-- Logs begin at Thu 2022-06-02 12:55:25 UTC, end at Thu 2022-06-02 13:57:38 UTC. -- Jun 02 13:21:38.320501 dv-cinder-836083-8-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 02 13:21:38.330468 dv-cinder-836083-8-iscsi devstack@keystone.service[80172]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 02 13:21:38.332797 dv-cinder-836083-8-iscsi devstack@keystone.service[80172]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 2 13:21:38 2022] *** Jun 02 13:21:38.332797 dv-cinder-836083-8-iscsi devstack@keystone.service[80172]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 02 13:21:38.332797 dv-cinder-836083-8-iscsi devstack@keystone.service[80172]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 02 13:21:38.332797 dv-cinder-836083-8-iscsi devstack@keystone.service[80172]: nodename: dv-cinder-836083-8-iscsi Jun 02 13:21:38.332797 dv-cinder-836083-8-iscsi devstack@keystone.service[80172]: machine: x86_64 Jun 02 13:21:38.332797 dv-cinder-836083-8-iscsi devstack@keystone.service[80172]: clock source: unix Jun 02 13:21:38.332797 dv-cinder-836083-8-iscsi devstack@keystone.service[80172]: pcre jit disabled Jun 02 13:21:38.332797 dv-cinder-836083-8-iscsi devstack@keystone.service[80172]: detected number of CPU cores: 4 Jun 02 13:21:38.332797 dv-cinder-836083-8-iscsi devstack@keystone.service[80172]: current working directory: / Jun 02 13:21:38.332797 dv-cinder-836083-8-iscsi devstack@keystone.service[80172]: detected binary path: /usr/bin/uwsgi-core Jun 02 13:21:38.333317 dv-cinder-836083-8-iscsi devstack@keystone.service[80172]: your processes number limit is 47680 Jun 02 13:21:38.333317 dv-cinder-836083-8-iscsi devstack@keystone.service[80172]: your memory page size is 4096 bytes Jun 02 13:21:38.333317 dv-cinder-836083-8-iscsi devstack@keystone.service[80172]: detected max file descriptor number: 2048 Jun 02 13:21:38.333317 dv-cinder-836083-8-iscsi devstack@keystone.service[80172]: lock engine: pthread robust mutexes Jun 02 13:21:38.333317 dv-cinder-836083-8-iscsi devstack@keystone.service[80172]: thunder lock: enabled Jun 02 13:21:38.333317 dv-cinder-836083-8-iscsi devstack@keystone.service[80172]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 02 13:21:38.333317 dv-cinder-836083-8-iscsi devstack@keystone.service[80172]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 02 13:21:38.377708 dv-cinder-836083-8-iscsi devstack@keystone.service[80172]: Python main interpreter initialized at 0x5587902a99c0 Jun 02 13:21:38.377708 dv-cinder-836083-8-iscsi devstack@keystone.service[80172]: python threads support enabled Jun 02 13:21:38.377708 dv-cinder-836083-8-iscsi devstack@keystone.service[80172]: your server socket listen backlog is limited to 100 connections Jun 02 13:21:38.377708 dv-cinder-836083-8-iscsi devstack@keystone.service[80172]: your mercy for graceful operations on workers is 90 seconds Jun 02 13:21:38.378032 dv-cinder-836083-8-iscsi devstack@keystone.service[80172]: mapped 403077 bytes (393 KB) for 2 cores Jun 02 13:21:38.378119 dv-cinder-836083-8-iscsi devstack@keystone.service[80172]: *** Operational MODE: preforking *** Jun 02 13:21:38.378395 dv-cinder-836083-8-iscsi devstack@keystone.service[80172]: *** uWSGI is running in multiple interpreter mode *** Jun 02 13:21:38.378395 dv-cinder-836083-8-iscsi devstack@keystone.service[80172]: spawned uWSGI master process (pid: 80172) Jun 02 13:21:38.378586 dv-cinder-836083-8-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 02 13:21:38.379149 dv-cinder-836083-8-iscsi devstack@keystone.service[80172]: spawned uWSGI worker 1 (pid: 80181, cores: 1) Jun 02 13:21:38.379442 dv-cinder-836083-8-iscsi devstack@keystone.service[80172]: spawned uWSGI worker 2 (pid: 80182, cores: 1) Jun 02 13:21:38.380349 dv-cinder-836083-8-iscsi devstack@keystone.service[80172]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 02 13:21:44.042329 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:21:44.042329 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: from cryptography.utils import int_from_bytes Jun 02 13:21:44.043063 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:21:44.043063 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: from cryptography.utils import int_from_bytes Jun 02 13:21:44.043168 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:21:44.043168 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: from cryptography.utils import int_from_bytes Jun 02 13:21:44.043580 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:21:44.043580 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: from cryptography.utils import int_from_bytes Jun 02 13:21:44.092422 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 13:21:44.092616 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 13:21:44.092810 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] command line args: [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 13:21:44.092907 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 13:21:44.093073 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 13:21:44.093157 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 13:21:44.093241 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ================================================================================ {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 13:21:44.093314 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] command line args: [] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 13:21:44.093488 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] admin_token = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.093576 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 13:21:44.093706 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ================================================================================ {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 13:21:44.093793 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] config_dir = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.093910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.093996 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] admin_token = **** {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.094093 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] config_source = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.094202 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] config_dir = [] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.094280 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] debug = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.094395 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.094475 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.095194 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] config_source = [] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.095194 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] debug = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.095392 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.095498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.095629 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.095728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.095823 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.095918 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.096024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.096127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.096230 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.096365 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.096476 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] log_config_append = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.096476 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.096680 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] list_limit = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.096767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] log_dir = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.096893 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] log_config_append = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.096969 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] log_file = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.097091 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.097091 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] log_dir = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.097283 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.097360 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] log_file = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.097474 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.097549 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.097669 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.097752 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.097837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.097911 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.098034 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.098034 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.098221 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.098310 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.098395 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.098395 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.098530 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.098608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.098681 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.098797 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.098884 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.098963 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.099079 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.099154 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.099274 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.099370 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.099449 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.099522 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.099641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.099717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.099831 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.099920 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.100119 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.100203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.32/identity {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.100346 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] publish_errors = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.100583 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.100669 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.32/identity {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.100831 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] publish_errors = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.100919 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.101049 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.101124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.101246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.101322 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.101436 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.101568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.101699 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.101782 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] standard_threads = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.101855 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.101935 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.102099 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.102187 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] standard_threads = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.102311 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.102393 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.102471 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] use_journal = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.102544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.102615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] use_json = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.102726 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.102806 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] use_stderr = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.102908 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] use_journal = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.102993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] use_syslog = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.103088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] use_json = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.103166 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.103815 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] use_stderr = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.103934 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.104014 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] use_syslog = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.104174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.104259 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:21:44.104460 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.104553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.104701 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.104836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.104957 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.105033 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.105173 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.105254 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.105419 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.105503 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.105656 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.105736 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.105902 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.105989 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.106148 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.106232 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.106394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.106477 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.106628 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.106709 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.106874 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.106996 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.107109 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.107190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.107354 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.107439 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.107590 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.107673 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.107824 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.107903 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.108074 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.108174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.108329 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.108413 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.108581 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.108658 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.108817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.108898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.109068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.109145 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.109307 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.109389 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.109563 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.109644 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.109809 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.109887 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.110040 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.110119 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.110272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.110358 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.110502 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.110586 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.110738 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.110816 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.110968 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.111047 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.111207 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.111285 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.111434 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.111510 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.111655 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.111730 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.111895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.111980 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.112135 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.112212 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.112391 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.112482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.112640 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.112719 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.112871 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.112958 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.113105 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.113183 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.113340 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.113416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.113567 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.113652 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.113796 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.113875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.114025 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.114110 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.114260 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.114394 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.114489 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.114565 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.114712 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.114793 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.114946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.115043 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.115182 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.115262 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.115415 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.115577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.115718 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.115862 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.116001 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.116130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.116130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.116431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.116431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.116682 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.116807 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.116964 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.117114 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.117240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.117362 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.117493 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.117617 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.117617 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.117850 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.117980 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.118101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.118231 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.118353 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.118474 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.118598 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.118730 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.118854 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.118986 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.119128 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.119205 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.119273 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.119399 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.119512 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.119636 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.119767 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.119891 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.120042 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.120120 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.120250 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.120395 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.120520 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.120651 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.120778 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.120901 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.121027 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.121153 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.121280 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.121414 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.121539 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.121665 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.121790 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.121917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.122062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.122196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.122321 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.122448 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.122574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.122699 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.122828 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.122965 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.123090 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.123215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.123345 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.123472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.123600 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.123805 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.123932 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.124057 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.124182 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.124320 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.124459 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.124588 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.124714 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.124838 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.124961 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.125087 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.125220 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.125346 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.125483 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.125620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.125749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.125919 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.126052 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.126175 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.126304 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.126430 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.126563 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.126689 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.126689 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.126943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.126943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.127190 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.127315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.127450 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.127576 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.127700 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.127832 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.127959 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.128085 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.128212 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.128378 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.128502 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.128640 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.128766 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.128889 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.129014 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.129149 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.129276 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.129410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.129536 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.129667 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.129794 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.external = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.129926 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.130052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.130188 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.130314 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.130439 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.130563 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.130687 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] auth.external = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.130845 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.password = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.130989 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.131121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.token = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.131254 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.131382 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.131505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.131632 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.131765 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] auth.password = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.131900 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.132026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] auth.token = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.132158 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.132284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.132426 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.132554 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.132700 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.132827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.132962 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.133094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.133220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.133347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.133483 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.133608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.133735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.133861 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.133987 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.134112 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] credential.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.134246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.134372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.134525 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.134525 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.134769 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.134769 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.135023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.135155 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.135282 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.135408 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.135536 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.135662 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.135801 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.135928 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.136054 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.136180 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.136356 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.136482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.136629 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.136782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.136906 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.137035 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.137163 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.137295 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.137430 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.137430 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.137669 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.137795 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.137923 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.138072 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.138208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.138335 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.138462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] federation.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.138596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.138725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.138851 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.139051 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.139179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.139306 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.139433 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.139558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.139685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.139820 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.139958 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.140085 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.140213 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.140354 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.140479 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.140612 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.140737 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.140860 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.140984 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.141108 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.141232 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.141363 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.141491 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.141625 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.141749 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.141872 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.142002 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.142139 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.142275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.142403 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.142531 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.142655 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.142786 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.142911 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.143040 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.143164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.143287 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.143420 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.143552 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.143676 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.143799 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.143923 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.144046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.144169 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.144358 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.144484 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.144611 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.144738 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.144864 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.144986 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.145137 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.145265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.145393 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.145519 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.145644 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.145774 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.145909 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.146050 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.146177 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.146303 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.146431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.146557 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.146692 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.146827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.146963 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.147092 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.147225 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.147350 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.147485 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.147612 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.147739 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.147866 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.147991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.148119 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.148251 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.148392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.148519 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.148653 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.148778 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.148902 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.149035 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.149161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.149286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.149410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.149535 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.149659 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.149791 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.149915 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.150528 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.150672 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.150799 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.150934 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.151067 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.151193 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.151318 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.151442 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.151565 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.151690 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.151822 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.151946 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.152071 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.152195 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.152372 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.152497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.152633 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.152769 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.152894 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.152894 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.153132 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.153257 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.153395 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.153521 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.153646 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.153770 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.153895 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.154020 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.154154 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.154286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.154422 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.154422 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.154658 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.154784 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.154918 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.155045 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.155172 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.155297 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.155424 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.155549 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.155686 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.155686 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.155923 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.156048 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.156185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.156344 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.156482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.156608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.156733 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.156858 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.156982 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.157114 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.157240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.157364 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.157489 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.157614 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.157738 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.157880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.158005 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.158129 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.158253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.158378 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.158502 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.158634 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.158759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.158884 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.159007 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.159131 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.159256 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.159388 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.159513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.159648 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.159773 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.159897 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.160021 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.160152 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.160277 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.160447 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.160575 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.160702 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.160828 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.160964 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.161090 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.161216 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.161341 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.161475 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.161600 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.161739 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.161867 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.161993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.162117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.162242 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.162369 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.162501 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.162627 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.162752 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.162877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.163001 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.163145 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.163293 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.163420 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.163545 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.163671 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.163796 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.163940 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.164142 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.164223 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.164311 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.164387 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.164460 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.164533 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.164623 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.164700 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] resource.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.164773 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.164846 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.164919 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.164992 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.165072 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.165146 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.165219 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.165291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.165363 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] role.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.165435 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.165516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] role.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.165590 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.165667 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.165770 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.165877 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.166454 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.166541 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.166617 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.166690 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.166763 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] role.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.166837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.166910 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] role.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.166990 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.167071 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.167146 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.167219 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.167292 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.167364 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.167445 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.167521 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.167594 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.167666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.167739 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.167811 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.167892 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.167967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.168040 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.168119 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.168194 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.168274 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.168395 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.168470 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.168543 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.168615 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.168687 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.168772 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.168848 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.168921 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.168994 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.169066 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.169139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.169139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.169279 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.169352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.169425 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.169497 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.169569 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.169650 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.169725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.169798 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.169869 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.169941 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.170013 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.170094 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.170169 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.170242 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.170315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.170388 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.170460 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.170541 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.170616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.170688 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.170760 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.170833 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.170905 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.170986 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.171060 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.171134 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] token.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.171207 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.171280 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.171352 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.171433 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.171508 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.171581 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.171653 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.171726 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.171805 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.171880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.171953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.172025 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.172096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] token.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.172169 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.172249 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.172339 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.172463 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.172541 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.172613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.172686 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.172770 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.172846 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.172919 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.172992 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.173064 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.173136 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.173216 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.173291 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.173363 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.173436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.173509 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.173582 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.173663 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.173738 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.173810 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.173883 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.connection = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.173964 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.174046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.174121 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.174194 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.174276 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.174351 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.174453 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.174560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.174697 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.174798 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.174998 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.175081 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.175259 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.175339 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.connection = **** {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.175493 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.175583 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.175736 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.175827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.175972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.176053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.176213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.176292 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.176469 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.176561 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.176714 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.176795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.176950 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.177030 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.177195 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.177285 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.177425 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.177506 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.177665 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.177745 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.177899 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.178051 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.178128 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 13:21:44.178202 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.178374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.178613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.178859 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.179092 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.179334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.179573 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:21:44.179746 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 13:21:44.207112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.207339 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.207567 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.207907 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.208146 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.208408 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.216602 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.217399 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.245041 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.245272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.246165 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.246399 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.299278 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.299903 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.349046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.349280 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.350270 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.350510 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.416016 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.416241 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.416491 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.416577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.416714 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.416821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.416931 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.417016 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.417145 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.417230 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.417383 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.417603 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.440582 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.440813 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.440898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.441042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.441129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.441262 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.441346 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.441477 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.441570 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.441691 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.441776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.441902 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.441987 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.442122 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.453718 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.454059 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.466416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.466648 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.466850 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.466950 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.467081 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.467165 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.467299 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.467383 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.467516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.467601 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.467731 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.467815 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.467950 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.468171 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:21:44.484647 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.484858 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 13:21:44.485194 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.485378 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.485460 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 13:21:44.485592 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 13:21:44.485678 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.485890 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.485972 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.486124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 13:21:44.486205 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.486384 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.486466 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.486648 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.486906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.487163 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.497947 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.498222 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.498486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.498762 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.498846 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.499270 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.499607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.500019 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.507506 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.508092 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.511341 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.511614 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.511892 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.511975 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.512170 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.512255 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.512472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.512558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.512779 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.512861 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.513062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.513152 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.513358 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.513440 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.513627 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.513710 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.513896 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.513987 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.514159 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.514242 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.514472 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.514739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.540337 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.542093 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.542372 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.543769 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.546334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.546617 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.547618 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.547902 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.548188 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.552828 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.553077 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.553370 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.555451 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.555731 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.560771 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.561167 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.561263 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.561449 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.561534 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.561731 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.562001 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.562272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.562536 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.562803 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.566312 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.566710 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.566994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.567276 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.567561 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.567840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.568112 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.568403 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.581849 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.582132 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.586708 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.587601 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.587882 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.590334 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.590622 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.592506 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.595520 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.596100 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.596422 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.599070 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.601337 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.604126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.604448 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.604734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.604937 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.605021 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.605286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.605565 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.609992 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.610293 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.610579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.610869 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.611149 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.611429 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.624962 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.625239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.625506 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.625776 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.631080 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.631366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.631636 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.631909 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.633701 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.635961 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.636232 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.639240 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.639517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.639810 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.640089 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.640408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.640702 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.642429 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.642705 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.645778 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.646059 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.646341 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.646621 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.646912 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.653644 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.653922 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.654199 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.654474 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.654751 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.655021 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.655292 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.660213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.660587 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.660871 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.661153 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.661434 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.661709 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.661983 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.673139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.676361 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.679630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.679928 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.681227 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.683377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.683654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.683737 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.683933 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.686999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.688629 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.690277 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.690554 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.690835 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.691278 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.692908 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.696066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.696374 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.696652 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.696942 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.698267 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.699882 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.703587 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.703877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.704158 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.704453 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.706435 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.706972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.707347 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.713780 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.714068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.714451 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.715280 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.715558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.715835 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.716108 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.716403 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.716693 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.716963 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.717238 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.717503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.717770 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.718036 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.718305 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.718574 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.718830 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.722457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:21:44.722735 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.723016 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.723553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.723834 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.724140 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.724437 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.724710 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.724984 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.725252 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.725519 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.725785 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.726066 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.726324 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:21:44.756711 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5587902a99c0 pid: 80181 (default app) Jun 02 13:21:44.760503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fa358-2837-4cba-8d7e-f9f5921b1d8c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:44.760794 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fa358-2837-4cba-8d7e-f9f5921b1d8c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:44.761069 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fa358-2837-4cba-8d7e-f9f5921b1d8c None None] PATH_INFO: `/v3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:44.764927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5587902a99c0 pid: 80182 (default app) Jun 02 13:21:44.765333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1/1] 10.222.0.32 () {50 vars in 791 bytes} [Thu Jun 2 13:21:44 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:21:52.716892 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a60cf2-5195-4b08-a511-4f4a1edbb659 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:52.717465 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a60cf2-5195-4b08-a511-4f4a1edbb659 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:52.717465 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a60cf2-5195-4b08-a511-4f4a1edbb659 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:52.721829 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1/2] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:21:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:21:52.727012 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb6d5b-8005-4734-b684-54ec19dc3336 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:52.727422 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb6d5b-8005-4734-b684-54ec19dc3336 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:52.727577 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb6d5b-8005-4734-b684-54ec19dc3336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:52.795887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: INFO dbcounter [None req-cacb6d5b-8005-4734-b684-54ec19dc3336 None None] Registered counter for database keystone Jun 02 13:21:52.817156 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG oslo_db.sqlalchemy.engines [None req-cacb6d5b-8005-4734-b684-54ec19dc3336 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80181) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:21:52.823795 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writer thread running {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:21:53.108112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG passlib.handlers.bcrypt [None req-cacb6d5b-8005-4734-b684-54ec19dc3336 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80181) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 02 13:21:53.108555 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG passlib.handlers.bcrypt [None req-cacb6d5b-8005-4734-b684-54ec19dc3336 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80181) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 02 13:21:53.163039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-cacb6d5b-8005-4734-b684-54ec19dc3336 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:53.164668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cacb6d5b-8005-4734-b684-54ec19dc3336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:53.286771 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 2/3] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:21:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 561 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 02 13:21:53.456607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a60cf2-5195-4b08-a511-4f4a1edbb659 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:53.525896 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: INFO dbcounter [None req-a6a60cf2-5195-4b08-a511-4f4a1edbb659 None None] Registered counter for database keystone Jun 02 13:21:53.545279 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG oslo_db.sqlalchemy.engines [None req-a6a60cf2-5195-4b08-a511-4f4a1edbb659 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80182) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:21:53.551499 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writer thread running {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:21:53.785584 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a60cf2-5195-4b08-a511-4f4a1edbb659 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:53.789840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5d4b5-2b9c-4e18-94ca-50262485b758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:53.790496 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5d4b5-2b9c-4e18-94ca-50262485b758 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:53.790802 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5d4b5-2b9c-4e18-94ca-50262485b758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:53.791263 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5d4b5-2b9c-4e18-94ca-50262485b758 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:53.799447 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5d4b5-2b9c-4e18-94ca-50262485b758 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:53.851273 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c6c5d4b5-2b9c-4e18-94ca-50262485b758 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 02 13:21:53.851617 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5d4b5-2b9c-4e18-94ca-50262485b758 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:53.860870 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 2/4] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Jun 2 13:21:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:21:53.866871 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb6d5b-8005-4734-b684-54ec19dc3336 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:53.881219 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb6d5b-8005-4734-b684-54ec19dc3336 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:53.886121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3c681-68ff-4a53-b213-2b8f7fee9a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:53.887263 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3c681-68ff-4a53-b213-2b8f7fee9a96 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:53.887555 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3c681-68ff-4a53-b213-2b8f7fee9a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:53.887833 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3c681-68ff-4a53-b213-2b8f7fee9a96 admin admin] PATH_INFO: `/v3/projects/0c7119c3fda547cdad0db42ad18b471e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:53.889379 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3c681-68ff-4a53-b213-2b8f7fee9a96 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c7119c3fda547cdad0db42ad18b471e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:53.940613 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: WARNING keystone.common.rbac_enforcer.enforcer [None req-70f3c681-68ff-4a53-b213-2b8f7fee9a96 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 02 13:21:53.940960 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3c681-68ff-4a53-b213-2b8f7fee9a96 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:53.945642 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 3/5] 10.222.0.32 () {56 vars in 1207 bytes} [Thu Jun 2 13:21:53 2022] GET /identity/v3/projects/0c7119c3fda547cdad0db42ad18b471e => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:21:56.126169 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cba99-2424-4688-a5cb-26ac1cb53652 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:56.126668 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cba99-2424-4688-a5cb-26ac1cb53652 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:56.126772 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cba99-2424-4688-a5cb-26ac1cb53652 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:56.130878 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 3/6] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:21:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:21:56.136360 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4065b3-ffa6-44b0-9491-48cf76b98a81 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:56.136812 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4065b3-ffa6-44b0-9491-48cf76b98a81 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:56.136907 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4065b3-ffa6-44b0-9491-48cf76b98a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:56.155215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0f4065b3-ffa6-44b0-9491-48cf76b98a81 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:56.156774 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0f4065b3-ffa6-44b0-9491-48cf76b98a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:56.164461 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 4/7] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:21:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 02 13:21:56.187021 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cba99-2424-4688-a5cb-26ac1cb53652 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:56.199149 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cba99-2424-4688-a5cb-26ac1cb53652 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:56.203366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c87ed7-c0d1-425b-9463-53dac0aae517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:56.203982 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c87ed7-c0d1-425b-9463-53dac0aae517 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:56.204267 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c87ed7-c0d1-425b-9463-53dac0aae517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:56.204574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c87ed7-c0d1-425b-9463-53dac0aae517 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:56.212423 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c87ed7-c0d1-425b-9463-53dac0aae517 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:56.214257 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c87ed7-c0d1-425b-9463-53dac0aae517 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:56.222857 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 4/8] 10.222.0.32 () {58 vars in 1324 bytes} [Thu Jun 2 13:21:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:21:56.227990 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4065b3-ffa6-44b0-9491-48cf76b98a81 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:56.237299 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4065b3-ffa6-44b0-9491-48cf76b98a81 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:56.241585 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffb360-bce0-4c83-b837-629d382cd583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:56.242427 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffb360-bce0-4c83-b837-629d382cd583 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:56.242708 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffb360-bce0-4c83-b837-629d382cd583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:56.242984 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffb360-bce0-4c83-b837-629d382cd583 admin admin] PATH_INFO: `/v3/users/9c16757fd814428091339e7b09bd9627` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:56.244952 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffb360-bce0-4c83-b837-629d382cd583 admin admin] RBAC: Authorizing `identity:get_user(user_id=9c16757fd814428091339e7b09bd9627)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:56.246763 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffb360-bce0-4c83-b837-629d382cd583 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:56.248309 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 5/9] 10.222.0.32 () {56 vars in 1198 bytes} [Thu Jun 2 13:21:56 2022] GET /identity/v3/users/9c16757fd814428091339e7b09bd9627 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:21:58.532747 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e9045-a6e2-4077-bd3d-064339256aa5 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:58.533266 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e9045-a6e2-4077-bd3d-064339256aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:58.533364 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e9045-a6e2-4077-bd3d-064339256aa5 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:58.534668 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 5/10] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:21:58.540003 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd851c-bfbf-413b-96dd-fb1979bcd7c6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:58.540430 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd851c-bfbf-413b-96dd-fb1979bcd7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:58.540612 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd851c-bfbf-413b-96dd-fb1979bcd7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:58.546710 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbd723-993b-4bb3-bfdb-4501262a0091 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:58.546999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbd723-993b-4bb3-bfdb-4501262a0091 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:58.547287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbd723-993b-4bb3-bfdb-4501262a0091 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:58.548617 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 6/11] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:21:58.553556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036beb2c-8e90-4b5b-9b74-947e5d25bae7 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:58.553845 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036beb2c-8e90-4b5b-9b74-947e5d25bae7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:58.554129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036beb2c-8e90-4b5b-9b74-947e5d25bae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:58.557174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f2dd851c-bfbf-413b-96dd-fb1979bcd7c6 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:58.558373 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f2dd851c-bfbf-413b-96dd-fb1979bcd7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:58.595184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG passlib.handlers.bcrypt [None req-036beb2c-8e90-4b5b-9b74-947e5d25bae7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80182) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 02 13:21:58.595614 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG passlib.handlers.bcrypt [None req-036beb2c-8e90-4b5b-9b74-947e5d25bae7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80182) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 02 13:21:58.638225 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 6/12] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:21:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:21:58.642776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-036beb2c-8e90-4b5b-9b74-947e5d25bae7 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:21:58.644395 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-036beb2c-8e90-4b5b-9b74-947e5d25bae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:21:58.661358 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd851c-bfbf-413b-96dd-fb1979bcd7c6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:58.684757 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:58.746182 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 7/13] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:21:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:21:58.765391 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd851c-bfbf-413b-96dd-fb1979bcd7c6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:58.768482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036beb2c-8e90-4b5b-9b74-947e5d25bae7 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:58.798287 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d835e-ff6f-4673-bf35-bdeea7268bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:58.799089 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d835e-ff6f-4673-bf35-bdeea7268bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:58.799381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d835e-ff6f-4673-bf35-bdeea7268bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:58.799664 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d835e-ff6f-4673-bf35-bdeea7268bc0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:58.812025 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d835e-ff6f-4673-bf35-bdeea7268bc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:21:58.823750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b01d835e-ff6f-4673-bf35-bdeea7268bc0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:21:58.823750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:21:58.823750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:21:58.823750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:21:58.823750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:21:58.823750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:21:58.823750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:21:58.823750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:21:58.823750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:21:58.823750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:21:58.823750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:21:58.823750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:21:58.823750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:21:58.823750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:21:58.823750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:21:58.823750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:21:58.824792 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:21:58.824792 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:21:58.824792 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:21:58.824792 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:21:58.824792 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:21:58.824792 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:21:58.824792 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:21:58.824792 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:21:58.824792 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:21:58.824792 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:21:58.824792 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:21:58.824792 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:21:58.824792 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:21:58.824792 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:21:58.824792 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:21:58.824792 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:21:58.825609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:21:58.825609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:21:58.825609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:21:58.825609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:21:58.825609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:21:58.825609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:21:58.825609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:21:58.825609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:21:58.825609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:21:58.825609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:21:58.825609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:21:58.825609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:21:58.825609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 7/14] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:21:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:21:58.830658 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d835e-ff6f-4673-bf35-bdeea7268bc0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:58.867535 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036beb2c-8e90-4b5b-9b74-947e5d25bae7 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:58.870323 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:58.904523 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8de1e-1e29-4e21-ad85-0da6f48b5ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:58.905421 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8de1e-1e29-4e21-ad85-0da6f48b5ffb None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:58.905712 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8de1e-1e29-4e21-ad85-0da6f48b5ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:58.905993 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8de1e-1e29-4e21-ad85-0da6f48b5ffb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:58.910784 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:58.929531 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d835e-ff6f-4673-bf35-bdeea7268bc0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:58.964237 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42eb73d-19a2-497e-9d68-3d0f3115a61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:58.964931 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eb73d-19a2-497e-9d68-3d0f3115a61e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:58.965221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eb73d-19a2-497e-9d68-3d0f3115a61e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:58.965504 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eb73d-19a2-497e-9d68-3d0f3115a61e None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:58.966256 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42eb73d-19a2-497e-9d68-3d0f3115a61e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:21:58.966570 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42eb73d-19a2-497e-9d68-3d0f3115a61e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:58.967983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42eb73d-19a2-497e-9d68-3d0f3115a61e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:58.975605 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8de1e-1e29-4e21-ad85-0da6f48b5ffb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:58.977158 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8de1e-1e29-4e21-ad85-0da6f48b5ffb None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:58.981461 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 8/15] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:21:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:21:58.986968 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42eb73d-19a2-497e-9d68-3d0f3115a61e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:59.076269 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 8/16] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:21:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:21:59.081615 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8de1e-1e29-4e21-ad85-0da6f48b5ffb None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:59.084539 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:59.089735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42eb73d-19a2-497e-9d68-3d0f3115a61e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:59.123543 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c67d1c-99a0-4ace-96d5-c7c7aad333a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:59.124461 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c67d1c-99a0-4ace-96d5-c7c7aad333a4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:59.124754 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c67d1c-99a0-4ace-96d5-c7c7aad333a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:59.125039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c67d1c-99a0-4ace-96d5-c7c7aad333a4 None admin] PATH_INFO: `/v3/users/9c16757fd814428091339e7b09bd9627` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:59.126259 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c67d1c-99a0-4ace-96d5-c7c7aad333a4 None admin] RBAC: Authorizing `identity:get_user(user_id=9c16757fd814428091339e7b09bd9627)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:59.127751 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c67d1c-99a0-4ace-96d5-c7c7aad333a4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:59.129408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 9/17] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:21:58 2022] GET /identity/v3/users/9c16757fd814428091339e7b09bd9627 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:21:59.135200 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c67d1c-99a0-4ace-96d5-c7c7aad333a4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:59.149276 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:59.181545 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8de1e-1e29-4e21-ad85-0da6f48b5ffb None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:59.215687 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15d2e4-7a1b-4a1f-950e-ddd1a844f76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:59.216500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15d2e4-7a1b-4a1f-950e-ddd1a844f76d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:59.216785 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15d2e4-7a1b-4a1f-950e-ddd1a844f76d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:59.217066 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15d2e4-7a1b-4a1f-950e-ddd1a844f76d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:59.234383 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c67d1c-99a0-4ace-96d5-c7c7aad333a4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:59.235201 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15d2e4-7a1b-4a1f-950e-ddd1a844f76d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:59.236703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15d2e4-7a1b-4a1f-950e-ddd1a844f76d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:59.257116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-ba15d2e4-7a1b-4a1f-950e-ddd1a844f76d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:21:59.257116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:21:59.257116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:21:59.257116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:21:59.257116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:21:59.257116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:21:59.257116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:21:59.257116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:21:59.257116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:21:59.257116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:21:59.257116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:21:59.257116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:21:59.257116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:21:59.257116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:21:59.257116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:21:59.258130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:21:59.258130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:21:59.258130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:21:59.258130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:21:59.258130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:21:59.258130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:21:59.258130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:21:59.258130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:21:59.258130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:21:59.258130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:21:59.258130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:21:59.258130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:21:59.258130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:21:59.258130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:21:59.258130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:21:59.258130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:21:59.258130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:21:59.259130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:21:59.259130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:21:59.259130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:21:59.259130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:21:59.259130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 9/18] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:21:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:21:59.264631 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15d2e4-7a1b-4a1f-950e-ddd1a844f76d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:59.270212 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eebd92-1fde-4e43-8064-0c72176960e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:59.271013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eebd92-1fde-4e43-8064-0c72176960e6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:59.271302 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eebd92-1fde-4e43-8064-0c72176960e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:59.271586 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eebd92-1fde-4e43-8064-0c72176960e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:59.272816 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eebd92-1fde-4e43-8064-0c72176960e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:59.274280 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eebd92-1fde-4e43-8064-0c72176960e6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:59.276500 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 10/19] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:21:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:21:59.282023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eebd92-1fde-4e43-8064-0c72176960e6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:21:59.320071 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:59.360838 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:21:59.364970 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15d2e4-7a1b-4a1f-950e-ddd1a844f76d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:59.380551 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eebd92-1fde-4e43-8064-0c72176960e6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:21:59.398560 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1464d2-d10d-44c8-917e-3e858973c9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:59.399219 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1464d2-d10d-44c8-917e-3e858973c9f6 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:59.399510 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1464d2-d10d-44c8-917e-3e858973c9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:59.399795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1464d2-d10d-44c8-917e-3e858973c9f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:59.400626 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1464d2-d10d-44c8-917e-3e858973c9f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:21:59.400942 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1464d2-d10d-44c8-917e-3e858973c9f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:59.402347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1464d2-d10d-44c8-917e-3e858973c9f6 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:59.413262 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577336b0-36a9-4b74-9d5d-de25fced0312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:21:59.413905 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577336b0-36a9-4b74-9d5d-de25fced0312 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:21:59.414188 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577336b0-36a9-4b74-9d5d-de25fced0312 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:21:59.414468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577336b0-36a9-4b74-9d5d-de25fced0312 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:21:59.415290 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577336b0-36a9-4b74-9d5d-de25fced0312 None admin] RBAC: Adding query filter params (role.id=128feb04d1e042ac844f9ad70b89bb02, scope.domain.id=default, user.id=9c16757fd814428091339e7b09bd9627) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:21:59.415602 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577336b0-36a9-4b74-9d5d-de25fced0312 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:21:59.417086 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577336b0-36a9-4b74-9d5d-de25fced0312 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:21:59.419419 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 10/20] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:21:59.423877 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 11/21] 10.222.0.32 () {56 vars in 1322 bytes} [Thu Jun 2 13:21:59 2022] GET /identity/v3/role_assignments?user.id=9c16757fd814428091339e7b09bd9627&scope.domain.id=default&role.id=128feb04d1e042ac844f9ad70b89bb02 => generated 233 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:22:02.085457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add47668-7fe9-4817-8c2f-fe07ff3d3442 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:02.086421 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add47668-7fe9-4817-8c2f-fe07ff3d3442 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:02.086942 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add47668-7fe9-4817-8c2f-fe07ff3d3442 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:02.089074 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 11/22] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:02.094680 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4464c-f3ae-4f51-a72d-7d71430691bb None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:02.095161 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4464c-f3ae-4f51-a72d-7d71430691bb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:02.095522 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4464c-f3ae-4f51-a72d-7d71430691bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:02.117677 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-10f4464c-f3ae-4f51-a72d-7d71430691bb None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:02.118880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-10f4464c-f3ae-4f51-a72d-7d71430691bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:02.192345 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304d003-0401-46b5-bb46-5e534debfd80 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:02.192980 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304d003-0401-46b5-bb46-5e534debfd80 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:02.193973 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304d003-0401-46b5-bb46-5e534debfd80 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:02.196149 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 12/23] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:22:02.205854 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d24f67-a6a5-4e8e-b878-2e97918155bc None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:02.206412 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d24f67-a6a5-4e8e-b878-2e97918155bc None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:02.206900 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d24f67-a6a5-4e8e-b878-2e97918155bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:02.227875 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 12/24] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:02.245300 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d6d24f67-a6a5-4e8e-b878-2e97918155bc None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:02.246835 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d6d24f67-a6a5-4e8e-b878-2e97918155bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:02.265454 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4464c-f3ae-4f51-a72d-7d71430691bb None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:02.398677 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 13/25] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 02 13:22:02.416671 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:02.432548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4464c-f3ae-4f51-a72d-7d71430691bb None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:02.435673 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d24f67-a6a5-4e8e-b878-2e97918155bc None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:02.481219 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8afcf4-9bf6-43d5-aebd-ffc7aad0b74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:02.484420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8afcf4-9bf6-43d5-aebd-ffc7aad0b74f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:02.484915 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8afcf4-9bf6-43d5-aebd-ffc7aad0b74f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:02.485391 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8afcf4-9bf6-43d5-aebd-ffc7aad0b74f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:02.508187 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8afcf4-9bf6-43d5-aebd-ffc7aad0b74f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:02.510584 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8afcf4-9bf6-43d5-aebd-ffc7aad0b74f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:02.517849 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:02.545691 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-fb8afcf4-9bf6-43d5-aebd-ffc7aad0b74f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:22:02.545691 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:02.545691 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:02.545691 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:02.545691 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:02.545691 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:02.545691 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:02.545691 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:02.545691 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:02.545691 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:02.545691 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:02.545691 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:02.545691 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:22:02.545691 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:22:02.545691 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:22:02.546557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:22:02.546557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:02.546557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:02.546557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:02.546557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:02.546557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:02.546557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:02.546557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:02.546557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:02.546557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:02.546557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:02.546557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:02.546557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:02.546557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:02.546557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:02.546557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:02.546557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:02.547360 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:22:02.547360 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:22:02.547360 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:22:02.547360 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:22:02.557185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 13/26] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:22:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:22:02.558610 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a46d03-2531-45ea-b9dc-8442dd839541 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:02.558902 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a46d03-2531-45ea-b9dc-8442dd839541 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:02.559184 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a46d03-2531-45ea-b9dc-8442dd839541 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:02.560731 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 14/27] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:02.561239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a46d03-2531-45ea-b9dc-8442dd839541 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:02.617590 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d24f67-a6a5-4e8e-b878-2e97918155bc None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:02.676955 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a85f0-b82a-4cfc-b11b-40bfea729bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:02.677765 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a85f0-b82a-4cfc-b11b-40bfea729bbb None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:02.678321 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a85f0-b82a-4cfc-b11b-40bfea729bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:02.678605 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a85f0-b82a-4cfc-b11b-40bfea729bbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:02.694841 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a85f0-b82a-4cfc-b11b-40bfea729bbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:02.710213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-388a85f0-b82a-4cfc-b11b-40bfea729bbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:22:02.710213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:02.710213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:02.710213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:02.710213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:02.710213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:02.710213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:02.710213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:02.710213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:02.710213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:02.710213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:02.710213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:02.710213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:02.710213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:02.710213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:02.710213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:02.711116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:02.711116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:02.711116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:02.711116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:02.711116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:02.711116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:02.711116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:02.711116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:02.711116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:02.711116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:02.711116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:02.711116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:02.711116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:02.711116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:02.711116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:02.711116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:02.711954 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:02.711954 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:02.711954 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:02.711954 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:02.711954 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:02.711954 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:02.711954 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:02.711954 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:02.711954 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:02.711954 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:02.711954 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:22:02.711954 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:22:02.714728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 14/28] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:22:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:22:02.715773 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642e892-7dc3-4bd1-b2f6-8305b944b73b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:02.716073 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642e892-7dc3-4bd1-b2f6-8305b944b73b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:02.716391 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642e892-7dc3-4bd1-b2f6-8305b944b73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:02.733320 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-0642e892-7dc3-4bd1-b2f6-8305b944b73b None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:02.734529 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0642e892-7dc3-4bd1-b2f6-8305b944b73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:02.735812 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a46d03-2531-45ea-b9dc-8442dd839541 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:02.771087 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:02.784677 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260ca2b-b930-470b-9240-a5a3d19f8ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:02.786132 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260ca2b-b930-470b-9240-a5a3d19f8ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:02.786626 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260ca2b-b930-470b-9240-a5a3d19f8ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:02.787503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260ca2b-b930-470b-9240-a5a3d19f8ae9 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:02.788731 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260ca2b-b930-470b-9240-a5a3d19f8ae9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:02.789246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260ca2b-b930-470b-9240-a5a3d19f8ae9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:02.792091 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260ca2b-b930-470b-9240-a5a3d19f8ae9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:02.815129 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 15/29] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:02.816496 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718d97e-96fd-4d90-a740-13593edc6a1c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:02.816773 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718d97e-96fd-4d90-a740-13593edc6a1c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:02.816970 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 15/30] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:02.817067 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718d97e-96fd-4d90-a740-13593edc6a1c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:02.818194 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642e892-7dc3-4bd1-b2f6-8305b944b73b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:02.818582 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 16/31] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:02.823788 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bfb24-a0c0-4f5b-8917-3c341d31b9c0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:02.824080 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bfb24-a0c0-4f5b-8917-3c341d31b9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:02.824456 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bfb24-a0c0-4f5b-8917-3c341d31b9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:02.841930 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-772bfb24-a0c0-4f5b-8917-3c341d31b9c0 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:02.843424 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-772bfb24-a0c0-4f5b-8917-3c341d31b9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:02.863681 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:02.916521 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 17/32] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:22:02.917941 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bfb24-a0c0-4f5b-8917-3c341d31b9c0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:02.960404 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642e892-7dc3-4bd1-b2f6-8305b944b73b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:02.998144 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7153c26-2f5b-420e-aa7e-d30ae91b1947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:02.998836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7153c26-2f5b-420e-aa7e-d30ae91b1947 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:02.999126 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7153c26-2f5b-420e-aa7e-d30ae91b1947 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:02.999409 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7153c26-2f5b-420e-aa7e-d30ae91b1947 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:03.000190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7153c26-2f5b-420e-aa7e-d30ae91b1947 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:03.001147 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7153c26-2f5b-420e-aa7e-d30ae91b1947 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:03.002003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7153c26-2f5b-420e-aa7e-d30ae91b1947 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:03.016002 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 16/33] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:03.016677 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7153c26-2f5b-420e-aa7e-d30ae91b1947 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:03.042297 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bfb24-a0c0-4f5b-8917-3c341d31b9c0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:03.060481 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:03.081097 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743cd06-49e9-4c8f-9f09-bcf7f78833c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:03.082136 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743cd06-49e9-4c8f-9f09-bcf7f78833c8 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:03.083071 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743cd06-49e9-4c8f-9f09-bcf7f78833c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:03.083571 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743cd06-49e9-4c8f-9f09-bcf7f78833c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:03.084987 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743cd06-49e9-4c8f-9f09-bcf7f78833c8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:03.087182 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743cd06-49e9-4c8f-9f09-bcf7f78833c8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:03.120346 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7153c26-2f5b-420e-aa7e-d30ae91b1947 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:03.128726 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:03.170781 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ac96b-4447-4af9-8bf4-26445da61c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:03.171799 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ac96b-4447-4af9-8bf4-26445da61c58 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:03.172268 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ac96b-4447-4af9-8bf4-26445da61c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:03.172724 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ac96b-4447-4af9-8bf4-26445da61c58 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:03.173631 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ac96b-4447-4af9-8bf4-26445da61c58 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:03.175218 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ac96b-4447-4af9-8bf4-26445da61c58 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:03.238062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 18/34] 10.222.0.32 () {60 vars in 1141 bytes} [Thu Jun 2 13:22:02 2022] POST /identity/v3/projects => generated 301 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:03.239251 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743cd06-49e9-4c8f-9f09-bcf7f78833c8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:03.305070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 17/35] 10.222.0.32 () {60 vars in 1131 bytes} [Thu Jun 2 13:22:03 2022] POST /identity/v3/roles => generated 225 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:03.306224 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ac96b-4447-4af9-8bf4-26445da61c58 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:03.384687 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743cd06-49e9-4c8f-9f09-bcf7f78833c8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:03.428672 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ac96b-4447-4af9-8bf4-26445da61c58 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:03.439475 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31905378-2e80-4a88-869e-375aa4bade02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:03.441039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31905378-2e80-4a88-869e-375aa4bade02 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:03.441471 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31905378-2e80-4a88-869e-375aa4bade02 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:03.442356 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31905378-2e80-4a88-869e-375aa4bade02 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:03.443651 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31905378-2e80-4a88-869e-375aa4bade02 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:03.445744 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31905378-2e80-4a88-869e-375aa4bade02 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:03.468641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 19/36] 10.222.0.32 () {60 vars in 1131 bytes} [Thu Jun 2 13:22:03 2022] POST /identity/v3/roles => generated 219 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:03.470393 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68581719-95c8-489e-8520-439d5bfcff2f None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:03.470694 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68581719-95c8-489e-8520-439d5bfcff2f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:03.470981 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68581719-95c8-489e-8520-439d5bfcff2f None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:03.472439 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 20/37] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:03.476812 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72344094-af79-4269-bf9a-c4c9de63129e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:03.478225 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72344094-af79-4269-bf9a-c4c9de63129e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:03.479346 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72344094-af79-4269-bf9a-c4c9de63129e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:03.479878 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72344094-af79-4269-bf9a-c4c9de63129e None admin] PATH_INFO: `/v3/users/9c16757fd814428091339e7b09bd9627` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:03.482078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587ce78-6c2a-43a4-8fb6-7ab22e3b1b60 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:03.482380 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587ce78-6c2a-43a4-8fb6-7ab22e3b1b60 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:03.482636 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72344094-af79-4269-bf9a-c4c9de63129e None admin] RBAC: Authorizing `identity:get_user(user_id=9c16757fd814428091339e7b09bd9627)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:03.482758 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587ce78-6c2a-43a4-8fb6-7ab22e3b1b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:03.484705 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72344094-af79-4269-bf9a-c4c9de63129e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:03.487247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 18/38] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:03 2022] GET /identity/v3/users/9c16757fd814428091339e7b09bd9627 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:03.493474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72344094-af79-4269-bf9a-c4c9de63129e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:03.511867 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e587ce78-6c2a-43a4-8fb6-7ab22e3b1b60 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:03.521831 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e587ce78-6c2a-43a4-8fb6-7ab22e3b1b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:03.539411 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:03.574654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:03.640056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72344094-af79-4269-bf9a-c4c9de63129e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:03.653630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 21/39] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:03.683355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587ce78-6c2a-43a4-8fb6-7ab22e3b1b60 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:03.687379 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582db20-7d85-4636-b9a6-336980894e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:03.688490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582db20-7d85-4636-b9a6-336980894e2a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:03.688997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582db20-7d85-4636-b9a6-336980894e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:03.689456 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582db20-7d85-4636-b9a6-336980894e2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:03.691052 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582db20-7d85-4636-b9a6-336980894e2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:03.692794 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582db20-7d85-4636-b9a6-336980894e2a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:03.694711 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 19/40] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:22:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:03.702271 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582db20-7d85-4636-b9a6-336980894e2a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:03.827635 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:03.836173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582db20-7d85-4636-b9a6-336980894e2a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:03.856254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587ce78-6c2a-43a4-8fb6-7ab22e3b1b60 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:03.874608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0e34a-91e7-4117-9acd-221181a2ce24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:03.875556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0e34a-91e7-4117-9acd-221181a2ce24 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:03.875851 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0e34a-91e7-4117-9acd-221181a2ce24 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:03.876138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0e34a-91e7-4117-9acd-221181a2ce24 None admin] PATH_INFO: `/v3/domains/default/users/9c16757fd814428091339e7b09bd9627/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:03.878237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb0e34a-91e7-4117-9acd-221181a2ce24 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9c16757fd814428091339e7b09bd9627, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:03.879816 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb0e34a-91e7-4117-9acd-221181a2ce24 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:03.893039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fca12-2970-48b9-8173-6ec54fc4e994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:03.893806 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fca12-2970-48b9-8173-6ec54fc4e994 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:03.894100 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fca12-2970-48b9-8173-6ec54fc4e994 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:03.894383 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fca12-2970-48b9-8173-6ec54fc4e994 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:03.895137 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4fca12-2970-48b9-8173-6ec54fc4e994 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:03.896292 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 20/41] 10.222.0.32 () {58 vars in 1361 bytes} [Thu Jun 2 13:22:03 2022] PUT /identity/v3/domains/default/users/9c16757fd814428091339e7b09bd9627/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:03.896649 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4fca12-2970-48b9-8173-6ec54fc4e994 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:03.920355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 22/42] 10.222.0.32 () {60 vars in 1131 bytes} [Thu Jun 2 13:22:03 2022] POST /identity/v3/roles => generated 223 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:04.086761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478dd4d-5d01-45e6-a5ec-649cd0f2618e None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:04.087072 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478dd4d-5d01-45e6-a5ec-649cd0f2618e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:04.087240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478dd4d-5d01-45e6-a5ec-649cd0f2618e None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:04.089040 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 21/43] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:04.094750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f12829-b274-4b32-a9b1-12ffefa0b427 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:04.095035 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f12829-b274-4b32-a9b1-12ffefa0b427 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:04.095322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f12829-b274-4b32-a9b1-12ffefa0b427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:04.115157 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c3f12829-b274-4b32-a9b1-12ffefa0b427 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:04.116428 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c3f12829-b274-4b32-a9b1-12ffefa0b427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:04.132498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:04.190001 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 23/44] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:04.213877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478dd4d-5d01-45e6-a5ec-649cd0f2618e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:04.313798 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478dd4d-5d01-45e6-a5ec-649cd0f2618e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:04.345967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414420bf-c307-45ae-8072-4139c481f546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:04.346697 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414420bf-c307-45ae-8072-4139c481f546 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:04.346987 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414420bf-c307-45ae-8072-4139c481f546 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:04.347269 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414420bf-c307-45ae-8072-4139c481f546 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:04.348489 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414420bf-c307-45ae-8072-4139c481f546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:04.349947 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414420bf-c307-45ae-8072-4139c481f546 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:04.351565 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 22/45] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:22:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:04.357535 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f12829-b274-4b32-a9b1-12ffefa0b427 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:04.457801 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f12829-b274-4b32-a9b1-12ffefa0b427 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:04.490901 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb4e8c-d917-42cc-adeb-93c068f4685a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:04.491560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb4e8c-d917-42cc-adeb-93c068f4685a None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:04.491848 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb4e8c-d917-42cc-adeb-93c068f4685a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:04.492127 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb4e8c-d917-42cc-adeb-93c068f4685a None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:04.492885 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb4e8c-d917-42cc-adeb-93c068f4685a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:04.494894 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb4e8c-d917-42cc-adeb-93c068f4685a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:04.513586 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:04.524491 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 24/46] 10.222.0.32 () {60 vars in 1141 bytes} [Thu Jun 2 13:22:04 2022] POST /identity/v3/projects => generated 312 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:06.125464 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ce1a1-dd68-4731-8cd5-cfdfc2d0555e None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:06.125977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ce1a1-dd68-4731-8cd5-cfdfc2d0555e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:06.126057 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ce1a1-dd68-4731-8cd5-cfdfc2d0555e None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:06.127389 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 23/47] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:06.132466 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98834ce5-5772-4323-a277-b6735eb4272e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:06.132882 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98834ce5-5772-4323-a277-b6735eb4272e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:06.133044 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98834ce5-5772-4323-a277-b6735eb4272e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:06.150846 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-98834ce5-5772-4323-a277-b6735eb4272e None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:06.152065 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-98834ce5-5772-4323-a277-b6735eb4272e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:06.217890 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 25/48] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:06.240895 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ce1a1-dd68-4731-8cd5-cfdfc2d0555e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:06.266621 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:06.342783 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ce1a1-dd68-4731-8cd5-cfdfc2d0555e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:06.375146 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e62ee-5cb9-4489-a55b-d128a35c9ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:06.375942 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e62ee-5cb9-4489-a55b-d128a35c9ccd None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:06.376234 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e62ee-5cb9-4489-a55b-d128a35c9ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:06.376540 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e62ee-5cb9-4489-a55b-d128a35c9ccd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:06.387040 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e62ee-5cb9-4489-a55b-d128a35c9ccd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:06.394778 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-1f7e62ee-5cb9-4489-a55b-d128a35c9ccd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:22:06.394778 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:06.394778 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:06.394778 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:06.394778 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:06.394778 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:06.394778 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:06.394778 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:06.394778 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:06.394778 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:06.394778 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:06.394778 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:06.394778 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:06.394778 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:06.394778 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:06.394778 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:06.395795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:06.395795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:06.395795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:06.395795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:06.395795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:06.395795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:06.395795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:06.395795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:06.395795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:06.395795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:06.395795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:06.395795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:06.395795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:06.395795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:06.395795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:06.395795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:06.396616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:06.396616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:06.396616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:06.396616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:06.396616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:06.396616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:06.396616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:06.396616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:06.396616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:06.396616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:06.396616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:22:06.396616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:22:06.396616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 24/49] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:22:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:06.404078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98834ce5-5772-4323-a277-b6735eb4272e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:06.507136 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98834ce5-5772-4323-a277-b6735eb4272e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:06.537012 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:06.543067 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033d768-5e96-49cd-889d-efef840bd2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:06.543738 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033d768-5e96-49cd-889d-efef840bd2a0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:06.544029 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033d768-5e96-49cd-889d-efef840bd2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:06.544350 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033d768-5e96-49cd-889d-efef840bd2a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:06.545165 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033d768-5e96-49cd-889d-efef840bd2a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:06.545476 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033d768-5e96-49cd-889d-efef840bd2a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:06.547156 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033d768-5e96-49cd-889d-efef840bd2a0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:06.555434 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 26/50] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:06.561434 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e62ee-5cb9-4489-a55b-d128a35c9ccd None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:06.643199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:06.661568 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e62ee-5cb9-4489-a55b-d128a35c9ccd None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:06.695138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac076fe-f76c-4f58-b0ef-b03900441098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:06.696020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac076fe-f76c-4f58-b0ef-b03900441098 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:06.696355 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac076fe-f76c-4f58-b0ef-b03900441098 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:06.696689 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac076fe-f76c-4f58-b0ef-b03900441098 None admin] PATH_INFO: `/v3/users/9c16757fd814428091339e7b09bd9627` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:06.698488 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac076fe-f76c-4f58-b0ef-b03900441098 None admin] RBAC: Authorizing `identity:get_user(user_id=9c16757fd814428091339e7b09bd9627)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:06.699927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac076fe-f76c-4f58-b0ef-b03900441098 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:06.701588 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 25/51] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:06 2022] GET /identity/v3/users/9c16757fd814428091339e7b09bd9627 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:06.706905 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033d768-5e96-49cd-889d-efef840bd2a0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:06.736533 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47925440-9012-4008-b709-ce3ee64f0922 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:06.736826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47925440-9012-4008-b709-ce3ee64f0922 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:06.737148 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47925440-9012-4008-b709-ce3ee64f0922 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:06.738507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 26/52] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:22:06.743689 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17109ee4-e22c-4958-9cbc-83e9fe719613 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:06.744531 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17109ee4-e22c-4958-9cbc-83e9fe719613 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:06.744821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17109ee4-e22c-4958-9cbc-83e9fe719613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:06.761686 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-17109ee4-e22c-4958-9cbc-83e9fe719613 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:06.763186 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-17109ee4-e22c-4958-9cbc-83e9fe719613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:06.810145 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033d768-5e96-49cd-889d-efef840bd2a0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:06.833497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 27/53] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:22:06.844368 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079efa70-6575-4ab4-88d2-21c7693c536e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:06.845167 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079efa70-6575-4ab4-88d2-21c7693c536e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:06.845452 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079efa70-6575-4ab4-88d2-21c7693c536e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:06.845727 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079efa70-6575-4ab4-88d2-21c7693c536e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:06.846908 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079efa70-6575-4ab4-88d2-21c7693c536e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:06.848388 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079efa70-6575-4ab4-88d2-21c7693c536e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:06.849997 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 27/54] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:22:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:22:06.856158 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17109ee4-e22c-4958-9cbc-83e9fe719613 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:06.858160 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079efa70-6575-4ab4-88d2-21c7693c536e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:06.915451 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:06.933741 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:06.953945 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17109ee4-e22c-4958-9cbc-83e9fe719613 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:06.956645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079efa70-6575-4ab4-88d2-21c7693c536e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:06.987466 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7354d2-9f6c-419b-b06c-b278e51d3fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:06.988122 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7354d2-9f6c-419b-b06c-b278e51d3fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:06.988445 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7354d2-9f6c-419b-b06c-b278e51d3fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:06.988729 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7354d2-9f6c-419b-b06c-b278e51d3fa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:06.989570 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7354d2-9f6c-419b-b06c-b278e51d3fa3 None admin] RBAC: Adding query filter params (role.id=128feb04d1e042ac844f9ad70b89bb02, scope.domain.id=default, user.id=9c16757fd814428091339e7b09bd9627) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:06.989885 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7354d2-9f6c-419b-b06c-b278e51d3fa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:06.989970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f324b18-206e-41b6-b70e-795fec1ff11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:06.990736 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f324b18-206e-41b6-b70e-795fec1ff11f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:06.991030 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f324b18-206e-41b6-b70e-795fec1ff11f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:06.991316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f324b18-206e-41b6-b70e-795fec1ff11f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:06.991400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7354d2-9f6c-419b-b06c-b278e51d3fa3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:06.992535 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f324b18-206e-41b6-b70e-795fec1ff11f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:06.993991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f324b18-206e-41b6-b70e-795fec1ff11f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:06.995619 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 28/55] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:22:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:22:06.999372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 28/56] 10.222.0.32 () {56 vars in 1322 bytes} [Thu Jun 2 13:22:06 2022] GET /identity/v3/role_assignments?user.id=9c16757fd814428091339e7b09bd9627&scope.domain.id=default&role.id=128feb04d1e042ac844f9ad70b89bb02 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:22:07.001246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f324b18-206e-41b6-b70e-795fec1ff11f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:07.109556 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f324b18-206e-41b6-b70e-795fec1ff11f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:07.137259 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:07.145985 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03c318-ebad-4742-a331-87baee325b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:07.146704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03c318-ebad-4742-a331-87baee325b88 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:07.146993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03c318-ebad-4742-a331-87baee325b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:07.147272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03c318-ebad-4742-a331-87baee325b88 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:07.148003 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03c318-ebad-4742-a331-87baee325b88 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:07.149506 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03c318-ebad-4742-a331-87baee325b88 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:07.176955 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 29/57] 10.222.0.32 () {60 vars in 1140 bytes} [Thu Jun 2 13:22:07 2022] POST /identity/v3/projects => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:09.407625 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc098f-d9d5-40f5-b535-1fd1add0fe97 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:09.408158 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc098f-d9d5-40f5-b535-1fd1add0fe97 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:09.408266 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc098f-d9d5-40f5-b535-1fd1add0fe97 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:09.409594 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 29/58] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:09.414986 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9ea74-7ec1-4526-91fc-71cb233c3f00 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:09.415346 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9ea74-7ec1-4526-91fc-71cb233c3f00 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:09.415559 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9ea74-7ec1-4526-91fc-71cb233c3f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:09.432045 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f2a9ea74-7ec1-4526-91fc-71cb233c3f00 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:09.433299 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f2a9ea74-7ec1-4526-91fc-71cb233c3f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:09.498012 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 30/59] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:09.522417 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc098f-d9d5-40f5-b535-1fd1add0fe97 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:09.622081 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc098f-d9d5-40f5-b535-1fd1add0fe97 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:09.654796 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730acc3-a948-475c-8f53-54a576869b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:09.655581 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730acc3-a948-475c-8f53-54a576869b57 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:09.655872 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730acc3-a948-475c-8f53-54a576869b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:09.656160 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730acc3-a948-475c-8f53-54a576869b57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:09.657363 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730acc3-a948-475c-8f53-54a576869b57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:09.659839 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730acc3-a948-475c-8f53-54a576869b57 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:09.661576 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 30/60] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:22:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:09.668188 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9ea74-7ec1-4526-91fc-71cb233c3f00 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:09.768955 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9ea74-7ec1-4526-91fc-71cb233c3f00 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:09.781891 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:09.808221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d65a1-b8b7-4614-a20c-4fc486b9d601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:09.808935 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d65a1-b8b7-4614-a20c-4fc486b9d601 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:09.809223 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d65a1-b8b7-4614-a20c-4fc486b9d601 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:09.809553 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d65a1-b8b7-4614-a20c-4fc486b9d601 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:09.810270 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d65a1-b8b7-4614-a20c-4fc486b9d601 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:09.811732 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d65a1-b8b7-4614-a20c-4fc486b9d601 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:09.838054 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 31/61] 10.222.0.32 () {60 vars in 1132 bytes} [Thu Jun 2 13:22:09 2022] POST /identity/v3/users => generated 275 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:13.210747 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2547cf6-f196-4031-bce2-4f59cee27b79 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:13.211649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2547cf6-f196-4031-bce2-4f59cee27b79 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:13.212078 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2547cf6-f196-4031-bce2-4f59cee27b79 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:13.214470 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 31/62] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:13.220118 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd404d1-8aa5-4e60-9964-4abc4fa078e8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:13.220692 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd404d1-8aa5-4e60-9964-4abc4fa078e8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:13.220974 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd404d1-8aa5-4e60-9964-4abc4fa078e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:13.249490 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9cd404d1-8aa5-4e60-9964-4abc4fa078e8 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:13.250796 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9cd404d1-8aa5-4e60-9964-4abc4fa078e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:13.265551 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54207f7-a5c5-4310-a95a-caab2809a396 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:13.266148 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54207f7-a5c5-4310-a95a-caab2809a396 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:13.266627 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54207f7-a5c5-4310-a95a-caab2809a396 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:13.268203 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 32/63] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:13.277516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfae17-af6a-484a-8da2-305f82c581c6 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:13.278098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfae17-af6a-484a-8da2-305f82c581c6 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:13.278617 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfae17-af6a-484a-8da2-305f82c581c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:13.303988 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-03cfae17-af6a-484a-8da2-305f82c581c6 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:13.305238 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-03cfae17-af6a-484a-8da2-305f82c581c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:13.322944 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:13.364998 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 32/64] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:13.392770 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd404d1-8aa5-4e60-9964-4abc4fa078e8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:13.423309 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 33/65] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:22:13.460375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cfae17-af6a-484a-8da2-305f82c581c6 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:13.516818 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:13.535557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd404d1-8aa5-4e60-9964-4abc4fa078e8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:13.586003 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e44e5d-c3bb-4dad-a2a4-0d60f9b5ae70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:13.587731 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e44e5d-c3bb-4dad-a2a4-0d60f9b5ae70 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:13.588236 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e44e5d-c3bb-4dad-a2a4-0d60f9b5ae70 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:13.588733 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e44e5d-c3bb-4dad-a2a4-0d60f9b5ae70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:13.602722 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e44e5d-c3bb-4dad-a2a4-0d60f9b5ae70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:13.613412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b7e44e5d-c3bb-4dad-a2a4-0d60f9b5ae70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:22:13.613412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:13.613412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:13.613412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:13.613412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:13.613412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:13.613412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:13.613412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:13.613412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:13.613412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:13.613412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:13.613412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:13.613412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:13.613412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:13.613412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:13.613412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:13.614272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:13.614272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:13.614272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:13.614272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:13.614272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:13.614272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:13.614272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:13.614272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:13.614272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:13.614272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:13.614272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:13.614272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:13.614272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:13.614272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:13.614272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:13.614272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:13.615038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:13.615038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:13.615038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:13.615038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:13.615038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:13.615038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:13.615038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:13.615038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:13.615038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:13.615038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:13.615038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:22:13.615038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:22:13.615613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cfae17-af6a-484a-8da2-305f82c581c6 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:13.618802 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 33/66] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:22:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:22:13.620894 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4d24d-0946-4b14-becb-dffc2293aafa None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:13.621400 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4d24d-0946-4b14-becb-dffc2293aafa None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:13.621882 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4d24d-0946-4b14-becb-dffc2293aafa None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:13.623359 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 34/67] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:13.628396 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4d24d-0946-4b14-becb-dffc2293aafa None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:13.657711 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83911ec3-e496-402e-941b-fc5bc356bc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:13.658924 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83911ec3-e496-402e-941b-fc5bc356bc3c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:13.659484 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83911ec3-e496-402e-941b-fc5bc356bc3c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:13.659959 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83911ec3-e496-402e-941b-fc5bc356bc3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:13.671468 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83911ec3-e496-402e-941b-fc5bc356bc3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:13.680055 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-83911ec3-e496-402e-941b-fc5bc356bc3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:13.680055 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:13.680055 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:13.680055 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:13.680055 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:13.680055 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:13.680055 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:13.680055 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:13.680055 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:13.680055 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:13.680055 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:13.680055 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:13.680055 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:13.680055 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:13.680055 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:13.680055 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:13.681049 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:13.681049 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:13.681049 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:13.681049 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:13.681049 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:13.681049 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:13.681049 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:13.681049 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:13.681049 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:13.681049 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:13.681049 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:13.681049 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:13.681049 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:13.681049 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:13.681049 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:13.681049 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:13.682366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:13.682366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:13.682366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:13.682366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:13.682366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:13.682366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:13.682366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:13.682366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:13.682366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:13.682366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:13.682366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:13.682366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:22:13.685150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 34/68] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:22:13.686565 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53dcd39-c44e-4d7e-934c-bd27b89480e4 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:13.687072 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53dcd39-c44e-4d7e-934c-bd27b89480e4 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:13.687627 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53dcd39-c44e-4d7e-934c-bd27b89480e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:13.692993 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:13.707202 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b53dcd39-c44e-4d7e-934c-bd27b89480e4 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:13.709183 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b53dcd39-c44e-4d7e-934c-bd27b89480e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:13.743565 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4d24d-0946-4b14-becb-dffc2293aafa None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:13.783701 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 35/69] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:13.785249 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369fba5-bbbe-4abb-bd18-f2cc92ad1460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:13.786532 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369fba5-bbbe-4abb-bd18-f2cc92ad1460 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:13.787258 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369fba5-bbbe-4abb-bd18-f2cc92ad1460 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:13.787933 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369fba5-bbbe-4abb-bd18-f2cc92ad1460 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:13.789445 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369fba5-bbbe-4abb-bd18-f2cc92ad1460 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:13.789571 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53dcd39-c44e-4d7e-934c-bd27b89480e4 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:13.790092 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369fba5-bbbe-4abb-bd18-f2cc92ad1460 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:13.792242 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369fba5-bbbe-4abb-bd18-f2cc92ad1460 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:13.802840 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 35/70] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:13.809740 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369fba5-bbbe-4abb-bd18-f2cc92ad1460 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:13.837227 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:13.914820 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53dcd39-c44e-4d7e-934c-bd27b89480e4 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:13.920206 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369fba5-bbbe-4abb-bd18-f2cc92ad1460 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:13.944356 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:13.949889 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13723a3-a42d-4ab9-a8fb-14a600361783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:13.950557 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13723a3-a42d-4ab9-a8fb-14a600361783 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:13.950846 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13723a3-a42d-4ab9-a8fb-14a600361783 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:13.951130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13723a3-a42d-4ab9-a8fb-14a600361783 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:13.951885 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13723a3-a42d-4ab9-a8fb-14a600361783 None admin] RBAC: Adding query filter params (name=member) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:13.952201 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13723a3-a42d-4ab9-a8fb-14a600361783 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:13.953627 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13723a3-a42d-4ab9-a8fb-14a600361783 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:13.954973 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd204e9f-17f7-4fdd-b37c-989da4107b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:13.955850 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd204e9f-17f7-4fdd-b37c-989da4107b35 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:13.956136 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd204e9f-17f7-4fdd-b37c-989da4107b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:13.956444 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd204e9f-17f7-4fdd-b37c-989da4107b35 None admin] PATH_INFO: `/v3/users/9c16757fd814428091339e7b09bd9627` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:13.957640 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd204e9f-17f7-4fdd-b37c-989da4107b35 None admin] RBAC: Authorizing `identity:get_user(user_id=9c16757fd814428091339e7b09bd9627)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:13.959408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd204e9f-17f7-4fdd-b37c-989da4107b35 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:13.961062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 36/71] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:13 2022] GET /identity/v3/users/9c16757fd814428091339e7b09bd9627 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:13.961823 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd204e9f-17f7-4fdd-b37c-989da4107b35 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:13.961979 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 36/72] 10.222.0.32 () {56 vars in 1101 bytes} [Thu Jun 2 13:22:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:13.963277 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8a21a-0412-4d74-9435-a082ac25b6b9 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:13.963573 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8a21a-0412-4d74-9435-a082ac25b6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:13.963857 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8a21a-0412-4d74-9435-a082ac25b6b9 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:13.965227 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 37/73] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:13.966189 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df157b59-1e98-4389-bd1f-0cc510ed7599 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:13.966481 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df157b59-1e98-4389-bd1f-0cc510ed7599 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:13.966769 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df157b59-1e98-4389-bd1f-0cc510ed7599 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:13.967988 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 38/74] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:13.972699 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df157b59-1e98-4389-bd1f-0cc510ed7599 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:14.055468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:14.072110 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd204e9f-17f7-4fdd-b37c-989da4107b35 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:14.073711 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df157b59-1e98-4389-bd1f-0cc510ed7599 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:14.106108 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc375c60-b1f9-4530-bb58-8c0c6d12f5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:14.106695 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de0157-3512-4bc6-9dca-a081462f066a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:14.107023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc375c60-b1f9-4530-bb58-8c0c6d12f5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:14.107340 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de0157-3512-4bc6-9dca-a081462f066a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:14.107428 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc375c60-b1f9-4530-bb58-8c0c6d12f5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:14.107631 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de0157-3512-4bc6-9dca-a081462f066a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:14.107719 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc375c60-b1f9-4530-bb58-8c0c6d12f5d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:14.107913 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de0157-3512-4bc6-9dca-a081462f066a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:14.118547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc375c60-b1f9-4530-bb58-8c0c6d12f5d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:14.126724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-dc375c60-b1f9-4530-bb58-8c0c6d12f5d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:22:14.126724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:14.126724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:14.126724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:14.126724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:14.126724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:14.126724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:14.126724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:14.126724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:14.126724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:14.126724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:14.126724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:14.126724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:14.126724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:14.126724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:14.126724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:14.127588 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:14.127588 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:14.127588 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:14.127588 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:14.127588 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:14.127588 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:14.127588 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:14.127588 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:14.127588 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:14.127588 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:14.127588 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:14.127588 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:14.127588 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:14.127588 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:14.127588 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:14.127588 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:14.128398 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:14.128398 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:14.128398 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:14.128398 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:14.128398 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:14.128398 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:14.128398 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:14.128398 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:14.128398 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:14.128398 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:14.128398 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:22:14.128398 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:22:14.128398 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 37/75] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Jun 2 13:22:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:14.129278 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc375c60-b1f9-4530-bb58-8c0c6d12f5d7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:14.174104 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:14.182002 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de0157-3512-4bc6-9dca-a081462f066a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:14.183480 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de0157-3512-4bc6-9dca-a081462f066a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:14.228389 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc375c60-b1f9-4530-bb58-8c0c6d12f5d7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:14.261456 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909aac06-d1d7-476c-bef9-765cf7070aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:14.262328 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909aac06-d1d7-476c-bef9-765cf7070aab None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:14.262613 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909aac06-d1d7-476c-bef9-765cf7070aab None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:14.262891 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909aac06-d1d7-476c-bef9-765cf7070aab None admin] PATH_INFO: `/v3/users/e5ce74481717495db8afe81424370eaf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:14.276320 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909aac06-d1d7-476c-bef9-765cf7070aab None admin] RBAC: Authorizing `identity:get_user(user_id=e5ce74481717495db8afe81424370eaf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:14.277809 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909aac06-d1d7-476c-bef9-765cf7070aab None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:14.279469 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 38/76] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:14 2022] GET /identity/v3/users/e5ce74481717495db8afe81424370eaf => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:14.284138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 39/77] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:22:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:14.284138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb76b1-05c3-421f-b6f3-d38cac3c1054 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:14.284138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb76b1-05c3-421f-b6f3-d38cac3c1054 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:14.284784 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cfd19-04a9-49ec-aaa9-35b86813bebc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:14.284854 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb76b1-05c3-421f-b6f3-d38cac3c1054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:14.284921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cfd19-04a9-49ec-aaa9-35b86813bebc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:14.284921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cfd19-04a9-49ec-aaa9-35b86813bebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:14.288134 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:14.299734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3d6cfd19-04a9-49ec-aaa9-35b86813bebc None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:14.299877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-1cdb76b1-05c3-421f-b6f3-d38cac3c1054 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:14.300999 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3d6cfd19-04a9-49ec-aaa9-35b86813bebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:14.301102 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1cdb76b1-05c3-421f-b6f3-d38cac3c1054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:14.366370 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 39/78] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:14.367211 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cfd19-04a9-49ec-aaa9-35b86813bebc None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:14.380490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 40/79] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:14.380490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb76b1-05c3-421f-b6f3-d38cac3c1054 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:14.395324 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:14.470606 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb76b1-05c3-421f-b6f3-d38cac3c1054 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:14.477442 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cfd19-04a9-49ec-aaa9-35b86813bebc None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:14.503175 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfe4cd-4989-460a-8ce9-fbd2203c2dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:14.503820 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfe4cd-4989-460a-8ce9-fbd2203c2dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:14.504106 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfe4cd-4989-460a-8ce9-fbd2203c2dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:14.504420 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfe4cd-4989-460a-8ce9-fbd2203c2dc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:14.510532 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7488884-2539-4550-bea2-80e7383e89be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:14.511194 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7488884-2539-4550-bea2-80e7383e89be None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:14.511480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7488884-2539-4550-bea2-80e7383e89be None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:14.511763 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7488884-2539-4550-bea2-80e7383e89be None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:14.512543 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7488884-2539-4550-bea2-80e7383e89be None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:14.512856 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7488884-2539-4550-bea2-80e7383e89be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:14.514261 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7488884-2539-4550-bea2-80e7383e89be None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:14.515611 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:14.522987 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 40/80] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:22:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:14.523776 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7488884-2539-4550-bea2-80e7383e89be None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:14.576810 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfe4cd-4989-460a-8ce9-fbd2203c2dc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:14.578324 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfe4cd-4989-460a-8ce9-fbd2203c2dc8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:14.602420 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:14.620847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7488884-2539-4550-bea2-80e7383e89be None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:14.654016 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad727b-bcec-4b9a-a5c8-8f73d785853b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:14.654885 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad727b-bcec-4b9a-a5c8-8f73d785853b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:14.655182 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad727b-bcec-4b9a-a5c8-8f73d785853b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:14.655462 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad727b-bcec-4b9a-a5c8-8f73d785853b None admin] PATH_INFO: `/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:14.656676 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad727b-bcec-4b9a-a5c8-8f73d785853b None admin] RBAC: Authorizing `identity:get_project(project_id=f8b3b94854ab4f878d89ba44b09b07ea)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:14.658144 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad727b-bcec-4b9a-a5c8-8f73d785853b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:14.659848 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 41/81] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:14 2022] GET /identity/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:14.660636 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad727b-bcec-4b9a-a5c8-8f73d785853b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:14.676953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 41/82] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:22:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:14.677997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfe4cd-4989-460a-8ce9-fbd2203c2dc8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:14.727297 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:14.764316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad727b-bcec-4b9a-a5c8-8f73d785853b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:14.776163 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfe4cd-4989-460a-8ce9-fbd2203c2dc8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:14.797932 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4805e6-4f53-40e0-b59d-1bad3fdadcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:14.798756 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:14.799086 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4805e6-4f53-40e0-b59d-1bad3fdadcfd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:14.799384 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4805e6-4f53-40e0-b59d-1bad3fdadcfd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:14.799672 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4805e6-4f53-40e0-b59d-1bad3fdadcfd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:14.800989 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4805e6-4f53-40e0-b59d-1bad3fdadcfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:14.802481 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4805e6-4f53-40e0-b59d-1bad3fdadcfd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:14.804368 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 42/83] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:22:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:14.804939 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4805e6-4f53-40e0-b59d-1bad3fdadcfd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:14.815461 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279f11e-67e5-40f8-8faf-fc10aaa671c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:14.816254 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279f11e-67e5-40f8-8faf-fc10aaa671c6 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:14.816571 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279f11e-67e5-40f8-8faf-fc10aaa671c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:14.816854 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279f11e-67e5-40f8-8faf-fc10aaa671c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:14.827541 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279f11e-67e5-40f8-8faf-fc10aaa671c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:14.835718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-c279f11e-67e5-40f8-8faf-fc10aaa671c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:14.835718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:14.835718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:14.835718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:14.835718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:14.835718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:14.835718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:14.835718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:14.835718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:14.835718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:14.835718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:14.835718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:14.835718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:14.835718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:14.835718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:14.835718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:14.836759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:14.836759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:14.836759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:14.836759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:14.836759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:14.836759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:14.836759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:14.836759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:14.836759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:14.836759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:14.836759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:14.836759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:14.836759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:14.836759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:14.836759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:14.836759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:14.837577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:14.837577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:14.837577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:14.837577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:14.837577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:14.837577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:14.837577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:14.837577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:14.837577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:14.837577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:14.837577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:14.837577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:22:14.837577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 42/84] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:14.838591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279f11e-67e5-40f8-8faf-fc10aaa671c6 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:14.906405 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4805e6-4f53-40e0-b59d-1bad3fdadcfd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:14.934716 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:14.935042 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279f11e-67e5-40f8-8faf-fc10aaa671c6 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:14.940316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431514b-1cd3-4842-af00-66d1cd5e1193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:14.941227 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431514b-1cd3-4842-af00-66d1cd5e1193 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:14.941513 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431514b-1cd3-4842-af00-66d1cd5e1193 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:14.941789 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431514b-1cd3-4842-af00-66d1cd5e1193 None admin] PATH_INFO: `/v3/users/e5ce74481717495db8afe81424370eaf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:14.942992 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431514b-1cd3-4842-af00-66d1cd5e1193 None admin] RBAC: Authorizing `identity:get_user(user_id=e5ce74481717495db8afe81424370eaf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:14.944494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431514b-1cd3-4842-af00-66d1cd5e1193 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:14.946132 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 43/85] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:14 2022] GET /identity/v3/users/e5ce74481717495db8afe81424370eaf => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:14.946892 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431514b-1cd3-4842-af00-66d1cd5e1193 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:14.969294 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84277cc4-ff65-4b74-ade9-115b74069997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:14.969940 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84277cc4-ff65-4b74-ade9-115b74069997 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:14.970228 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84277cc4-ff65-4b74-ade9-115b74069997 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:14.970508 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84277cc4-ff65-4b74-ade9-115b74069997 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:14.971345 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84277cc4-ff65-4b74-ade9-115b74069997 None admin] RBAC: Adding query filter params (role.id=128feb04d1e042ac844f9ad70b89bb02, scope.project.id=f8b3b94854ab4f878d89ba44b09b07ea, user.id=9c16757fd814428091339e7b09bd9627) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:14.971663 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84277cc4-ff65-4b74-ade9-115b74069997 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:14.973146 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84277cc4-ff65-4b74-ade9-115b74069997 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:14.979076 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 43/86] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:22:14 2022] GET /identity/v3/role_assignments?user.id=9c16757fd814428091339e7b09bd9627&scope.project.id=f8b3b94854ab4f878d89ba44b09b07ea&role.id=128feb04d1e042ac844f9ad70b89bb02 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:14.979711 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84277cc4-ff65-4b74-ade9-115b74069997 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:15.044335 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:15.067139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431514b-1cd3-4842-af00-66d1cd5e1193 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:15.101627 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84277cc4-ff65-4b74-ade9-115b74069997 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:15.108171 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f74023-691d-42ea-a9a8-a9dae0dd8c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:15.109097 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f74023-691d-42ea-a9a8-a9dae0dd8c30 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:15.109391 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f74023-691d-42ea-a9a8-a9dae0dd8c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:15.110183 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f74023-691d-42ea-a9a8-a9dae0dd8c30 None admin] PATH_INFO: `/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:15.111488 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f74023-691d-42ea-a9a8-a9dae0dd8c30 None admin] RBAC: Authorizing `identity:get_project(project_id=f8b3b94854ab4f878d89ba44b09b07ea)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:15.113755 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f74023-691d-42ea-a9a8-a9dae0dd8c30 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:15.115736 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 44/87] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:14 2022] GET /identity/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:15.121168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f74023-691d-42ea-a9a8-a9dae0dd8c30 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:15.144584 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390075c8-37ce-4024-b5c9-f0ffc5c58057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:15.145265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390075c8-37ce-4024-b5c9-f0ffc5c58057 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:15.145582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390075c8-37ce-4024-b5c9-f0ffc5c58057 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:15.145839 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390075c8-37ce-4024-b5c9-f0ffc5c58057 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:15.146574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390075c8-37ce-4024-b5c9-f0ffc5c58057 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:15.148080 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390075c8-37ce-4024-b5c9-f0ffc5c58057 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:15.180160 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 44/88] 10.222.0.32 () {60 vars in 1132 bytes} [Thu Jun 2 13:22:14 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:15.180834 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390075c8-37ce-4024-b5c9-f0ffc5c58057 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:15.199405 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:15.252987 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f74023-691d-42ea-a9a8-a9dae0dd8c30 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:15.300025 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d4c8b-6ad8-477d-ab8e-03c87189b0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:15.300950 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d4c8b-6ad8-477d-ab8e-03c87189b0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:15.301405 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d4c8b-6ad8-477d-ab8e-03c87189b0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:15.301695 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d4c8b-6ad8-477d-ab8e-03c87189b0e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:15.302835 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d4c8b-6ad8-477d-ab8e-03c87189b0e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:15.303152 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d4c8b-6ad8-477d-ab8e-03c87189b0e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:15.304694 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d4c8b-6ad8-477d-ab8e-03c87189b0e8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:15.317321 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 45/89] 10.222.0.32 () {56 vars in 1101 bytes} [Thu Jun 2 13:22:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:15.318495 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d4c8b-6ad8-477d-ab8e-03c87189b0e8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:15.320337 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390075c8-37ce-4024-b5c9-f0ffc5c58057 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:15.324544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:15.367206 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b4aaf-e4b5-41bf-8e52-d1a0c01179c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:15.367873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b4aaf-e4b5-41bf-8e52-d1a0c01179c9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:15.368161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b4aaf-e4b5-41bf-8e52-d1a0c01179c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:15.368496 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b4aaf-e4b5-41bf-8e52-d1a0c01179c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:15.455212 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d4c8b-6ad8-477d-ab8e-03c87189b0e8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:15.459806 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b4aaf-e4b5-41bf-8e52-d1a0c01179c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:15.461339 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b4aaf-e4b5-41bf-8e52-d1a0c01179c9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:15.502329 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:15.512564 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c6097-3897-469e-9d19-d2d3de186ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:15.514015 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c6097-3897-469e-9d19-d2d3de186ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:15.514504 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c6097-3897-469e-9d19-d2d3de186ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:15.516039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c6097-3897-469e-9d19-d2d3de186ed5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:15.516039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c6097-3897-469e-9d19-d2d3de186ed5 None admin] RBAC: Adding query filter params (role.id=e4d5af06c5a44d479d25ce8490ce71a0, scope.project.id=f8b3b94854ab4f878d89ba44b09b07ea, user.id=e5ce74481717495db8afe81424370eaf) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:15.516039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c6097-3897-469e-9d19-d2d3de186ed5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:15.518327 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c6097-3897-469e-9d19-d2d3de186ed5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:15.525932 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 46/90] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:22:15 2022] GET /identity/v3/role_assignments?user.id=e5ce74481717495db8afe81424370eaf&scope.project.id=f8b3b94854ab4f878d89ba44b09b07ea&role.id=e4d5af06c5a44d479d25ce8490ce71a0 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:15.527201 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c6097-3897-469e-9d19-d2d3de186ed5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:15.604117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 45/91] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:22:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:15.612549 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b4aaf-e4b5-41bf-8e52-d1a0c01179c9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:15.624681 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:15.691629 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c6097-3897-469e-9d19-d2d3de186ed5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:15.766707 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860cc01-b0bd-41d7-98f1-063522f466b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:15.767526 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860cc01-b0bd-41d7-98f1-063522f466b2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:15.767821 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860cc01-b0bd-41d7-98f1-063522f466b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:15.768105 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860cc01-b0bd-41d7-98f1-063522f466b2 None admin] PATH_INFO: `/v3/users/e5ce74481717495db8afe81424370eaf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:15.770043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860cc01-b0bd-41d7-98f1-063522f466b2 None admin] RBAC: Authorizing `identity:get_user(user_id=e5ce74481717495db8afe81424370eaf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:15.771559 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860cc01-b0bd-41d7-98f1-063522f466b2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:15.773557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 47/92] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:15 2022] GET /identity/v3/users/e5ce74481717495db8afe81424370eaf => generated 275 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:15.779547 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b4aaf-e4b5-41bf-8e52-d1a0c01179c9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:15.780673 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860cc01-b0bd-41d7-98f1-063522f466b2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:15.834971 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2d045-b6dd-4d3d-a707-f9d550923bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:15.837480 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2d045-b6dd-4d3d-a707-f9d550923bea None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:15.838676 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2d045-b6dd-4d3d-a707-f9d550923bea None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:15.839151 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2d045-b6dd-4d3d-a707-f9d550923bea None admin] PATH_INFO: `/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:15.840985 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2d045-b6dd-4d3d-a707-f9d550923bea None admin] RBAC: Authorizing `identity:get_project(project_id=f8b3b94854ab4f878d89ba44b09b07ea)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:15.843497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2d045-b6dd-4d3d-a707-f9d550923bea None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:15.847829 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 46/93] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:15 2022] GET /identity/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:15.853718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2d045-b6dd-4d3d-a707-f9d550923bea None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:15.896055 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:15.960339 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860cc01-b0bd-41d7-98f1-063522f466b2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:15.968217 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:16.032815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5145170-526d-40c4-b1c6-ce7dda430e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:16.034857 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2d045-b6dd-4d3d-a707-f9d550923bea None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:16.040428 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5145170-526d-40c4-b1c6-ce7dda430e23 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:16.041460 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5145170-526d-40c4-b1c6-ce7dda430e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:16.043307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5145170-526d-40c4-b1c6-ce7dda430e23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:16.129687 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b69f34-ce07-48dc-aed3-4ac274d931a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:16.130369 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b69f34-ce07-48dc-aed3-4ac274d931a8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:16.130653 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b69f34-ce07-48dc-aed3-4ac274d931a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:16.130927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b69f34-ce07-48dc-aed3-4ac274d931a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:16.131783 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b69f34-ce07-48dc-aed3-4ac274d931a8 None admin] RBAC: Adding query filter params (role.id=5fe1cb1c673a407bb1025d500f111390, scope.project.id=f8b3b94854ab4f878d89ba44b09b07ea, user.id=e5ce74481717495db8afe81424370eaf) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:16.132098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b69f34-ce07-48dc-aed3-4ac274d931a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:16.133633 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b69f34-ce07-48dc-aed3-4ac274d931a8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:16.140875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 47/94] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:22:15 2022] GET /identity/v3/role_assignments?user.id=e5ce74481717495db8afe81424370eaf&scope.project.id=f8b3b94854ab4f878d89ba44b09b07ea&role.id=5fe1cb1c673a407bb1025d500f111390 => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:16.204514 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5145170-526d-40c4-b1c6-ce7dda430e23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:16.206278 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5145170-526d-40c4-b1c6-ce7dda430e23 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:16.298370 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:16.354829 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 48/95] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:22:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:16.360722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b69f34-ce07-48dc-aed3-4ac274d931a8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:16.499943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b69f34-ce07-48dc-aed3-4ac274d931a8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:16.535216 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c9c4a-3554-4673-b6ae-e69bf2745aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:16.536078 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c9c4a-3554-4673-b6ae-e69bf2745aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:16.536390 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c9c4a-3554-4673-b6ae-e69bf2745aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:16.536671 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c9c4a-3554-4673-b6ae-e69bf2745aa3 None admin] PATH_INFO: `/v3/projects/c04bfb860e46478681fc3214bd8f773d` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:16.537913 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c9c4a-3554-4673-b6ae-e69bf2745aa3 None admin] RBAC: Authorizing `identity:get_project(project_id=c04bfb860e46478681fc3214bd8f773d)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:16.539372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c9c4a-3554-4673-b6ae-e69bf2745aa3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:16.541886 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 48/96] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:16 2022] GET /identity/v3/projects/c04bfb860e46478681fc3214bd8f773d => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:16.549713 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5145170-526d-40c4-b1c6-ce7dda430e23 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:16.694491 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5145170-526d-40c4-b1c6-ce7dda430e23 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:16.741155 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189998d0-a144-48e0-b442-14c7d12fd5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:16.741818 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189998d0-a144-48e0-b442-14c7d12fd5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:16.742114 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189998d0-a144-48e0-b442-14c7d12fd5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:16.742400 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189998d0-a144-48e0-b442-14c7d12fd5b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:16.743241 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189998d0-a144-48e0-b442-14c7d12fd5b7 None admin] RBAC: Adding query filter params (role.id=e4d5af06c5a44d479d25ce8490ce71a0, scope.project.id=c04bfb860e46478681fc3214bd8f773d, user.id=e5ce74481717495db8afe81424370eaf) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:16.743560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189998d0-a144-48e0-b442-14c7d12fd5b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:16.745077 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189998d0-a144-48e0-b442-14c7d12fd5b7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:16.756653 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 49/97] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:22:16 2022] GET /identity/v3/role_assignments?user.id=e5ce74481717495db8afe81424370eaf&scope.project.id=c04bfb860e46478681fc3214bd8f773d&role.id=e4d5af06c5a44d479d25ce8490ce71a0 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:18.050872 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98083f7-3805-4597-9e2b-1a6c2c8be96b None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:18.051853 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98083f7-3805-4597-9e2b-1a6c2c8be96b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:18.052364 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98083f7-3805-4597-9e2b-1a6c2c8be96b None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:18.054055 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 49/98] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:18.066229 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e1154-6601-461a-9a87-21e1cbdd53f3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:18.066738 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e1154-6601-461a-9a87-21e1cbdd53f3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:18.066811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e1154-6601-461a-9a87-21e1cbdd53f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:18.087597 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ed2e1154-6601-461a-9a87-21e1cbdd53f3 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:18.089754 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ed2e1154-6601-461a-9a87-21e1cbdd53f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:18.114107 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:18.162701 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 50/99] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:18.197907 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98083f7-3805-4597-9e2b-1a6c2c8be96b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:18.205410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:18.306472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc944b-3982-4106-a68a-cb1406daf41b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:18.306799 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc944b-3982-4106-a68a-cb1406daf41b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:18.307057 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc944b-3982-4106-a68a-cb1406daf41b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:18.309148 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 51/100] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:18.315405 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92f021-b436-4e7b-be47-1415a723ab2e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:18.316059 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92f021-b436-4e7b-be47-1415a723ab2e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:18.316588 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92f021-b436-4e7b-be47-1415a723ab2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:18.338810 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4f92f021-b436-4e7b-be47-1415a723ab2e None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:18.340643 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4f92f021-b436-4e7b-be47-1415a723ab2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:18.343348 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98083f7-3805-4597-9e2b-1a6c2c8be96b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:18.433044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde0eaf-9335-47bf-bd23-346bc131f4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:18.433873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde0eaf-9335-47bf-bd23-346bc131f4de None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:18.434164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde0eaf-9335-47bf-bd23-346bc131f4de None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:18.434453 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde0eaf-9335-47bf-bd23-346bc131f4de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:18.461616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde0eaf-9335-47bf-bd23-346bc131f4de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:18.469840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-8bde0eaf-9335-47bf-bd23-346bc131f4de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:22:18.469840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:18.469840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:18.469840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:18.469840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:18.469840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:18.469840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:18.469840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:18.469840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:18.469840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:18.469840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:18.469840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:18.469840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:18.469840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:18.469840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:18.469840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:18.470684 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:18.470684 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:18.470684 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:18.470684 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:18.470684 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:18.470684 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:18.470684 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:18.470684 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:18.470684 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:18.470684 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:18.470684 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:18.470684 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:18.470684 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:18.470684 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:18.470684 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:18.470684 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:18.471457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:18.471457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:18.471457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:18.471457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:18.471457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:18.471457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:18.471457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:18.471457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:18.471457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:18.471457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:18.471457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:22:18.471457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:22:18.471457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 50/101] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:22:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:18.475669 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 52/102] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:22:18.481337 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde0eaf-9335-47bf-bd23-346bc131f4de None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:18.513556 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92f021-b436-4e7b-be47-1415a723ab2e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:18.609709 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:18.675632 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:18.691586 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92f021-b436-4e7b-be47-1415a723ab2e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:18.696287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde0eaf-9335-47bf-bd23-346bc131f4de None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:18.727251 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25032476-6233-418f-8394-b0befeb5e907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:18.728958 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25032476-6233-418f-8394-b0befeb5e907 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:18.729473 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25032476-6233-418f-8394-b0befeb5e907 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:18.729976 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25032476-6233-418f-8394-b0befeb5e907 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:18.742426 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25032476-6233-418f-8394-b0befeb5e907 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:18.751390 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-25032476-6233-418f-8394-b0befeb5e907 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:22:18.751390 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:18.751390 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:18.751390 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:18.751390 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:18.751390 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:18.751390 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:18.751390 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:18.751390 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:18.751390 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:18.751390 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:18.751390 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:18.751390 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:18.751390 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:18.751390 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:18.751390 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:18.752247 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:18.752247 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:18.752247 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:18.752247 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:18.752247 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:18.752247 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:18.752247 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:18.752247 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:18.752247 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:18.752247 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:18.752247 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:18.752247 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:18.752247 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:18.752247 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:18.752247 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:18.752247 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:18.753046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:18.753046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:18.753046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:18.753046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:18.753046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:18.753046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:18.753046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:18.753046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:18.753046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:18.753046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:18.753046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:22:18.753046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:22:18.755833 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 53/103] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:18.757472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e4730-9aa4-4fa8-96b4-88d5d02b8895 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:18.757960 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e4730-9aa4-4fa8-96b4-88d5d02b8895 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:18.758428 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e4730-9aa4-4fa8-96b4-88d5d02b8895 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:18.760014 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 54/104] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:18.764992 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e4730-9aa4-4fa8-96b4-88d5d02b8895 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:18.765615 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e15c89-c6a1-49a7-884d-92da5cfe9854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:18.766436 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e15c89-c6a1-49a7-884d-92da5cfe9854 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:18.766734 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e15c89-c6a1-49a7-884d-92da5cfe9854 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:18.767020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e15c89-c6a1-49a7-884d-92da5cfe9854 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:18.767793 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e15c89-c6a1-49a7-884d-92da5cfe9854 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:18.768115 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e15c89-c6a1-49a7-884d-92da5cfe9854 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:18.769687 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e15c89-c6a1-49a7-884d-92da5cfe9854 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:18.786418 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 51/105] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:18.788105 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100f3a9-4da5-450a-a523-51170b97e492 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:18.788641 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100f3a9-4da5-450a-a523-51170b97e492 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:18.789240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100f3a9-4da5-450a-a523-51170b97e492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:18.822387 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6100f3a9-4da5-450a-a523-51170b97e492 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:18.823627 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6100f3a9-4da5-450a-a523-51170b97e492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:18.955833 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 52/106] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:18.956693 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100f3a9-4da5-450a-a523-51170b97e492 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:18.988188 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e4730-9aa4-4fa8-96b4-88d5d02b8895 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:19.053983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2057f-3c4b-4fea-906f-9589ce5d6700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:19.054668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2057f-3c4b-4fea-906f-9589ce5d6700 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:19.054959 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2057f-3c4b-4fea-906f-9589ce5d6700 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:19.055242 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2057f-3c4b-4fea-906f-9589ce5d6700 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:19.056004 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c2057f-3c4b-4fea-906f-9589ce5d6700 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:19.056335 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c2057f-3c4b-4fea-906f-9589ce5d6700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:19.057812 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c2057f-3c4b-4fea-906f-9589ce5d6700 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:19.072764 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 55/107] 10.222.0.32 () {56 vars in 1101 bytes} [Thu Jun 2 13:22:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:19.073617 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2057f-3c4b-4fea-906f-9589ce5d6700 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:19.075083 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:19.100066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:19.158036 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100f3a9-4da5-450a-a523-51170b97e492 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:19.203779 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb10109-9191-41d3-9277-0c9ccbbd1346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:19.205063 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb10109-9191-41d3-9277-0c9ccbbd1346 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:19.205575 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb10109-9191-41d3-9277-0c9ccbbd1346 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:19.206097 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb10109-9191-41d3-9277-0c9ccbbd1346 None admin] PATH_INFO: `/v3/users/9c16757fd814428091339e7b09bd9627` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:19.207556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb10109-9191-41d3-9277-0c9ccbbd1346 None admin] RBAC: Authorizing `identity:get_user(user_id=9c16757fd814428091339e7b09bd9627)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:19.209803 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb10109-9191-41d3-9277-0c9ccbbd1346 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:19.211765 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 53/108] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:18 2022] GET /identity/v3/users/9c16757fd814428091339e7b09bd9627 => generated 247 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:19.213479 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb10109-9191-41d3-9277-0c9ccbbd1346 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:19.230502 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2057f-3c4b-4fea-906f-9589ce5d6700 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:19.266427 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6e7e6-6ac9-46e0-9c79-b413afadc20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:19.267465 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6e7e6-6ac9-46e0-9c79-b413afadc20e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:19.267901 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6e7e6-6ac9-46e0-9c79-b413afadc20e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:19.268399 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6e7e6-6ac9-46e0-9c79-b413afadc20e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:19.279848 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c6e7e6-6ac9-46e0-9c79-b413afadc20e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:19.289956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-53c6e7e6-6ac9-46e0-9c79-b413afadc20e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:19.289956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:19.289956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:19.289956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:19.289956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:19.289956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:19.289956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:19.289956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:19.289956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:19.289956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:19.289956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:19.289956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:19.289956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:19.289956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:19.289956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:19.289956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:19.291023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:19.291023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:19.291023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:19.291023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:19.291023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:19.291023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:19.291023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:19.291023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:19.291023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:19.291023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:19.291023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:19.291023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:19.291023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:19.291023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:19.291023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:19.291023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:19.291904 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:19.291904 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:19.291904 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:19.291904 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:19.291904 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:19.291904 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:19.291904 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:19.291904 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:19.291904 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:19.291904 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:19.291904 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:19.291904 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:22:19.294147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 56/109] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:19.295139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6e7e6-6ac9-46e0-9c79-b413afadc20e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:19.372682 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:19.377459 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb10109-9191-41d3-9277-0c9ccbbd1346 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:19.413014 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:19.422674 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6e7e6-6ac9-46e0-9c79-b413afadc20e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:19.425181 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa2aa7-7742-4ef3-a3d7-7211be7d4d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:19.426339 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa2aa7-7742-4ef3-a3d7-7211be7d4d56 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:19.426828 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa2aa7-7742-4ef3-a3d7-7211be7d4d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:19.427304 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa2aa7-7742-4ef3-a3d7-7211be7d4d56 None admin] PATH_INFO: `/v3/users/aa6d318535084d91ae510e5b18b2763f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:19.443968 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa2aa7-7742-4ef3-a3d7-7211be7d4d56 None admin] RBAC: Authorizing `identity:get_user(user_id=aa6d318535084d91ae510e5b18b2763f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:19.445845 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa2aa7-7742-4ef3-a3d7-7211be7d4d56 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:19.448536 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 54/110] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:19 2022] GET /identity/v3/users/aa6d318535084d91ae510e5b18b2763f => generated 289 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:19.449533 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa2aa7-7742-4ef3-a3d7-7211be7d4d56 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:19.466534 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3344e-ce28-4c21-90aa-cbc5d233df5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:19.467606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3344e-ce28-4c21-90aa-cbc5d233df5e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:19.467899 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3344e-ce28-4c21-90aa-cbc5d233df5e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:19.468180 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3344e-ce28-4c21-90aa-cbc5d233df5e None admin] PATH_INFO: `/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:19.469691 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3344e-ce28-4c21-90aa-cbc5d233df5e None admin] RBAC: Authorizing `identity:get_project(project_id=f8b3b94854ab4f878d89ba44b09b07ea)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:19.471553 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3344e-ce28-4c21-90aa-cbc5d233df5e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:19.474215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 57/111] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:19 2022] GET /identity/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:19.476096 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60936ac-3533-4ab1-beb8-280d0972be52 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:19.476640 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60936ac-3533-4ab1-beb8-280d0972be52 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:19.477303 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60936ac-3533-4ab1-beb8-280d0972be52 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:19.479794 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 58/112] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:19.485216 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60936ac-3533-4ab1-beb8-280d0972be52 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:19.582463 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa2aa7-7742-4ef3-a3d7-7211be7d4d56 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:19.600161 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60936ac-3533-4ab1-beb8-280d0972be52 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:19.625515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880d097-fc14-4c5b-8da8-65790253543b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:19.626232 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880d097-fc14-4c5b-8da8-65790253543b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:19.626523 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880d097-fc14-4c5b-8da8-65790253543b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:19.626806 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880d097-fc14-4c5b-8da8-65790253543b None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:19.627706 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880d097-fc14-4c5b-8da8-65790253543b None admin] RBAC: Adding query filter params (name=member) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:19.628284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880d097-fc14-4c5b-8da8-65790253543b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:19.629619 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880d097-fc14-4c5b-8da8-65790253543b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:19.639288 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c705b31-a0b0-4452-a8a8-c1511675c4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:19.644482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 55/113] 10.222.0.32 () {56 vars in 1101 bytes} [Thu Jun 2 13:22:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:19.644626 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c705b31-a0b0-4452-a8a8-c1511675c4a8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:19.644626 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c705b31-a0b0-4452-a8a8-c1511675c4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:19.644626 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c705b31-a0b0-4452-a8a8-c1511675c4a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:19.644848 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880d097-fc14-4c5b-8da8-65790253543b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:19.646565 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:19.694100 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:19.720220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c705b31-a0b0-4452-a8a8-c1511675c4a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:19.721665 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c705b31-a0b0-4452-a8a8-c1511675c4a8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:19.753232 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880d097-fc14-4c5b-8da8-65790253543b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:19.787864 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c7dda-9303-41d1-b34b-4d4188a55f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:19.788814 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c7dda-9303-41d1-b34b-4d4188a55f31 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:19.789109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c7dda-9303-41d1-b34b-4d4188a55f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:19.789392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c7dda-9303-41d1-b34b-4d4188a55f31 None admin] PATH_INFO: `/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea/users/9c16757fd814428091339e7b09bd9627/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:19.792186 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c7dda-9303-41d1-b34b-4d4188a55f31 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8b3b94854ab4f878d89ba44b09b07ea, user_id=9c16757fd814428091339e7b09bd9627, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:19.793684 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c7dda-9303-41d1-b34b-4d4188a55f31 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:19.807247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 56/114] 10.222.0.32 () {58 vars in 1439 bytes} [Thu Jun 2 13:22:19 2022] PUT /identity/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea/users/9c16757fd814428091339e7b09bd9627/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:19.808889 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd9ce9-c55a-4d62-b536-ade4247f7cda None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:19.809189 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd9ce9-c55a-4d62-b536-ade4247f7cda None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:19.809471 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd9ce9-c55a-4d62-b536-ade4247f7cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:19.835217 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d9bd9ce9-c55a-4d62-b536-ade4247f7cda None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:19.837068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d9bd9ce9-c55a-4d62-b536-ade4247f7cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:19.837423 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 59/115] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:22:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:19.839188 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1791f-db32-4bb8-a4d5-19bcf62c19f7 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:19.839711 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1791f-db32-4bb8-a4d5-19bcf62c19f7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:19.840227 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1791f-db32-4bb8-a4d5-19bcf62c19f7 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:19.846073 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 60/116] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:19.847453 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1791f-db32-4bb8-a4d5-19bcf62c19f7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:19.890069 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:19.944322 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 57/117] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:19.944322 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd9ce9-c55a-4d62-b536-ade4247f7cda None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:19.977197 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:19.983004 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1791f-db32-4bb8-a4d5-19bcf62c19f7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:20.030946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19789448-5994-4a54-bbd9-d4a9e6aa2861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:20.032717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19789448-5994-4a54-bbd9-d4a9e6aa2861 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:20.032717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19789448-5994-4a54-bbd9-d4a9e6aa2861 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:20.032717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19789448-5994-4a54-bbd9-d4a9e6aa2861 None admin] PATH_INFO: `/v3/users/e5ce74481717495db8afe81424370eaf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:20.034872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19789448-5994-4a54-bbd9-d4a9e6aa2861 None admin] RBAC: Authorizing `identity:get_user(user_id=e5ce74481717495db8afe81424370eaf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:20.036395 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19789448-5994-4a54-bbd9-d4a9e6aa2861 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:20.038069 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 61/118] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:19 2022] GET /identity/v3/users/e5ce74481717495db8afe81424370eaf => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:20.039228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd8848-0c0c-4424-afc6-bfc917d7397c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:20.039521 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd8848-0c0c-4424-afc6-bfc917d7397c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:20.039803 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd8848-0c0c-4424-afc6-bfc917d7397c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:20.057905 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-24bd8848-0c0c-4424-afc6-bfc917d7397c None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:20.059110 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-24bd8848-0c0c-4424-afc6-bfc917d7397c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:20.063732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd9ce9-c55a-4d62-b536-ade4247f7cda None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:20.106834 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184e677-510c-48d7-ae30-823fad634267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:20.108313 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184e677-510c-48d7-ae30-823fad634267 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:20.108615 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184e677-510c-48d7-ae30-823fad634267 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:20.109177 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184e677-510c-48d7-ae30-823fad634267 None admin] PATH_INFO: `/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:20.110549 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184e677-510c-48d7-ae30-823fad634267 None admin] RBAC: Authorizing `identity:get_project(project_id=f8b3b94854ab4f878d89ba44b09b07ea)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:20.112371 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184e677-510c-48d7-ae30-823fad634267 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:20.119247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 58/119] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:19 2022] GET /identity/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:20.119247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d9a6a-1dcd-40c7-8a1e-8d746b713bf7 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:20.119247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d9a6a-1dcd-40c7-8a1e-8d746b713bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:20.119247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d9a6a-1dcd-40c7-8a1e-8d746b713bf7 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:20.120431 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 59/120] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:20.121467 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d9a6a-1dcd-40c7-8a1e-8d746b713bf7 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:20.131130 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 62/121] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:20.131989 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd8848-0c0c-4424-afc6-bfc917d7397c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:20.177820 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:20.230791 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d9a6a-1dcd-40c7-8a1e-8d746b713bf7 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:20.232416 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:20.251254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd8848-0c0c-4424-afc6-bfc917d7397c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:20.268317 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fed8c-054a-40b4-9ebb-edbd9f287137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:20.269154 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fed8c-054a-40b4-9ebb-edbd9f287137 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:20.269446 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fed8c-054a-40b4-9ebb-edbd9f287137 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:20.269729 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fed8c-054a-40b4-9ebb-edbd9f287137 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:20.270932 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fed8c-054a-40b4-9ebb-edbd9f287137 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:20.272508 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fed8c-054a-40b4-9ebb-edbd9f287137 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:20.274439 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 60/122] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:22:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:20.275053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fed8c-054a-40b4-9ebb-edbd9f287137 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:20.290197 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba5c99-25cb-41fe-988f-18e953b2b7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:20.291629 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba5c99-25cb-41fe-988f-18e953b2b7cc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:20.291921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba5c99-25cb-41fe-988f-18e953b2b7cc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:20.292200 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba5c99-25cb-41fe-988f-18e953b2b7cc None admin] PATH_INFO: `/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:20.293444 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba5c99-25cb-41fe-988f-18e953b2b7cc None admin] RBAC: Authorizing `identity:get_project(project_id=f8b3b94854ab4f878d89ba44b09b07ea)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:20.294891 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba5c99-25cb-41fe-988f-18e953b2b7cc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:20.296798 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 63/123] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:20 2022] GET /identity/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:20.297777 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04eb5b-c752-4f77-906e-2ecc95c36bc1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:20.298068 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04eb5b-c752-4f77-906e-2ecc95c36bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:20.298349 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04eb5b-c752-4f77-906e-2ecc95c36bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:20.316907 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-de04eb5b-c752-4f77-906e-2ecc95c36bc1 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:20.318382 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-de04eb5b-c752-4f77-906e-2ecc95c36bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:20.388800 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fed8c-054a-40b4-9ebb-edbd9f287137 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:20.400903 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 64/124] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:20.400903 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04eb5b-c752-4f77-906e-2ecc95c36bc1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:20.424427 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:20.443455 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73059406-209e-4acd-a3f7-442ce0b610cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:20.444116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73059406-209e-4acd-a3f7-442ce0b610cc None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:20.444435 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73059406-209e-4acd-a3f7-442ce0b610cc None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:20.444718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73059406-209e-4acd-a3f7-442ce0b610cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:20.445563 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73059406-209e-4acd-a3f7-442ce0b610cc None admin] RBAC: Adding query filter params (role.id=2ea21d1487064d41a2ce42f381b455cc, scope.project.id=f8b3b94854ab4f878d89ba44b09b07ea, user.id=aa6d318535084d91ae510e5b18b2763f) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:20.446065 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73059406-209e-4acd-a3f7-442ce0b610cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:20.447864 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73059406-209e-4acd-a3f7-442ce0b610cc None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:20.460886 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 61/125] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:22:20 2022] GET /identity/v3/role_assignments?user.id=aa6d318535084d91ae510e5b18b2763f&scope.project.id=f8b3b94854ab4f878d89ba44b09b07ea&role.id=2ea21d1487064d41a2ce42f381b455cc => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:20.460886 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73059406-209e-4acd-a3f7-442ce0b610cc None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:20.515198 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:20.523040 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04eb5b-c752-4f77-906e-2ecc95c36bc1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:20.579572 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2426a2d-a186-4c72-ac72-de386a8cd7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:20.580870 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2426a2d-a186-4c72-ac72-de386a8cd7ec None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:20.581238 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2426a2d-a186-4c72-ac72-de386a8cd7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:20.581964 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2426a2d-a186-4c72-ac72-de386a8cd7ec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:20.589006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73059406-209e-4acd-a3f7-442ce0b610cc None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:20.601633 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2426a2d-a186-4c72-ac72-de386a8cd7ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:20.613220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e2426a2d-a186-4c72-ac72-de386a8cd7ec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:22:20.613220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:20.613220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:20.613220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:20.613220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:20.613220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:20.613220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:20.613220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:20.613220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:20.613220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:20.613220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:20.613220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:20.613220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:20.613220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:20.613220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:20.613220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:20.614330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:20.614330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:20.614330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:20.614330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:20.614330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:20.614330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:20.614330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:20.614330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:20.614330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:20.614330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:20.614330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:20.614330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:20.614330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:20.614330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:20.614330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:20.614330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:20.615307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:20.615307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:20.615307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:20.615307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:20.615307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:20.615307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:20.615307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:20.615307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:20.615307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:20.615307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:20.615307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:22:20.615307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:22:20.615307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 65/126] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Jun 2 13:22:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:20.616031 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2426a2d-a186-4c72-ac72-de386a8cd7ec None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:20.638553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f82a53-80a0-4c3d-ad7c-6909eddbc46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:20.639703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f82a53-80a0-4c3d-ad7c-6909eddbc46b None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:20.640091 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f82a53-80a0-4c3d-ad7c-6909eddbc46b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:20.640753 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f82a53-80a0-4c3d-ad7c-6909eddbc46b None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:20.642044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f82a53-80a0-4c3d-ad7c-6909eddbc46b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:20.643683 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f82a53-80a0-4c3d-ad7c-6909eddbc46b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:20.687857 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 62/127] 10.222.0.32 () {60 vars in 1141 bytes} [Thu Jun 2 13:22:20 2022] POST /identity/v3/projects => generated 302 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:20.693135 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f82a53-80a0-4c3d-ad7c-6909eddbc46b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:20.739323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:20.751467 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2426a2d-a186-4c72-ac72-de386a8cd7ec None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:20.796070 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22972f-ba11-495a-a2e0-534b27043958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:20.797535 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22972f-ba11-495a-a2e0-534b27043958 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:20.798066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22972f-ba11-495a-a2e0-534b27043958 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:20.798868 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22972f-ba11-495a-a2e0-534b27043958 None admin] PATH_INFO: `/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea/users/e5ce74481717495db8afe81424370eaf/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:20.801217 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22972f-ba11-495a-a2e0-534b27043958 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8b3b94854ab4f878d89ba44b09b07ea, user_id=e5ce74481717495db8afe81424370eaf, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:20.803100 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22972f-ba11-495a-a2e0-534b27043958 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:20.830563 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:20.831724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 66/128] 10.222.0.32 () {58 vars in 1439 bytes} [Thu Jun 2 13:22:20 2022] PUT /identity/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea/users/e5ce74481717495db8afe81424370eaf/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:20.835609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22972f-ba11-495a-a2e0-534b27043958 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:20.866601 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f82a53-80a0-4c3d-ad7c-6909eddbc46b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:20.940508 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6ad6a-51c6-4ee6-b4c5-e9613d0559f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:20.942503 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6ad6a-51c6-4ee6-b4c5-e9613d0559f2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:20.943523 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6ad6a-51c6-4ee6-b4c5-e9613d0559f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:20.944983 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6ad6a-51c6-4ee6-b4c5-e9613d0559f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:20.966410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6ad6a-51c6-4ee6-b4c5-e9613d0559f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:20.974500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-06d6ad6a-51c6-4ee6-b4c5-e9613d0559f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:20.974500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:20.974500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:20.974500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:20.974500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:20.974500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:20.974500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:20.974500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:20.974500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:20.974500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:20.974500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:20.974500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:20.974500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:20.974500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:20.974500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:20.974500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:20.975462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:20.975462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:20.975462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:20.975462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:20.975462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:20.975462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:20.975462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:20.975462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:20.975462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:20.975462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:20.975462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:20.975462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:20.975462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:20.975462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:20.975462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:20.975462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:20.976252 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:20.976252 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:20.976252 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:20.976252 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:20.976252 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:20.976252 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:20.976252 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:20.976252 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:20.976252 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:20.976252 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:20.976252 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:20.976252 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:22:20.979632 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 63/129] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:20.989402 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6ad6a-51c6-4ee6-b4c5-e9613d0559f2 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:21.020336 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22972f-ba11-495a-a2e0-534b27043958 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:21.058923 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1a132-246e-4f9d-9748-1e5ad73f3634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:21.059840 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1a132-246e-4f9d-9748-1e5ad73f3634 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:21.060184 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1a132-246e-4f9d-9748-1e5ad73f3634 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:21.060511 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1a132-246e-4f9d-9748-1e5ad73f3634 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:21.061308 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1a132-246e-4f9d-9748-1e5ad73f3634 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:21.061625 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1a132-246e-4f9d-9748-1e5ad73f3634 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:21.063250 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1a132-246e-4f9d-9748-1e5ad73f3634 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:21.078708 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 67/130] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:22:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:21.084950 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1a132-246e-4f9d-9748-1e5ad73f3634 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:21.106117 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:21.216079 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1a132-246e-4f9d-9748-1e5ad73f3634 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:21.228585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6ad6a-51c6-4ee6-b4c5-e9613d0559f2 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:21.269881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a08e5c-479b-40a4-90c7-b732df598b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:21.270565 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a08e5c-479b-40a4-90c7-b732df598b1e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:21.270856 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a08e5c-479b-40a4-90c7-b732df598b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:21.271143 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a08e5c-479b-40a4-90c7-b732df598b1e None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:21.271911 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a08e5c-479b-40a4-90c7-b732df598b1e None admin] RBAC: Adding query filter params (name=member) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:21.272230 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a08e5c-479b-40a4-90c7-b732df598b1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:21.274080 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a08e5c-479b-40a4-90c7-b732df598b1e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:21.284768 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 64/131] 10.222.0.32 () {56 vars in 1101 bytes} [Thu Jun 2 13:22:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:21.286428 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365025ae-4f08-441a-b123-9b54a79282eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:21.287372 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365025ae-4f08-441a-b123-9b54a79282eb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:21.287664 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365025ae-4f08-441a-b123-9b54a79282eb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:21.287938 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365025ae-4f08-441a-b123-9b54a79282eb None admin] PATH_INFO: `/v3/users/e5ce74481717495db8afe81424370eaf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:21.290281 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a08e5c-479b-40a4-90c7-b732df598b1e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:21.291131 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365025ae-4f08-441a-b123-9b54a79282eb None admin] RBAC: Authorizing `identity:get_user(user_id=e5ce74481717495db8afe81424370eaf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:21.292575 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365025ae-4f08-441a-b123-9b54a79282eb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:21.294421 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 68/132] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:21 2022] GET /identity/v3/users/e5ce74481717495db8afe81424370eaf => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:21.299961 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365025ae-4f08-441a-b123-9b54a79282eb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:21.302161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:21.410426 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a08e5c-479b-40a4-90c7-b732df598b1e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:21.450884 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c5aed-cda9-4eab-883c-63200e86742d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:21.451772 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c5aed-cda9-4eab-883c-63200e86742d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:21.452159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c5aed-cda9-4eab-883c-63200e86742d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:21.452372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c5aed-cda9-4eab-883c-63200e86742d None admin] PATH_INFO: `/v3/users/e5ce74481717495db8afe81424370eaf` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:21.454269 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c5aed-cda9-4eab-883c-63200e86742d None admin] RBAC: Authorizing `identity:get_user(user_id=e5ce74481717495db8afe81424370eaf)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:21.455895 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c5aed-cda9-4eab-883c-63200e86742d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:21.458122 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 65/133] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:21 2022] GET /identity/v3/users/e5ce74481717495db8afe81424370eaf => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:22:21.465333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c5aed-cda9-4eab-883c-63200e86742d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:21.486084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:21.530228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365025ae-4f08-441a-b123-9b54a79282eb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:21.564284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:21.593097 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c5aed-cda9-4eab-883c-63200e86742d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:21.613918 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe3eec-c3aa-4214-b48e-2e806dc2bd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:21.614803 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe3eec-c3aa-4214-b48e-2e806dc2bd9a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:21.615089 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe3eec-c3aa-4214-b48e-2e806dc2bd9a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:21.615371 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe3eec-c3aa-4214-b48e-2e806dc2bd9a None admin] PATH_INFO: `/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:21.616604 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe3eec-c3aa-4214-b48e-2e806dc2bd9a None admin] RBAC: Authorizing `identity:get_project(project_id=f8b3b94854ab4f878d89ba44b09b07ea)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:21.618056 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe3eec-c3aa-4214-b48e-2e806dc2bd9a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:21.624949 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 69/134] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:21 2022] GET /identity/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea => generated 298 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:22:21.625776 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe3eec-c3aa-4214-b48e-2e806dc2bd9a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:21.633568 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09905fc3-b948-4618-8468-a1a32ef16e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:21.634444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09905fc3-b948-4618-8468-a1a32ef16e63 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:21.635304 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09905fc3-b948-4618-8468-a1a32ef16e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:21.640327 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09905fc3-b948-4618-8468-a1a32ef16e63 None admin] PATH_INFO: `/v3/projects/c04bfb860e46478681fc3214bd8f773d` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:21.643647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09905fc3-b948-4618-8468-a1a32ef16e63 None admin] RBAC: Authorizing `identity:get_project(project_id=c04bfb860e46478681fc3214bd8f773d)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:21.645209 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09905fc3-b948-4618-8468-a1a32ef16e63 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:21.649094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 66/135] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:21 2022] GET /identity/v3/projects/c04bfb860e46478681fc3214bd8f773d => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:21.654813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09905fc3-b948-4618-8468-a1a32ef16e63 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:21.767723 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09905fc3-b948-4618-8468-a1a32ef16e63 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:21.805347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25ebca-a35b-47f0-bd08-8f7b1d763016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:21.806392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25ebca-a35b-47f0-bd08-8f7b1d763016 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:21.806861 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25ebca-a35b-47f0-bd08-8f7b1d763016 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:21.807151 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25ebca-a35b-47f0-bd08-8f7b1d763016 None admin] PATH_INFO: `/v3/projects/c04bfb860e46478681fc3214bd8f773d/users/e5ce74481717495db8afe81424370eaf/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:21.809505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25ebca-a35b-47f0-bd08-8f7b1d763016 None admin] RBAC: Authorizing `identity:create_grant(project_id=c04bfb860e46478681fc3214bd8f773d, user_id=e5ce74481717495db8afe81424370eaf, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:21.810982 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25ebca-a35b-47f0-bd08-8f7b1d763016 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:21.826860 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 67/136] 10.222.0.32 () {58 vars in 1439 bytes} [Thu Jun 2 13:22:21 2022] PUT /identity/v3/projects/c04bfb860e46478681fc3214bd8f773d/users/e5ce74481717495db8afe81424370eaf/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:21.860612 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe3eec-c3aa-4214-b48e-2e806dc2bd9a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:21.913308 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3fa53-2456-4c83-883c-d88e6319204e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:21.914217 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3fa53-2456-4c83-883c-d88e6319204e None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:21.914508 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3fa53-2456-4c83-883c-d88e6319204e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:21.914791 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3fa53-2456-4c83-883c-d88e6319204e None admin] PATH_INFO: `/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea/users/e5ce74481717495db8afe81424370eaf/roles/5fe1cb1c673a407bb1025d500f111390` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:21.922476 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3fa53-2456-4c83-883c-d88e6319204e None admin] RBAC: Authorizing `identity:create_grant(project_id=f8b3b94854ab4f878d89ba44b09b07ea, user_id=e5ce74481717495db8afe81424370eaf, role_id=5fe1cb1c673a407bb1025d500f111390)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:21.923977 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3fa53-2456-4c83-883c-d88e6319204e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:21.943785 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 70/137] 10.222.0.32 () {58 vars in 1439 bytes} [Thu Jun 2 13:22:21 2022] PUT /identity/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea/users/e5ce74481717495db8afe81424370eaf/roles/5fe1cb1c673a407bb1025d500f111390 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:22.482910 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dee9b5-fd20-47af-825c-03ef05fae32f None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:22.483446 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dee9b5-fd20-47af-825c-03ef05fae32f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:22.483446 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dee9b5-fd20-47af-825c-03ef05fae32f None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:22.484868 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 68/138] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:22.490203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf7197-d742-41c7-ba6c-42246f37fb79 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:22.490636 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf7197-d742-41c7-ba6c-42246f37fb79 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:22.490805 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf7197-d742-41c7-ba6c-42246f37fb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:22.508461 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7adf7197-d742-41c7-ba6c-42246f37fb79 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:22.509701 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7adf7197-d742-41c7-ba6c-42246f37fb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:22.513163 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:22.583816 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 71/139] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:22.607416 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dee9b5-fd20-47af-825c-03ef05fae32f None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:22.611420 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:22.739925 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dee9b5-fd20-47af-825c-03ef05fae32f None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:22.784264 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d0295-c541-4c2f-bf47-370d783aa888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:22.785092 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d0295-c541-4c2f-bf47-370d783aa888 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:22.785385 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d0295-c541-4c2f-bf47-370d783aa888 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:22.785667 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d0295-c541-4c2f-bf47-370d783aa888 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:22.805175 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d0295-c541-4c2f-bf47-370d783aa888 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:22.813474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-5d9d0295-c541-4c2f-bf47-370d783aa888 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:22:22.813474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:22.813474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:22.813474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:22.813474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:22.813474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:22.813474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:22.813474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:22.813474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:22.813474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:22.813474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:22.813474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:22.813474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:22.813474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:22.813474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:22.813474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:22.814368 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:22.814368 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:22.814368 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:22.814368 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:22.814368 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:22.814368 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:22.814368 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:22.814368 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:22.814368 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:22.814368 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:22.814368 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:22.814368 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:22.814368 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:22.814368 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:22.814368 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:22.814368 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:22.815150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:22.815150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:22.815150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:22.815150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:22.815150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:22.815150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:22.815150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:22.815150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:22.815150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:22.815150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:22.815150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:22:22.815150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:22:22.815150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 69/140] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:22:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:22.820921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf7197-d742-41c7-ba6c-42246f37fb79 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:22.988683 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf7197-d742-41c7-ba6c-42246f37fb79 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:23.023970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64658850-02ba-46f6-a6b0-adf12f10d885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:23.024700 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64658850-02ba-46f6-a6b0-adf12f10d885 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:23.024989 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64658850-02ba-46f6-a6b0-adf12f10d885 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:23.025582 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64658850-02ba-46f6-a6b0-adf12f10d885 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:23.026406 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64658850-02ba-46f6-a6b0-adf12f10d885 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:23.026715 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64658850-02ba-46f6-a6b0-adf12f10d885 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:23.028169 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64658850-02ba-46f6-a6b0-adf12f10d885 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:23.039877 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 72/141] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:23.046389 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d0295-c541-4c2f-bf47-370d783aa888 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:23.158276 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:23.208075 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d0295-c541-4c2f-bf47-370d783aa888 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:23.257874 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ae615-630b-4b99-9519-f224da4b210d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:23.258759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ae615-630b-4b99-9519-f224da4b210d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:23.259051 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ae615-630b-4b99-9519-f224da4b210d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:23.259335 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ae615-630b-4b99-9519-f224da4b210d None admin] PATH_INFO: `/v3/users/9c16757fd814428091339e7b09bd9627` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:23.260623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ae615-630b-4b99-9519-f224da4b210d None admin] RBAC: Authorizing `identity:get_user(user_id=9c16757fd814428091339e7b09bd9627)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:23.262095 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ae615-630b-4b99-9519-f224da4b210d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:23.263738 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 70/142] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:23 2022] GET /identity/v3/users/9c16757fd814428091339e7b09bd9627 => generated 247 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:23.269480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64658850-02ba-46f6-a6b0-adf12f10d885 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:23.273310 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:23.435423 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64658850-02ba-46f6-a6b0-adf12f10d885 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:23.495764 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948c675-8301-484a-a2a2-b797247e2696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:23.496443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948c675-8301-484a-a2a2-b797247e2696 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:23.496738 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948c675-8301-484a-a2a2-b797247e2696 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:23.497016 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948c675-8301-484a-a2a2-b797247e2696 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:23.577439 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948c675-8301-484a-a2a2-b797247e2696 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:23.578937 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948c675-8301-484a-a2a2-b797247e2696 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:23.580830 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:23.731584 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 73/143] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:22:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:22:23.737391 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ae615-630b-4b99-9519-f224da4b210d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:23.855337 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ae615-630b-4b99-9519-f224da4b210d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:23.884543 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:23.893294 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4b98c-9e9f-44f5-8d1e-67acd1f5279b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:23.894172 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4b98c-9e9f-44f5-8d1e-67acd1f5279b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:23.894464 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4b98c-9e9f-44f5-8d1e-67acd1f5279b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:23.894747 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4b98c-9e9f-44f5-8d1e-67acd1f5279b None admin] PATH_INFO: `/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:23.895964 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c4b98c-9e9f-44f5-8d1e-67acd1f5279b None admin] RBAC: Authorizing `identity:get_project(project_id=f8b3b94854ab4f878d89ba44b09b07ea)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:23.897469 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c4b98c-9e9f-44f5-8d1e-67acd1f5279b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:23.899349 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 71/144] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:23 2022] GET /identity/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:22:23.905531 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948c675-8301-484a-a2a2-b797247e2696 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:24.051114 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948c675-8301-484a-a2a2-b797247e2696 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:24.053053 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:24.054393 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38cb2d-05ad-49b7-bd34-e07ea98ebdf8 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:24.054690 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38cb2d-05ad-49b7-bd34-e07ea98ebdf8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:24.054979 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38cb2d-05ad-49b7-bd34-e07ea98ebdf8 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:24.056535 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 72/145] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:22:24.061431 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efe551-3a27-4d5a-95b6-5ff1b44de7a3 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:24.061732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efe551-3a27-4d5a-95b6-5ff1b44de7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:24.062016 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efe551-3a27-4d5a-95b6-5ff1b44de7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:24.097936 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-72efe551-3a27-4d5a-95b6-5ff1b44de7a3 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:24.099394 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-72efe551-3a27-4d5a-95b6-5ff1b44de7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:24.176451 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0bc1a7-8432-43f6-bda7-ac4a58522ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:24.177047 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bc1a7-8432-43f6-bda7-ac4a58522ebe None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:24.177334 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bc1a7-8432-43f6-bda7-ac4a58522ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:24.177613 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bc1a7-8432-43f6-bda7-ac4a58522ebe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:24.178456 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0bc1a7-8432-43f6-bda7-ac4a58522ebe None admin] RBAC: Adding query filter params (role.id=128feb04d1e042ac844f9ad70b89bb02, scope.project.id=f8b3b94854ab4f878d89ba44b09b07ea, user.id=9c16757fd814428091339e7b09bd9627) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:24.178771 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0bc1a7-8432-43f6-bda7-ac4a58522ebe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:24.180245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0bc1a7-8432-43f6-bda7-ac4a58522ebe None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:24.206162 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 73/146] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:24.209241 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 74/147] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:22:23 2022] GET /identity/v3/role_assignments?user.id=9c16757fd814428091339e7b09bd9627&scope.project.id=f8b3b94854ab4f878d89ba44b09b07ea&role.id=128feb04d1e042ac844f9ad70b89bb02 => generated 608 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:24.245725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efe551-3a27-4d5a-95b6-5ff1b44de7a3 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:24.283249 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64933a36-4351-47dc-ac82-5fe55ef823f5 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:24.283555 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64933a36-4351-47dc-ac82-5fe55ef823f5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:24.283828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64933a36-4351-47dc-ac82-5fe55ef823f5 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:24.285638 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 75/148] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:24.291513 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a9393-7bc8-41fe-976b-2c073a89475c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:24.291821 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a9393-7bc8-41fe-976b-2c073a89475c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:24.292086 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a9393-7bc8-41fe-976b-2c073a89475c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:24.320641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f64a9393-7bc8-41fe-976b-2c073a89475c None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:24.321865 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f64a9393-7bc8-41fe-976b-2c073a89475c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:24.378367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efe551-3a27-4d5a-95b6-5ff1b44de7a3 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:24.413373 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:24.427122 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8566857-1669-4cb7-95a6-aadfe3decf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:24.428377 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8566857-1669-4cb7-95a6-aadfe3decf8f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:24.428866 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8566857-1669-4cb7-95a6-aadfe3decf8f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:24.429357 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8566857-1669-4cb7-95a6-aadfe3decf8f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:24.460095 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8566857-1669-4cb7-95a6-aadfe3decf8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:24.475115 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-b8566857-1669-4cb7-95a6-aadfe3decf8f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:22:24.475115 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:24.475115 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:24.475115 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:24.475115 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:24.475115 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:24.475115 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:24.475115 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:24.475115 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:24.475115 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:24.475115 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:24.475115 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:24.475115 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:24.475115 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:24.475115 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:24.475115 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:24.476058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:24.476058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:24.476058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:24.476058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:24.476058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:24.476058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:24.476058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:24.476058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:24.476058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:24.476058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:24.476058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:24.476058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:24.476058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:24.476058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:24.476058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:24.476058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:24.476875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:24.476875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:24.476875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:24.476875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:24.476875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:24.476875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:24.476875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:24.476875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:24.476875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:24.476875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:24.476875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:22:24.476875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:22:24.479501 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 74/149] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:24.485283 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8566857-1669-4cb7-95a6-aadfe3decf8f None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:24.535325 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 76/150] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:22:24.563006 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a9393-7bc8-41fe-976b-2c073a89475c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:24.683041 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8566857-1669-4cb7-95a6-aadfe3decf8f None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:24.715894 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:24.724282 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a9393-7bc8-41fe-976b-2c073a89475c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:24.740198 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2cb71-0f97-4575-9e01-9d7f38605fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:24.740926 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2cb71-0f97-4575-9e01-9d7f38605fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:24.741218 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2cb71-0f97-4575-9e01-9d7f38605fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:24.741502 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2cb71-0f97-4575-9e01-9d7f38605fb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:24.742296 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2cb71-0f97-4575-9e01-9d7f38605fb7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:24.742642 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2cb71-0f97-4575-9e01-9d7f38605fb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:24.746152 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2cb71-0f97-4575-9e01-9d7f38605fb7 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:24.757895 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 75/151] 10.222.0.32 () {56 vars in 1101 bytes} [Thu Jun 2 13:22:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:22:24.762369 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59057e2b-5491-4c3e-ad81-a69096afb8f1 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:24.762733 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59057e2b-5491-4c3e-ad81-a69096afb8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:24.763329 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59057e2b-5491-4c3e-ad81-a69096afb8f1 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:24.765299 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 76/152] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:24.765886 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59057e2b-5491-4c3e-ad81-a69096afb8f1 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:24.783607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b574b0-39bb-4b6c-bb00-5464ab04d8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:24.784865 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b574b0-39bb-4b6c-bb00-5464ab04d8ac None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:24.785391 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b574b0-39bb-4b6c-bb00-5464ab04d8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:24.785981 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b574b0-39bb-4b6c-bb00-5464ab04d8ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:24.787400 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b574b0-39bb-4b6c-bb00-5464ab04d8ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:24.789254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b574b0-39bb-4b6c-bb00-5464ab04d8ac None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:24.791271 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 77/153] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:22:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:22:24.792648 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca575af-5409-4dd8-bd24-71157c14c226 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:24.793218 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca575af-5409-4dd8-bd24-71157c14c226 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:24.793745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca575af-5409-4dd8-bd24-71157c14c226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:24.815681 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1ca575af-5409-4dd8-bd24-71157c14c226 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:24.817488 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1ca575af-5409-4dd8-bd24-71157c14c226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:24.830773 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:24.893345 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59057e2b-5491-4c3e-ad81-a69096afb8f1 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:24.899517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 78/154] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:24.900669 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca575af-5409-4dd8-bd24-71157c14c226 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:24.941475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48964c81-7624-4315-a76c-4851c9564081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:24.942757 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48964c81-7624-4315-a76c-4851c9564081 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:24.943254 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48964c81-7624-4315-a76c-4851c9564081 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:24.944217 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48964c81-7624-4315-a76c-4851c9564081 None admin] PATH_INFO: `/v3/users/aa6d318535084d91ae510e5b18b2763f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:24.946006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48964c81-7624-4315-a76c-4851c9564081 None admin] RBAC: Authorizing `identity:get_user(user_id=aa6d318535084d91ae510e5b18b2763f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:24.949270 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48964c81-7624-4315-a76c-4851c9564081 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:24.951790 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 77/155] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:24 2022] GET /identity/v3/users/aa6d318535084d91ae510e5b18b2763f => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:24.953171 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48964c81-7624-4315-a76c-4851c9564081 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:25.037481 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:25.045048 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca575af-5409-4dd8-bd24-71157c14c226 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:25.065447 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48964c81-7624-4315-a76c-4851c9564081 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:25.086345 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:25.096490 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a12373-8428-492f-8346-67621e057b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:25.097557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a12373-8428-492f-8346-67621e057b18 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:25.097848 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a12373-8428-492f-8346-67621e057b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:25.098228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a12373-8428-492f-8346-67621e057b18 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:25.099072 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a12373-8428-492f-8346-67621e057b18 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:25.100584 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a12373-8428-492f-8346-67621e057b18 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:25.100835 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53958b1a-6726-4d09-b390-ad9208ea96a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:25.101635 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53958b1a-6726-4d09-b390-ad9208ea96a5 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:25.101926 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53958b1a-6726-4d09-b390-ad9208ea96a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:25.102208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53958b1a-6726-4d09-b390-ad9208ea96a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:25.115339 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53958b1a-6726-4d09-b390-ad9208ea96a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:25.122873 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 79/156] 10.222.0.32 () {60 vars in 1132 bytes} [Thu Jun 2 13:22:24 2022] POST /identity/v3/users => generated 283 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:25.123605 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a12373-8428-492f-8346-67621e057b18 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:25.124096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-53958b1a-6726-4d09-b390-ad9208ea96a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:25.124096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:25.124096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:25.124096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:25.124096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:25.124096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:25.124096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:25.124096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:25.124096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:25.124096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:25.124096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:25.124096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:25.124096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:25.124096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:25.124096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:25.124096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:25.130717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:25.130717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:25.130717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:25.130717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:25.130717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:25.130717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:25.130717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:25.130717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:25.130717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:25.130717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:25.130717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:25.130717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:25.130717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:25.130717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:25.130717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:25.130717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:25.131591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:25.131591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:25.131591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:25.131591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:25.131591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:25.131591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:25.131591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:25.131591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:25.131591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:25.131591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:25.131591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:25.131591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:22:25.131591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 78/157] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:25.131591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83446e7-ceaf-439e-acc7-ad6d06151c16 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:25.132366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83446e7-ceaf-439e-acc7-ad6d06151c16 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:25.132366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83446e7-ceaf-439e-acc7-ad6d06151c16 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:25.132366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 79/158] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:25.135538 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83446e7-ceaf-439e-acc7-ad6d06151c16 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:25.258313 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83446e7-ceaf-439e-acc7-ad6d06151c16 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:25.281769 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a12373-8428-492f-8346-67621e057b18 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:25.303321 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780f2c3-496a-4241-8190-58cf067fb4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:25.304808 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780f2c3-496a-4241-8190-58cf067fb4cf None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:25.305322 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780f2c3-496a-4241-8190-58cf067fb4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:25.305817 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780f2c3-496a-4241-8190-58cf067fb4cf None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:25.307367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780f2c3-496a-4241-8190-58cf067fb4cf None admin] RBAC: Adding query filter params (name=member) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:25.308622 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780f2c3-496a-4241-8190-58cf067fb4cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:25.310577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780f2c3-496a-4241-8190-58cf067fb4cf None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:25.323183 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4f557-4d86-4301-af19-2cd650c00a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:25.323910 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 80/159] 10.222.0.32 () {56 vars in 1101 bytes} [Thu Jun 2 13:22:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:22:25.324080 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4f557-4d86-4301-af19-2cd650c00a3a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:25.324398 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4f557-4d86-4301-af19-2cd650c00a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:25.324688 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4f557-4d86-4301-af19-2cd650c00a3a None admin] PATH_INFO: `/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:25.326044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24e7ba-4f24-4461-9c59-190e971fd5b4 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:25.326486 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24e7ba-4f24-4461-9c59-190e971fd5b4 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:25.326585 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4f557-4d86-4301-af19-2cd650c00a3a None admin] RBAC: Authorizing `identity:get_project(project_id=f8b3b94854ab4f878d89ba44b09b07ea)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:25.326977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24e7ba-4f24-4461-9c59-190e971fd5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:25.328078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4f557-4d86-4301-af19-2cd650c00a3a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:25.330079 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 80/160] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:25 2022] GET /identity/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:25.335445 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4f557-4d86-4301-af19-2cd650c00a3a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:25.348323 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-db24e7ba-4f24-4461-9c59-190e971fd5b4 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:25.350221 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-db24e7ba-4f24-4461-9c59-190e971fd5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:25.359112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:25.397527 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:25.441092 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 81/161] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:25.442269 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24e7ba-4f24-4461-9c59-190e971fd5b4 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:25.468233 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4f557-4d86-4301-af19-2cd650c00a3a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:25.511858 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db97182-0791-4b61-8eb3-74413643d4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:25.512912 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db97182-0791-4b61-8eb3-74413643d4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:25.513496 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db97182-0791-4b61-8eb3-74413643d4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:25.513839 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db97182-0791-4b61-8eb3-74413643d4c4 None admin] PATH_INFO: `/v3/users/e5ce74481717495db8afe81424370eaf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:25.515110 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db97182-0791-4b61-8eb3-74413643d4c4 None admin] RBAC: Authorizing `identity:get_user(user_id=e5ce74481717495db8afe81424370eaf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:25.516777 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db97182-0791-4b61-8eb3-74413643d4c4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:25.519313 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 81/162] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:25 2022] GET /identity/v3/users/e5ce74481717495db8afe81424370eaf => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:25.520106 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db97182-0791-4b61-8eb3-74413643d4c4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:25.581104 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24e7ba-4f24-4461-9c59-190e971fd5b4 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:25.626115 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fbeee-c29d-4feb-b01e-32e7b2c6477d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:25.627019 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fbeee-c29d-4feb-b01e-32e7b2c6477d None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:25.627302 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fbeee-c29d-4feb-b01e-32e7b2c6477d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:25.627581 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fbeee-c29d-4feb-b01e-32e7b2c6477d None admin] PATH_INFO: `/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea/users/aa6d318535084d91ae510e5b18b2763f/roles/2ea21d1487064d41a2ce42f381b455cc` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:25.628743 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:25.630197 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fbeee-c29d-4feb-b01e-32e7b2c6477d None admin] RBAC: Authorizing `identity:create_grant(project_id=f8b3b94854ab4f878d89ba44b09b07ea, user_id=aa6d318535084d91ae510e5b18b2763f, role_id=2ea21d1487064d41a2ce42f381b455cc)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:25.631675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fbeee-c29d-4feb-b01e-32e7b2c6477d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:25.647905 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db97182-0791-4b61-8eb3-74413643d4c4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:25.650059 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 82/163] 10.222.0.32 () {58 vars in 1439 bytes} [Thu Jun 2 13:22:25 2022] PUT /identity/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea/users/aa6d318535084d91ae510e5b18b2763f/roles/2ea21d1487064d41a2ce42f381b455cc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:25.651943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875706fc-c56e-4de3-a9ee-bee2f91a295e None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:25.652327 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875706fc-c56e-4de3-a9ee-bee2f91a295e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:25.652622 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875706fc-c56e-4de3-a9ee-bee2f91a295e None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:25.654089 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 83/164] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:25.654692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875706fc-c56e-4de3-a9ee-bee2f91a295e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:25.700730 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:25.701226 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395c84c-861a-4eb9-ac00-baa65c37c886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:25.702413 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395c84c-861a-4eb9-ac00-baa65c37c886 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:25.702875 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395c84c-861a-4eb9-ac00-baa65c37c886 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:25.703327 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395c84c-861a-4eb9-ac00-baa65c37c886 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:25.722457 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395c84c-861a-4eb9-ac00-baa65c37c886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:25.734102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e395c84c-861a-4eb9-ac00-baa65c37c886 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:25.734102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:25.734102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:25.734102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:25.734102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:25.734102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:25.734102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:25.734102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:25.734102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:25.734102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:25.734102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:25.734102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:25.734102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:25.734102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:25.734102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:25.734102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:25.735071 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:25.735071 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:25.735071 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:25.735071 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:25.735071 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:25.735071 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:25.735071 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:25.735071 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:25.735071 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:25.735071 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:25.735071 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:25.735071 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:25.735071 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:25.735071 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:25.735071 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:25.735071 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:25.735873 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:25.735873 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:25.735873 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:25.735873 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:25.735873 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:25.735873 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:25.735873 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:25.735873 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:25.735873 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:25.735873 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:25.735873 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:25.735873 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:22:25.738524 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 82/165] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:25.740872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79018502-c459-44e9-9317-4b31f566cbe2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:25.741386 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79018502-c459-44e9-9317-4b31f566cbe2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:25.741959 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79018502-c459-44e9-9317-4b31f566cbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:25.767386 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-79018502-c459-44e9-9317-4b31f566cbe2 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:25.769359 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-79018502-c459-44e9-9317-4b31f566cbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:25.808859 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875706fc-c56e-4de3-a9ee-bee2f91a295e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:25.849112 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25613a1-d506-4d00-9558-04f97b20b6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:25.850100 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25613a1-d506-4d00-9558-04f97b20b6c8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:25.850567 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25613a1-d506-4d00-9558-04f97b20b6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:25.851019 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25613a1-d506-4d00-9558-04f97b20b6c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:25.856359 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 83/166] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:25.857611 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79018502-c459-44e9-9317-4b31f566cbe2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:25.928555 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25613a1-d506-4d00-9558-04f97b20b6c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:25.930414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25613a1-d506-4d00-9558-04f97b20b6c8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:25.968493 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:25.978849 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79018502-c459-44e9-9317-4b31f566cbe2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:25.991629 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:26.020984 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda48a8-c921-43bb-a53d-410e98d702ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:26.020984 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda48a8-c921-43bb-a53d-410e98d702ad None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:26.020984 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda48a8-c921-43bb-a53d-410e98d702ad None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:26.020984 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda48a8-c921-43bb-a53d-410e98d702ad None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:26.021313 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda48a8-c921-43bb-a53d-410e98d702ad None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:26.021313 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda48a8-c921-43bb-a53d-410e98d702ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:26.024384 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda48a8-c921-43bb-a53d-410e98d702ad None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:26.031158 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 84/167] 10.222.0.32 () {56 vars in 1101 bytes} [Thu Jun 2 13:22:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:26.033166 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda48a8-c921-43bb-a53d-410e98d702ad None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:26.049692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 84/168] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:22:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:26.050564 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25613a1-d506-4d00-9558-04f97b20b6c8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:26.150156 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda48a8-c921-43bb-a53d-410e98d702ad None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:26.180670 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25613a1-d506-4d00-9558-04f97b20b6c8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:26.185975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f194d12-661b-40cb-ac9d-06b7001b8703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:26.186781 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f194d12-661b-40cb-ac9d-06b7001b8703 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:26.187058 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f194d12-661b-40cb-ac9d-06b7001b8703 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:26.187349 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f194d12-661b-40cb-ac9d-06b7001b8703 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:26.222119 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:26.236946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f194d12-661b-40cb-ac9d-06b7001b8703 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:26.245573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-1f194d12-661b-40cb-ac9d-06b7001b8703 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:22:26.245573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:26.245573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:26.245573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:26.245573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:26.245573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:26.245573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:26.245573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:26.245573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:26.245573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:26.245573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:26.245573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:26.245573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:26.245573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:26.245573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:26.245573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:26.246557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:26.246557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:26.246557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:26.246557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:26.246557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:26.246557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:26.246557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:26.246557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:26.246557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:26.246557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:26.246557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:26.246557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:26.246557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:26.246557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:26.246557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:26.246557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:26.247333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:26.247333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:26.247333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:26.247333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:26.247333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:26.247333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:26.247333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:26.247333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:26.247333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:26.247333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:26.247333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:22:26.247333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:22:26.247333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 85/169] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Jun 2 13:22:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:26.247971 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f194d12-661b-40cb-ac9d-06b7001b8703 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:26.280594 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:26.313641 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d0aa1-6bef-4733-be0d-a1a644498b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:26.314537 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d0aa1-6bef-4733-be0d-a1a644498b86 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:26.314825 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d0aa1-6bef-4733-be0d-a1a644498b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:26.315102 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d0aa1-6bef-4733-be0d-a1a644498b86 None admin] PATH_INFO: `/v3/users/e5ce74481717495db8afe81424370eaf` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:26.321092 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d0aa1-6bef-4733-be0d-a1a644498b86 None admin] RBAC: Authorizing `identity:get_user(user_id=e5ce74481717495db8afe81424370eaf)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:26.323190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d0aa1-6bef-4733-be0d-a1a644498b86 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:26.324955 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 85/170] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:26 2022] GET /identity/v3/users/e5ce74481717495db8afe81424370eaf => generated 275 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:26.325788 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d0aa1-6bef-4733-be0d-a1a644498b86 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:26.460118 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d0aa1-6bef-4733-be0d-a1a644498b86 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:26.510183 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc612c-6256-492a-a67a-d65fc0157070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:26.511351 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc612c-6256-492a-a67a-d65fc0157070 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:26.512028 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc612c-6256-492a-a67a-d65fc0157070 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:26.512525 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc612c-6256-492a-a67a-d65fc0157070 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:26.513487 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc612c-6256-492a-a67a-d65fc0157070 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:26.514005 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc612c-6256-492a-a67a-d65fc0157070 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:26.515597 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc612c-6256-492a-a67a-d65fc0157070 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:26.538540 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 86/171] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:22:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:26.540774 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc612c-6256-492a-a67a-d65fc0157070 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:26.565420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f194d12-661b-40cb-ac9d-06b7001b8703 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:26.637921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58513e-9515-412f-8f41-2348d11a5246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:26.638806 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58513e-9515-412f-8f41-2348d11a5246 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:26.639095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58513e-9515-412f-8f41-2348d11a5246 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:26.639430 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58513e-9515-412f-8f41-2348d11a5246 None admin] PATH_INFO: `/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:26.640958 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58513e-9515-412f-8f41-2348d11a5246 None admin] RBAC: Authorizing `identity:get_project(project_id=f8b3b94854ab4f878d89ba44b09b07ea)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:26.642559 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58513e-9515-412f-8f41-2348d11a5246 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:26.644159 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 86/172] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:26 2022] GET /identity/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea => generated 298 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:26.644968 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58513e-9515-412f-8f41-2348d11a5246 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:26.716651 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:26.780141 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:26.822939 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58513e-9515-412f-8f41-2348d11a5246 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:26.862287 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18140b-b183-4f0f-8ee9-f46760cc1b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:26.863511 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18140b-b183-4f0f-8ee9-f46760cc1b81 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:26.864021 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18140b-b183-4f0f-8ee9-f46760cc1b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:26.864607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18140b-b183-4f0f-8ee9-f46760cc1b81 None admin] PATH_INFO: `/v3/users/e5ce74481717495db8afe81424370eaf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:26.866043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18140b-b183-4f0f-8ee9-f46760cc1b81 None admin] RBAC: Authorizing `identity:get_user(user_id=e5ce74481717495db8afe81424370eaf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:26.866269 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc612c-6256-492a-a67a-d65fc0157070 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:26.868543 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18140b-b183-4f0f-8ee9-f46760cc1b81 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:26.871376 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 87/173] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:26 2022] GET /identity/v3/users/e5ce74481717495db8afe81424370eaf => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:26.872412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18140b-b183-4f0f-8ee9-f46760cc1b81 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:26.992053 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18140b-b183-4f0f-8ee9-f46760cc1b81 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:27.009375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41dc84-b6d0-40ca-9fb3-c9861bf96f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:27.012183 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41dc84-b6d0-40ca-9fb3-c9861bf96f28 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:27.012183 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41dc84-b6d0-40ca-9fb3-c9861bf96f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:27.012183 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41dc84-b6d0-40ca-9fb3-c9861bf96f28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:27.030634 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac625ab7-31de-4da4-bca3-9846cb368bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:27.031377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac625ab7-31de-4da4-bca3-9846cb368bed None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:27.031734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac625ab7-31de-4da4-bca3-9846cb368bed None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:27.032084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac625ab7-31de-4da4-bca3-9846cb368bed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:27.033458 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac625ab7-31de-4da4-bca3-9846cb368bed None admin] RBAC: Adding query filter params (role.id=e4d5af06c5a44d479d25ce8490ce71a0, scope.project.id=f8b3b94854ab4f878d89ba44b09b07ea, user.id=e5ce74481717495db8afe81424370eaf) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:27.033856 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac625ab7-31de-4da4-bca3-9846cb368bed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:27.035488 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac625ab7-31de-4da4-bca3-9846cb368bed None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:27.037579 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:27.045276 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 88/174] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:22:26 2022] GET /identity/v3/role_assignments?user.id=e5ce74481717495db8afe81424370eaf&scope.project.id=f8b3b94854ab4f878d89ba44b09b07ea&role.id=e4d5af06c5a44d479d25ce8490ce71a0 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:27.046167 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac625ab7-31de-4da4-bca3-9846cb368bed None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:27.194435 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac625ab7-31de-4da4-bca3-9846cb368bed None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:27.268138 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4bd1a-281e-4357-8a75-4da7af9b68b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:27.268138 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4bd1a-281e-4357-8a75-4da7af9b68b9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:27.268138 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4bd1a-281e-4357-8a75-4da7af9b68b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:27.268138 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4bd1a-281e-4357-8a75-4da7af9b68b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:27.283790 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41dc84-b6d0-40ca-9fb3-c9861bf96f28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:27.286542 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41dc84-b6d0-40ca-9fb3-c9861bf96f28 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:27.397952 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:27.412326 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4bd1a-281e-4357-8a75-4da7af9b68b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:27.412326 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4bd1a-281e-4357-8a75-4da7af9b68b9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:27.548651 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:27.644768 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 89/175] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:22:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:27.653368 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4bd1a-281e-4357-8a75-4da7af9b68b9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:27.673357 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 87/176] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:22:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1134 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:27.684322 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41dc84-b6d0-40ca-9fb3-c9861bf96f28 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:27.862998 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:27.867042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4bd1a-281e-4357-8a75-4da7af9b68b9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:27.911548 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41dc84-b6d0-40ca-9fb3-c9861bf96f28 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:27.935545 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96b34b-61b6-49c0-986e-9906806350bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:27.936445 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96b34b-61b6-49c0-986e-9906806350bc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:27.936736 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96b34b-61b6-49c0-986e-9906806350bc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:27.937152 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96b34b-61b6-49c0-986e-9906806350bc None admin] PATH_INFO: `/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:27.938405 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96b34b-61b6-49c0-986e-9906806350bc None admin] RBAC: Authorizing `identity:get_project(project_id=f8b3b94854ab4f878d89ba44b09b07ea)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:27.940037 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96b34b-61b6-49c0-986e-9906806350bc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:27.942721 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 90/177] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:27 2022] GET /identity/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:27.949268 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96b34b-61b6-49c0-986e-9906806350bc None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:27.982099 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c83ef2-390c-4200-9ffd-b10478e4bbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:27.983454 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c83ef2-390c-4200-9ffd-b10478e4bbe0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:27.983993 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c83ef2-390c-4200-9ffd-b10478e4bbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:27.984499 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c83ef2-390c-4200-9ffd-b10478e4bbe0 None admin] PATH_INFO: `/v3/projects/c04bfb860e46478681fc3214bd8f773d` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:27.989113 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c83ef2-390c-4200-9ffd-b10478e4bbe0 None admin] RBAC: Authorizing `identity:get_project(project_id=c04bfb860e46478681fc3214bd8f773d)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:27.990763 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c83ef2-390c-4200-9ffd-b10478e4bbe0 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:27.992690 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 88/178] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:27 2022] GET /identity/v3/projects/c04bfb860e46478681fc3214bd8f773d => generated 312 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:27.998987 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c83ef2-390c-4200-9ffd-b10478e4bbe0 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:28.061854 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:28.098970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96b34b-61b6-49c0-986e-9906806350bc None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:28.154025 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79defd9b-de06-4984-8fa9-5f41cdf46211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:28.154607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79defd9b-de06-4984-8fa9-5f41cdf46211 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:28.154895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79defd9b-de06-4984-8fa9-5f41cdf46211 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:28.155174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79defd9b-de06-4984-8fa9-5f41cdf46211 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:28.156016 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79defd9b-de06-4984-8fa9-5f41cdf46211 None admin] RBAC: Adding query filter params (role.id=5fe1cb1c673a407bb1025d500f111390, scope.project.id=f8b3b94854ab4f878d89ba44b09b07ea, user.id=e5ce74481717495db8afe81424370eaf) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:28.156347 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79defd9b-de06-4984-8fa9-5f41cdf46211 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:28.157812 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79defd9b-de06-4984-8fa9-5f41cdf46211 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:28.164063 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 91/179] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:22:27 2022] GET /identity/v3/role_assignments?user.id=e5ce74481717495db8afe81424370eaf&scope.project.id=f8b3b94854ab4f878d89ba44b09b07ea&role.id=5fe1cb1c673a407bb1025d500f111390 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:28.216389 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c83ef2-390c-4200-9ffd-b10478e4bbe0 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:28.273220 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b2e07-a62f-46ab-9e2f-00f2ce959f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:28.274429 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b2e07-a62f-46ab-9e2f-00f2ce959f67 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:28.274429 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b2e07-a62f-46ab-9e2f-00f2ce959f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:28.274429 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b2e07-a62f-46ab-9e2f-00f2ce959f67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:28.275314 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b2e07-a62f-46ab-9e2f-00f2ce959f67 None admin] RBAC: Adding query filter params (role.id=e4d5af06c5a44d479d25ce8490ce71a0, scope.project.id=c04bfb860e46478681fc3214bd8f773d, user.id=e5ce74481717495db8afe81424370eaf) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:28.275631 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b2e07-a62f-46ab-9e2f-00f2ce959f67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:28.277210 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b2e07-a62f-46ab-9e2f-00f2ce959f67 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:28.284101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 89/180] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:22:27 2022] GET /identity/v3/role_assignments?user.id=e5ce74481717495db8afe81424370eaf&scope.project.id=c04bfb860e46478681fc3214bd8f773d&role.id=e4d5af06c5a44d479d25ce8490ce71a0 => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:22:28.642666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8339a-f7de-40fd-bfe3-c68027bc0bcb None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:28.642966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8339a-f7de-40fd-bfe3-c68027bc0bcb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:28.643337 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8339a-f7de-40fd-bfe3-c68027bc0bcb None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:28.645065 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 92/181] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:28.662352 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a85fb-126c-4689-9ce4-ea3f3e67d567 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:28.662645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a85fb-126c-4689-9ce4-ea3f3e67d567 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:28.662917 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a85fb-126c-4689-9ce4-ea3f3e67d567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:28.684983 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-7d8a85fb-126c-4689-9ce4-ea3f3e67d567 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:28.686185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7d8a85fb-126c-4689-9ce4-ea3f3e67d567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:28.762323 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 90/182] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:28.785771 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8339a-f7de-40fd-bfe3-c68027bc0bcb None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:28.816016 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8be6ef-3400-4071-9704-367887b3848e None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:28.816378 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8be6ef-3400-4071-9704-367887b3848e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:28.816605 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8be6ef-3400-4071-9704-367887b3848e None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:28.818211 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 91/183] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:28.824153 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d415d97-4349-497d-bb1c-67a457c976b6 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:28.824858 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d415d97-4349-497d-bb1c-67a457c976b6 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:28.825343 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d415d97-4349-497d-bb1c-67a457c976b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:28.827324 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:28.846567 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6d415d97-4349-497d-bb1c-67a457c976b6 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:28.848129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6d415d97-4349-497d-bb1c-67a457c976b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:28.870548 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:28.924884 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8339a-f7de-40fd-bfe3-c68027bc0bcb None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:28.934077 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 92/184] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:22:28.959191 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d415d97-4349-497d-bb1c-67a457c976b6 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:28.969213 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3387a-51d1-42b1-a17b-c593a210d9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:28.970121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3387a-51d1-42b1-a17b-c593a210d9ff None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:28.970498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3387a-51d1-42b1-a17b-c593a210d9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:28.970844 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3387a-51d1-42b1-a17b-c593a210d9ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:28.983478 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3387a-51d1-42b1-a17b-c593a210d9ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:28.991103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-aea3387a-51d1-42b1-a17b-c593a210d9ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:22:28.991103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:28.991103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:28.991103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:28.991103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:28.991103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:28.991103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:28.991103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:28.991103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:28.991103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:28.991103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:28.991103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:28.991103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:28.991103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:28.991103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:28.991103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:28.991970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:28.991970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:28.991970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:28.991970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:28.991970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:28.991970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:28.991970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:28.991970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:28.991970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:28.991970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:28.991970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:28.991970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:28.991970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:28.991970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:28.991970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:28.991970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:28.992831 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:28.992831 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:28.992831 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:28.992831 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:28.992831 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:28.992831 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:28.992831 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:28.992831 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:28.992831 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:28.992831 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:28.992831 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:22:28.992831 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:22:28.992831 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 93/185] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Jun 2 13:22:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:29.000478 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3387a-51d1-42b1-a17b-c593a210d9ff None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:29.083821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d415d97-4349-497d-bb1c-67a457c976b6 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:29.098760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:29.111674 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3387a-51d1-42b1-a17b-c593a210d9ff None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:29.120421 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9d25e-eee9-4cbd-9e43-6da6cb2bee07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:29.121552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9d25e-eee9-4cbd-9e43-6da6cb2bee07 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:29.121985 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9d25e-eee9-4cbd-9e43-6da6cb2bee07 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:29.122406 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9d25e-eee9-4cbd-9e43-6da6cb2bee07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:29.134990 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9d25e-eee9-4cbd-9e43-6da6cb2bee07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:29.143630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-9fd9d25e-eee9-4cbd-9e43-6da6cb2bee07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:22:29.143630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:29.143630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:29.143630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:29.143630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:29.143630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:29.143630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:29.143630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:29.143630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:29.143630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:29.143630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:29.143630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:29.143630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:29.143630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:29.143630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:29.143630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:29.144730 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:29.144730 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:29.144730 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:29.144730 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:29.144730 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:29.144730 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:29.144730 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:29.144730 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:29.144730 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:29.144730 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:29.144730 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:29.144730 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:29.144730 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:29.144730 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:29.144730 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:29.144730 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:29.145546 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:29.145546 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:29.145546 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:29.145546 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:29.145546 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:29.145546 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:29.145546 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:29.145546 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:29.145546 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:29.145546 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:29.145546 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:22:29.145546 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:22:29.148098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 93/186] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:22:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:29.153981 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a78d70-4dcb-4004-88fc-6c8e92a6b1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:29.154605 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9d25e-eee9-4cbd-9e43-6da6cb2bee07 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:29.155092 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a78d70-4dcb-4004-88fc-6c8e92a6b1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:29.155505 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a78d70-4dcb-4004-88fc-6c8e92a6b1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:29.155856 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a78d70-4dcb-4004-88fc-6c8e92a6b1b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:29.156727 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a78d70-4dcb-4004-88fc-6c8e92a6b1b1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:29.157105 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a78d70-4dcb-4004-88fc-6c8e92a6b1b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:29.158595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a78d70-4dcb-4004-88fc-6c8e92a6b1b1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:29.170884 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 94/187] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:22:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:29.176498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a78d70-4dcb-4004-88fc-6c8e92a6b1b1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:29.180670 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:29.262381 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9d25e-eee9-4cbd-9e43-6da6cb2bee07 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:29.285180 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a78d70-4dcb-4004-88fc-6c8e92a6b1b1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:29.298068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27369e-f722-4a7e-961b-74739e86d27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:29.298734 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27369e-f722-4a7e-961b-74739e86d27f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:29.299017 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27369e-f722-4a7e-961b-74739e86d27f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:29.299300 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27369e-f722-4a7e-961b-74739e86d27f None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:29.300048 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27369e-f722-4a7e-961b-74739e86d27f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:29.300382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27369e-f722-4a7e-961b-74739e86d27f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:29.301770 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27369e-f722-4a7e-961b-74739e86d27f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:29.309759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 94/188] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:29.310935 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a18a90-3c13-46b0-bc83-f7a1dec3ab4d None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:29.311221 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a18a90-3c13-46b0-bc83-f7a1dec3ab4d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:29.311499 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a18a90-3c13-46b0-bc83-f7a1dec3ab4d None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:29.312743 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 95/189] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:29.313807 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c42d2c-debd-4769-9c77-8e4d3a5c8861 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:29.314068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c42d2c-debd-4769-9c77-8e4d3a5c8861 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:29.314339 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c42d2c-debd-4769-9c77-8e4d3a5c8861 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:29.315657 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 96/190] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:29.316215 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c42d2c-debd-4769-9c77-8e4d3a5c8861 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:29.324214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa2d64-b480-4db9-8aed-7396979822cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:29.325142 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa2d64-b480-4db9-8aed-7396979822cb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:29.325422 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa2d64-b480-4db9-8aed-7396979822cb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:29.325698 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa2d64-b480-4db9-8aed-7396979822cb None admin] PATH_INFO: `/v3/users/f12cb35a2c4a402b8f1f84d889d0f298` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:29.339729 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa2d64-b480-4db9-8aed-7396979822cb None admin] RBAC: Authorizing `identity:get_user(user_id=f12cb35a2c4a402b8f1f84d889d0f298)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:29.341215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa2d64-b480-4db9-8aed-7396979822cb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:29.342848 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 95/191] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:29 2022] GET /identity/v3/users/f12cb35a2c4a402b8f1f84d889d0f298 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:29.344133 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee046a7-ead0-4287-bf6e-c949bf9fb50a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:29.344442 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee046a7-ead0-4287-bf6e-c949bf9fb50a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:29.344717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee046a7-ead0-4287-bf6e-c949bf9fb50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:29.360573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6ee046a7-ead0-4287-bf6e-c949bf9fb50a None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:29.361748 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6ee046a7-ead0-4287-bf6e-c949bf9fb50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:29.364418 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:29.399452 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:29.423655 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c42d2c-debd-4769-9c77-8e4d3a5c8861 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:29.427347 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 96/192] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:29.428590 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb8dd9-143b-4233-8543-f3431cbc85e9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:29.428877 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb8dd9-143b-4233-8543-f3431cbc85e9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:29.429148 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb8dd9-143b-4233-8543-f3431cbc85e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:29.445874 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-15bb8dd9-143b-4233-8543-f3431cbc85e9 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:29.447081 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-15bb8dd9-143b-4233-8543-f3431cbc85e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:29.459438 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d5046-4033-4f46-bef1-e31a28e52dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:29.460321 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d5046-4033-4f46-bef1-e31a28e52dfb None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:29.460613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d5046-4033-4f46-bef1-e31a28e52dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:29.460883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d5046-4033-4f46-bef1-e31a28e52dfb None admin] PATH_INFO: `/v3/users/f12cb35a2c4a402b8f1f84d889d0f298` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:29.462162 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d5046-4033-4f46-bef1-e31a28e52dfb None admin] RBAC: Authorizing `identity:get_user(user_id=f12cb35a2c4a402b8f1f84d889d0f298)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:29.463634 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d5046-4033-4f46-bef1-e31a28e52dfb None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:29.465281 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 97/193] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:29 2022] GET /identity/v3/users/f12cb35a2c4a402b8f1f84d889d0f298 => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:29.466029 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d5046-4033-4f46-bef1-e31a28e52dfb None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:29.516584 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 97/194] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:29.532498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb8dd9-143b-4233-8543-f3431cbc85e9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:29.565679 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d5046-4033-4f46-bef1-e31a28e52dfb None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:29.583664 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:29.598529 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb246ed2-c7da-40b7-9bbd-8bbd7f2c622e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:29.599201 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb246ed2-c7da-40b7-9bbd-8bbd7f2c622e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:29.599481 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb246ed2-c7da-40b7-9bbd-8bbd7f2c622e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:29.599761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb246ed2-c7da-40b7-9bbd-8bbd7f2c622e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:29.614964 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:29.615185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb8dd9-143b-4233-8543-f3431cbc85e9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:29.649423 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb4536-7c6d-4615-8055-3e6e6804b7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:29.650243 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb4536-7c6d-4615-8055-3e6e6804b7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:29.650532 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb4536-7c6d-4615-8055-3e6e6804b7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:29.650812 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb4536-7c6d-4615-8055-3e6e6804b7b9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:29.661270 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb4536-7c6d-4615-8055-3e6e6804b7b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:29.667011 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb246ed2-c7da-40b7-9bbd-8bbd7f2c622e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:29.668488 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb246ed2-c7da-40b7-9bbd-8bbd7f2c622e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:29.669483 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-dcfb4536-7c6d-4615-8055-3e6e6804b7b9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:22:29.669483 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:29.669483 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:29.669483 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:29.669483 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:29.669483 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:29.669483 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:29.669483 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:29.669483 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:29.669483 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:29.669483 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:29.669483 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:29.669483 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:29.669483 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:29.669483 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:29.669483 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:29.670304 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:29.670304 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:29.670304 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:29.670304 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:29.670304 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:29.670304 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:29.670304 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:29.670304 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:29.670304 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:29.670304 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:29.670304 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:29.670304 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:29.670304 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:29.670304 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:29.670304 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:29.670304 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:29.671275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:29.671275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:29.671275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:29.671275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:29.671275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:29.671275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:29.671275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:29.671275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:29.671275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:29.671275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:29.671275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:22:29.671275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:22:29.671275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 98/195] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:29.672085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb4536-7c6d-4615-8055-3e6e6804b7b9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:29.767154 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 98/196] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:22:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:29.767908 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb246ed2-c7da-40b7-9bbd-8bbd7f2c622e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:29.768631 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb4536-7c6d-4615-8055-3e6e6804b7b9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:29.796844 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:29.803375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3fec4-6658-4418-b504-60663f6fb11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:29.804024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3fec4-6658-4418-b504-60663f6fb11c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:29.804328 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3fec4-6658-4418-b504-60663f6fb11c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:29.804622 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3fec4-6658-4418-b504-60663f6fb11c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:29.814094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:29.867554 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb246ed2-c7da-40b7-9bbd-8bbd7f2c622e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:29.870923 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3fec4-6658-4418-b504-60663f6fb11c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:29.872421 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3fec4-6658-4418-b504-60663f6fb11c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:29.899786 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc5028-fd00-46a6-b08f-26f1761ac79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:29.901329 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc5028-fd00-46a6-b08f-26f1761ac79b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:29.901616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc5028-fd00-46a6-b08f-26f1761ac79b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:29.901883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc5028-fd00-46a6-b08f-26f1761ac79b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:29.903041 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc5028-fd00-46a6-b08f-26f1761ac79b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:29.904495 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc5028-fd00-46a6-b08f-26f1761ac79b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:29.906094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 99/197] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:22:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:29.906094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc5028-fd00-46a6-b08f-26f1761ac79b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:29.969970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 99/198] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:22:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:29.970807 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3fec4-6658-4418-b504-60663f6fb11c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:30.001069 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:30.003563 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc5028-fd00-46a6-b08f-26f1761ac79b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:30.016823 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:30.038404 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5453a8-fc79-48dc-b16f-3035a5799d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:30.038998 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5453a8-fc79-48dc-b16f-3035a5799d9d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:30.039283 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5453a8-fc79-48dc-b16f-3035a5799d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:30.039551 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5453a8-fc79-48dc-b16f-3035a5799d9d None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:30.040318 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5453a8-fc79-48dc-b16f-3035a5799d9d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:30.040623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5453a8-fc79-48dc-b16f-3035a5799d9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:30.042716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5453a8-fc79-48dc-b16f-3035a5799d9d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:30.050883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 100/199] 10.222.0.32 () {56 vars in 1101 bytes} [Thu Jun 2 13:22:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:30.051717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5453a8-fc79-48dc-b16f-3035a5799d9d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:30.076868 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3fec4-6658-4418-b504-60663f6fb11c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:30.110581 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76335d-64f5-4b33-9722-ec0de23556bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:30.111535 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76335d-64f5-4b33-9722-ec0de23556bd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:30.111813 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76335d-64f5-4b33-9722-ec0de23556bd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:30.112085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76335d-64f5-4b33-9722-ec0de23556bd None admin] PATH_INFO: `/v3/projects/b4bc26bb161145d88db0ede674ffce12` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:30.113287 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e76335d-64f5-4b33-9722-ec0de23556bd None admin] RBAC: Authorizing `identity:get_project(project_id=b4bc26bb161145d88db0ede674ffce12)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:30.114757 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e76335d-64f5-4b33-9722-ec0de23556bd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:30.116459 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 100/200] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:29 2022] GET /identity/v3/projects/b4bc26bb161145d88db0ede674ffce12 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:30.121181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76335d-64f5-4b33-9722-ec0de23556bd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:30.148636 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5453a8-fc79-48dc-b16f-3035a5799d9d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:30.182107 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69597844-2b1b-47c4-8d7c-ea3a53297fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:30.182759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69597844-2b1b-47c4-8d7c-ea3a53297fc2 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:30.183040 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69597844-2b1b-47c4-8d7c-ea3a53297fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:30.183316 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69597844-2b1b-47c4-8d7c-ea3a53297fc2 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:30.184028 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69597844-2b1b-47c4-8d7c-ea3a53297fc2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:30.185503 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69597844-2b1b-47c4-8d7c-ea3a53297fc2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:30.204436 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 101/201] 10.222.0.32 () {60 vars in 1132 bytes} [Thu Jun 2 13:22:30 2022] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:30.204436 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69597844-2b1b-47c4-8d7c-ea3a53297fc2 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:30.221008 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:30.224960 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76335d-64f5-4b33-9722-ec0de23556bd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:30.246927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:30.266100 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1416fa-d3ec-4608-a488-c84b9169a556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:30.266979 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1416fa-d3ec-4608-a488-c84b9169a556 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:30.267264 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1416fa-d3ec-4608-a488-c84b9169a556 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:30.267541 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1416fa-d3ec-4608-a488-c84b9169a556 None admin] PATH_INFO: `/v3/projects/b4bc26bb161145d88db0ede674ffce12` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:30.268829 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1416fa-d3ec-4608-a488-c84b9169a556 None admin] RBAC: Authorizing `identity:get_project(project_id=b4bc26bb161145d88db0ede674ffce12)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:30.270349 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1416fa-d3ec-4608-a488-c84b9169a556 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:30.272164 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 101/202] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:30 2022] GET /identity/v3/projects/b4bc26bb161145d88db0ede674ffce12 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:30.273021 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1416fa-d3ec-4608-a488-c84b9169a556 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:30.333855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69597844-2b1b-47c4-8d7c-ea3a53297fc2 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:30.371898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cc851-61e5-4d9f-92ef-2da1f5289d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:30.372821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cc851-61e5-4d9f-92ef-2da1f5289d7a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:30.373109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cc851-61e5-4d9f-92ef-2da1f5289d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:30.373391 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cc851-61e5-4d9f-92ef-2da1f5289d7a None admin] PATH_INFO: `/v3/users/aa6d318535084d91ae510e5b18b2763f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:30.374680 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098cc851-61e5-4d9f-92ef-2da1f5289d7a None admin] RBAC: Authorizing `identity:get_user(user_id=aa6d318535084d91ae510e5b18b2763f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:30.376177 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098cc851-61e5-4d9f-92ef-2da1f5289d7a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:30.377902 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 102/203] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:30 2022] GET /identity/v3/users/aa6d318535084d91ae510e5b18b2763f => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:30.378696 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cc851-61e5-4d9f-92ef-2da1f5289d7a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:30.400337 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1416fa-d3ec-4608-a488-c84b9169a556 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:30.440359 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b3222-a61b-46d7-af27-fd266ad203e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:30.440913 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b3222-a61b-46d7-af27-fd266ad203e2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:30.441421 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b3222-a61b-46d7-af27-fd266ad203e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:30.441524 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b3222-a61b-46d7-af27-fd266ad203e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:30.442297 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b3222-a61b-46d7-af27-fd266ad203e2 None admin] RBAC: Adding query filter params (role.id=5fe1cb1c673a407bb1025d500f111390, scope.project.id=b4bc26bb161145d88db0ede674ffce12, user.id=f12cb35a2c4a402b8f1f84d889d0f298) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:30.442611 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b3222-a61b-46d7-af27-fd266ad203e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:30.444606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b3222-a61b-46d7-af27-fd266ad203e2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:30.459107 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 102/204] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:22:30 2022] GET /identity/v3/role_assignments?user.id=f12cb35a2c4a402b8f1f84d889d0f298&scope.project.id=b4bc26bb161145d88db0ede674ffce12&role.id=5fe1cb1c673a407bb1025d500f111390 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:30.459107 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b3222-a61b-46d7-af27-fd266ad203e2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:30.503400 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:30.514212 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:30.519580 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cc851-61e5-4d9f-92ef-2da1f5289d7a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:30.568567 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1919ae-cbc6-4b61-a4b5-7d391fd46319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:30.569411 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1919ae-cbc6-4b61-a4b5-7d391fd46319 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:30.569825 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1919ae-cbc6-4b61-a4b5-7d391fd46319 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:30.570209 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1919ae-cbc6-4b61-a4b5-7d391fd46319 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:30.571195 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1919ae-cbc6-4b61-a4b5-7d391fd46319 None admin] RBAC: Adding query filter params (role.id=128feb04d1e042ac844f9ad70b89bb02, scope.project.id=b4bc26bb161145d88db0ede674ffce12, user.id=f12cb35a2c4a402b8f1f84d889d0f298) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:30.571522 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1919ae-cbc6-4b61-a4b5-7d391fd46319 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:30.575571 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1919ae-cbc6-4b61-a4b5-7d391fd46319 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:30.584190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 103/205] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:22:30 2022] GET /identity/v3/role_assignments?user.id=f12cb35a2c4a402b8f1f84d889d0f298&scope.project.id=b4bc26bb161145d88db0ede674ffce12&role.id=128feb04d1e042ac844f9ad70b89bb02 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:30.601062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b3222-a61b-46d7-af27-fd266ad203e2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:30.646972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9e4d3-ddd8-49f2-b791-78b0a6e52dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:30.647729 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9e4d3-ddd8-49f2-b791-78b0a6e52dcb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:30.648011 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9e4d3-ddd8-49f2-b791-78b0a6e52dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:30.648330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9e4d3-ddd8-49f2-b791-78b0a6e52dcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:30.737763 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9e4d3-ddd8-49f2-b791-78b0a6e52dcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:30.739293 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9e4d3-ddd8-49f2-b791-78b0a6e52dcb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:30.773852 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:30.853632 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 103/206] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:22:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:30.859073 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1919ae-cbc6-4b61-a4b5-7d391fd46319 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:30.982516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1919ae-cbc6-4b61-a4b5-7d391fd46319 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:31.031918 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45256602-cbd9-447f-96b5-093d01e8fa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:31.032811 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45256602-cbd9-447f-96b5-093d01e8fa47 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:31.033190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45256602-cbd9-447f-96b5-093d01e8fa47 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:31.033474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45256602-cbd9-447f-96b5-093d01e8fa47 None admin] PATH_INFO: `/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:31.037053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45256602-cbd9-447f-96b5-093d01e8fa47 None admin] RBAC: Authorizing `identity:get_project(project_id=f8b3b94854ab4f878d89ba44b09b07ea)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:31.038523 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45256602-cbd9-447f-96b5-093d01e8fa47 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:31.040467 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 104/207] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:30 2022] GET /identity/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:31.046717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9e4d3-ddd8-49f2-b791-78b0a6e52dcb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:31.153962 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9e4d3-ddd8-49f2-b791-78b0a6e52dcb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:31.185095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:31.191516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d8be2-df60-46fc-8f4c-84862605bb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:31.192180 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d8be2-df60-46fc-8f4c-84862605bb0a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:31.192503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d8be2-df60-46fc-8f4c-84862605bb0a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:31.192789 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d8be2-df60-46fc-8f4c-84862605bb0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:31.193626 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d8be2-df60-46fc-8f4c-84862605bb0a None admin] RBAC: Adding query filter params (role.id=2ea21d1487064d41a2ce42f381b455cc, scope.project.id=f8b3b94854ab4f878d89ba44b09b07ea, user.id=aa6d318535084d91ae510e5b18b2763f) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:31.193940 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d8be2-df60-46fc-8f4c-84862605bb0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:31.195400 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d8be2-df60-46fc-8f4c-84862605bb0a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:31.202138 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 104/208] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:22:31 2022] GET /identity/v3/role_assignments?user.id=aa6d318535084d91ae510e5b18b2763f&scope.project.id=f8b3b94854ab4f878d89ba44b09b07ea&role.id=2ea21d1487064d41a2ce42f381b455cc => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:32.903258 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928af70-6e9b-487d-bcad-6bdefd35efd2 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:32.904287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928af70-6e9b-487d-bcad-6bdefd35efd2 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:32.904805 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928af70-6e9b-487d-bcad-6bdefd35efd2 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:32.906385 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 105/209] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:32.912058 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08c2b1-d6bb-4576-9c74-bb69b00e14a1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:32.912948 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08c2b1-d6bb-4576-9c74-bb69b00e14a1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:32.913428 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08c2b1-d6bb-4576-9c74-bb69b00e14a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:32.930196 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5e92f-940b-4a33-9bf4-1febdeed0996 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:32.930788 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5e92f-940b-4a33-9bf4-1febdeed0996 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:32.931265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5e92f-940b-4a33-9bf4-1febdeed0996 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:32.933145 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8a08c2b1-d6bb-4576-9c74-bb69b00e14a1 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:32.933362 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 106/210] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:32.934258 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8a08c2b1-d6bb-4576-9c74-bb69b00e14a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:32.941390 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fa73e-c878-421b-b5af-23d36193ea88 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:32.941956 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fa73e-c878-421b-b5af-23d36193ea88 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:32.942456 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fa73e-c878-421b-b5af-23d36193ea88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:32.959341 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-309fa73e-c878-421b-b5af-23d36193ea88 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:32.960844 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-309fa73e-c878-421b-b5af-23d36193ea88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:32.986266 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:33.026057 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 105/211] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:33.042986 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b7a57-b8af-4ec8-945f-e9c7625597e1 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:33.043274 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b7a57-b8af-4ec8-945f-e9c7625597e1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:33.043552 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b7a57-b8af-4ec8-945f-e9c7625597e1 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:33.044409 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 107/212] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:22:33.045069 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 106/213] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:33.050355 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17af26-06c6-459d-9a67-2a775f899bfd None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:33.050866 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17af26-06c6-459d-9a67-2a775f899bfd None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:33.051341 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17af26-06c6-459d-9a67-2a775f899bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:33.054572 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b7a57-b8af-4ec8-945f-e9c7625597e1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:33.069179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-4b17af26-06c6-459d-9a67-2a775f899bfd None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:33.070607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4b17af26-06c6-459d-9a67-2a775f899bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:33.139164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 108/214] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:33.140120 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17af26-06c6-459d-9a67-2a775f899bfd None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:33.167364 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b7a57-b8af-4ec8-945f-e9c7625597e1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:33.190028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:33.201341 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1aea77-02b7-4a79-9435-86ebe7faabb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:33.202147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1aea77-02b7-4a79-9435-86ebe7faabb5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:33.202431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1aea77-02b7-4a79-9435-86ebe7faabb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:33.202707 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1aea77-02b7-4a79-9435-86ebe7faabb5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:33.213636 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1aea77-02b7-4a79-9435-86ebe7faabb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:33.221717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4e1aea77-02b7-4a79-9435-86ebe7faabb5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:22:33.221717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:33.221717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:33.221717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:33.221717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:33.221717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:33.221717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:33.221717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:33.221717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:33.221717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:33.221717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:33.221717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:33.221717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:33.221717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:33.221717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:33.221717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:33.222735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:33.222735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:33.222735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:33.222735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:33.222735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:33.222735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:33.222735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:33.222735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:33.222735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:33.222735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:33.222735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:33.222735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:33.222735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:33.222735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:33.222735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:33.222735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:33.223706 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:33.223706 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:33.223706 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:33.223706 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:33.223706 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:33.223706 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:33.223706 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:33.223706 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:33.223706 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:33.223706 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:33.223706 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:22:33.223706 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:22:33.223706 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 107/215] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Jun 2 13:22:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:22:33.224683 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d318de7-00a0-4ecd-94d5-14ea25765c17 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:33.224683 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d318de7-00a0-4ecd-94d5-14ea25765c17 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:33.224683 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d318de7-00a0-4ecd-94d5-14ea25765c17 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:33.226092 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 108/216] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:33.226617 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d318de7-00a0-4ecd-94d5-14ea25765c17 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:33.234114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:33.244680 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17af26-06c6-459d-9a67-2a775f899bfd None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:33.278596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c05b58-b1f6-4fa2-9845-f14b3ce08059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:33.279386 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c05b58-b1f6-4fa2-9845-f14b3ce08059 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:33.279673 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c05b58-b1f6-4fa2-9845-f14b3ce08059 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:33.279951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c05b58-b1f6-4fa2-9845-f14b3ce08059 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:33.289801 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c05b58-b1f6-4fa2-9845-f14b3ce08059 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:33.297435 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-61c05b58-b1f6-4fa2-9845-f14b3ce08059 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:33.297435 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:33.297435 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:33.297435 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:33.297435 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:33.297435 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:33.297435 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:33.297435 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:33.297435 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:33.297435 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:33.297435 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:33.297435 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:33.297435 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:33.297435 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:33.297435 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:33.297435 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:33.298374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:33.298374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:33.298374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:33.298374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:33.298374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:33.298374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:33.298374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:33.298374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:33.298374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:33.298374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:33.298374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:33.298374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:33.298374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:33.298374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:33.298374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:33.298374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:33.299456 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:33.299456 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:33.299456 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:33.299456 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:33.299456 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:33.299456 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:33.299456 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:33.299456 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:33.299456 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:33.299456 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:33.299456 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:33.299456 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:22:33.299456 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 109/217] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:33.300286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c05b58-b1f6-4fa2-9845-f14b3ce08059 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:33.329178 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d318de7-00a0-4ecd-94d5-14ea25765c17 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:33.362097 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f80e6-3693-4d3c-a494-1f08cc81262e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:33.362883 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f80e6-3693-4d3c-a494-1f08cc81262e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:33.363198 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f80e6-3693-4d3c-a494-1f08cc81262e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:33.363478 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f80e6-3693-4d3c-a494-1f08cc81262e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:33.364677 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f80e6-3693-4d3c-a494-1f08cc81262e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:33.366142 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f80e6-3693-4d3c-a494-1f08cc81262e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:33.367748 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 109/218] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:22:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:33.368896 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c21c3-8c82-4d99-a1c4-7ecb6f96cc15 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:33.369349 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c21c3-8c82-4d99-a1c4-7ecb6f96cc15 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:33.369629 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c21c3-8c82-4d99-a1c4-7ecb6f96cc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:33.385691 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-553c21c3-8c82-4d99-a1c4-7ecb6f96cc15 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:33.386868 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-553c21c3-8c82-4d99-a1c4-7ecb6f96cc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:33.399596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c05b58-b1f6-4fa2-9845-f14b3ce08059 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:33.431591 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:33.433560 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e555c-1ab1-4a6c-a71f-804dbd079d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:33.434218 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e555c-1ab1-4a6c-a71f-804dbd079d00 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:33.434506 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e555c-1ab1-4a6c-a71f-804dbd079d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:33.434783 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e555c-1ab1-4a6c-a71f-804dbd079d00 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:33.435543 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e555c-1ab1-4a6c-a71f-804dbd079d00 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:33.435851 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e555c-1ab1-4a6c-a71f-804dbd079d00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:33.437256 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e555c-1ab1-4a6c-a71f-804dbd079d00 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:33.445122 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 110/219] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:22:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:33.445889 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e555c-1ab1-4a6c-a71f-804dbd079d00 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:33.456905 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 110/220] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:33.457577 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c21c3-8c82-4d99-a1c4-7ecb6f96cc15 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:33.463804 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:33.548979 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e555c-1ab1-4a6c-a71f-804dbd079d00 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:33.561750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c21c3-8c82-4d99-a1c4-7ecb6f96cc15 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:33.581829 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8ec82-a440-4bf4-844a-2e54251292c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:33.582486 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8ec82-a440-4bf4-844a-2e54251292c2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:33.582780 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8ec82-a440-4bf4-844a-2e54251292c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:33.583061 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8ec82-a440-4bf4-844a-2e54251292c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:33.584069 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8ec82-a440-4bf4-844a-2e54251292c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:33.584405 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8ec82-a440-4bf4-844a-2e54251292c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:33.585788 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8ec82-a440-4bf4-844a-2e54251292c2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:33.593613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 111/221] 10.222.0.32 () {56 vars in 1101 bytes} [Thu Jun 2 13:22:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:33.594389 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8ec82-a440-4bf4-844a-2e54251292c2 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:33.594539 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ef0bd-78bf-4345-9871-97372ee61af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:33.595191 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ef0bd-78bf-4345-9871-97372ee61af6 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:33.595477 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ef0bd-78bf-4345-9871-97372ee61af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:33.595755 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ef0bd-78bf-4345-9871-97372ee61af6 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:33.596491 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ef0bd-78bf-4345-9871-97372ee61af6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:33.598167 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ef0bd-78bf-4345-9871-97372ee61af6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:33.624714 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 111/222] 10.222.0.32 () {60 vars in 1132 bytes} [Thu Jun 2 13:22:33 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:33.625744 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ef0bd-78bf-4345-9871-97372ee61af6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:33.669764 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:33.681285 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:33.711624 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8ec82-a440-4bf4-844a-2e54251292c2 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:33.744817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ef0bd-78bf-4345-9871-97372ee61af6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:33.750104 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd2195-3863-4b0b-bbcc-e194eb62032d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:33.750992 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd2195-3863-4b0b-bbcc-e194eb62032d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:33.751277 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd2195-3863-4b0b-bbcc-e194eb62032d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:33.751552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd2195-3863-4b0b-bbcc-e194eb62032d None admin] PATH_INFO: `/v3/users/f12cb35a2c4a402b8f1f84d889d0f298` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:33.752868 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd2195-3863-4b0b-bbcc-e194eb62032d None admin] RBAC: Authorizing `identity:get_user(user_id=f12cb35a2c4a402b8f1f84d889d0f298)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:33.754350 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd2195-3863-4b0b-bbcc-e194eb62032d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:33.756055 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 112/223] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:33 2022] GET /identity/v3/users/f12cb35a2c4a402b8f1f84d889d0f298 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:33.756948 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd2195-3863-4b0b-bbcc-e194eb62032d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:33.786451 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279077c-0329-43fa-9423-8a3fccc6216d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:33.787733 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279077c-0329-43fa-9423-8a3fccc6216d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:33.788004 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279077c-0329-43fa-9423-8a3fccc6216d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:33.788278 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279077c-0329-43fa-9423-8a3fccc6216d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:33.803600 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b279077c-0329-43fa-9423-8a3fccc6216d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:33.812085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b279077c-0329-43fa-9423-8a3fccc6216d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:22:33.812085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:33.812085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:33.812085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:33.812085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:33.812085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:33.812085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:33.812085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:33.812085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:33.812085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:33.812085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:33.812085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:33.812085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:33.812085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:33.812085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:33.812085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:33.813269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:33.813269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:33.813269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:33.813269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:33.813269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:33.813269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:33.813269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:33.813269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:33.813269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:33.813269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:33.813269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:33.813269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:33.813269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:33.813269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:33.813269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:33.813269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:33.814101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:33.814101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:33.814101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:33.814101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:33.814101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:33.814101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:33.814101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:33.814101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:33.814101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:33.814101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:33.814101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:22:33.814101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:22:33.814101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 112/224] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:22:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:33.815270 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279077c-0329-43fa-9423-8a3fccc6216d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:33.888422 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd2195-3863-4b0b-bbcc-e194eb62032d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:33.932758 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388d9a8-d19a-4b8b-9e16-14008c331af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:33.934396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388d9a8-d19a-4b8b-9e16-14008c331af3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:33.934862 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388d9a8-d19a-4b8b-9e16-14008c331af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:33.935209 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388d9a8-d19a-4b8b-9e16-14008c331af3 None admin] PATH_INFO: `/v3/users/bfbd69c569bb4d438a759fb82fb7b452` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:33.943757 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279077c-0329-43fa-9423-8a3fccc6216d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:33.945633 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:33.951597 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:33.952826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388d9a8-d19a-4b8b-9e16-14008c331af3 None admin] RBAC: Authorizing `identity:get_user(user_id=bfbd69c569bb4d438a759fb82fb7b452)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:33.954577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388d9a8-d19a-4b8b-9e16-14008c331af3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:33.957445 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 113/225] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:33 2022] GET /identity/v3/users/bfbd69c569bb4d438a759fb82fb7b452 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:33.958230 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388d9a8-d19a-4b8b-9e16-14008c331af3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:33.985053 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3f942-7d36-4786-8d42-5d14822f1aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:33.986151 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3f942-7d36-4786-8d42-5d14822f1aed None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:33.986595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3f942-7d36-4786-8d42-5d14822f1aed None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:33.986875 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3f942-7d36-4786-8d42-5d14822f1aed None admin] PATH_INFO: `/v3/projects/b4bc26bb161145d88db0ede674ffce12` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:33.988512 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3f942-7d36-4786-8d42-5d14822f1aed None admin] RBAC: Authorizing `identity:get_project(project_id=b4bc26bb161145d88db0ede674ffce12)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:33.990373 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3f942-7d36-4786-8d42-5d14822f1aed None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:33.992585 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 113/226] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:33 2022] GET /identity/v3/projects/b4bc26bb161145d88db0ede674ffce12 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:33.993193 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3f942-7d36-4786-8d42-5d14822f1aed None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:34.087677 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388d9a8-d19a-4b8b-9e16-14008c331af3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:34.109532 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3f942-7d36-4786-8d42-5d14822f1aed None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:34.141304 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae42c5a-48e9-43c7-8e39-85a6d6d18a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:34.141973 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae42c5a-48e9-43c7-8e39-85a6d6d18a92 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:34.142257 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae42c5a-48e9-43c7-8e39-85a6d6d18a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:34.142533 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae42c5a-48e9-43c7-8e39-85a6d6d18a92 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:34.143289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae42c5a-48e9-43c7-8e39-85a6d6d18a92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:34.143596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae42c5a-48e9-43c7-8e39-85a6d6d18a92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:34.145014 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae42c5a-48e9-43c7-8e39-85a6d6d18a92 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:34.155214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b332461-d119-4e63-aa21-5d67cb7c2d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:34.155870 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b332461-d119-4e63-aa21-5d67cb7c2d93 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:34.156155 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b332461-d119-4e63-aa21-5d67cb7c2d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:34.156461 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b332461-d119-4e63-aa21-5d67cb7c2d93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:34.157309 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 114/227] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:34.158464 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae42c5a-48e9-43c7-8e39-85a6d6d18a92 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:34.193842 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:34.237940 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:34.240931 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b332461-d119-4e63-aa21-5d67cb7c2d93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:34.242752 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b332461-d119-4e63-aa21-5d67cb7c2d93 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:34.282089 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae42c5a-48e9-43c7-8e39-85a6d6d18a92 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:34.327414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317c00b-e8f6-4117-af6a-70793df41389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:34.328705 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317c00b-e8f6-4117-af6a-70793df41389 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:34.329494 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317c00b-e8f6-4117-af6a-70793df41389 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:34.329838 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317c00b-e8f6-4117-af6a-70793df41389 None admin] PATH_INFO: `/v3/projects/b4bc26bb161145d88db0ede674ffce12/users/f12cb35a2c4a402b8f1f84d889d0f298/roles/5fe1cb1c673a407bb1025d500f111390` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:34.334521 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317c00b-e8f6-4117-af6a-70793df41389 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4bc26bb161145d88db0ede674ffce12, user_id=f12cb35a2c4a402b8f1f84d889d0f298, role_id=5fe1cb1c673a407bb1025d500f111390)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:34.336270 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317c00b-e8f6-4117-af6a-70793df41389 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:34.354208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 115/228] 10.222.0.32 () {58 vars in 1439 bytes} [Thu Jun 2 13:22:34 2022] PUT /identity/v3/projects/b4bc26bb161145d88db0ede674ffce12/users/f12cb35a2c4a402b8f1f84d889d0f298/roles/5fe1cb1c673a407bb1025d500f111390 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:34.355337 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317c00b-e8f6-4117-af6a-70793df41389 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:34.370358 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 114/229] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:22:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:34.378549 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b332461-d119-4e63-aa21-5d67cb7c2d93 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:34.507287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317c00b-e8f6-4117-af6a-70793df41389 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:34.526986 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:34.535349 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:34.550385 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247c1a7-bb8a-4d82-8676-76a9ef7e77a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:34.551631 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247c1a7-bb8a-4d82-8676-76a9ef7e77a9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:34.552173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247c1a7-bb8a-4d82-8676-76a9ef7e77a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:34.552676 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247c1a7-bb8a-4d82-8676-76a9ef7e77a9 None admin] PATH_INFO: `/v3/users/f12cb35a2c4a402b8f1f84d889d0f298` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:34.554247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247c1a7-bb8a-4d82-8676-76a9ef7e77a9 None admin] RBAC: Authorizing `identity:get_user(user_id=f12cb35a2c4a402b8f1f84d889d0f298)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:34.556026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247c1a7-bb8a-4d82-8676-76a9ef7e77a9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:34.558148 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 116/230] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:34 2022] GET /identity/v3/users/f12cb35a2c4a402b8f1f84d889d0f298 => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:34.568326 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247c1a7-bb8a-4d82-8676-76a9ef7e77a9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:34.583141 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b332461-d119-4e63-aa21-5d67cb7c2d93 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:34.620289 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4021c-7a62-473c-a120-6f412910cd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:34.621186 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4021c-7a62-473c-a120-6f412910cd1c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:34.621468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4021c-7a62-473c-a120-6f412910cd1c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:34.621739 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4021c-7a62-473c-a120-6f412910cd1c None admin] PATH_INFO: `/v3/projects/b4bc26bb161145d88db0ede674ffce12` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:34.623058 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4021c-7a62-473c-a120-6f412910cd1c None admin] RBAC: Authorizing `identity:get_project(project_id=b4bc26bb161145d88db0ede674ffce12)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:34.624715 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4021c-7a62-473c-a120-6f412910cd1c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:34.626891 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 115/231] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:34 2022] GET /identity/v3/projects/b4bc26bb161145d88db0ede674ffce12 => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:34.637504 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4021c-7a62-473c-a120-6f412910cd1c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:34.683597 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247c1a7-bb8a-4d82-8676-76a9ef7e77a9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:34.722232 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c248a3-c726-46ab-8340-3907f8b9a9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:34.723404 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c248a3-c726-46ab-8340-3907f8b9a9fd None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:34.723897 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c248a3-c726-46ab-8340-3907f8b9a9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:34.724450 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c248a3-c726-46ab-8340-3907f8b9a9fd None admin] PATH_INFO: `/v3/projects/b4bc26bb161145d88db0ede674ffce12` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:34.725885 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c248a3-c726-46ab-8340-3907f8b9a9fd None admin] RBAC: Authorizing `identity:get_project(project_id=b4bc26bb161145d88db0ede674ffce12)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:34.727606 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c248a3-c726-46ab-8340-3907f8b9a9fd None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:34.730027 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 117/232] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:34 2022] GET /identity/v3/projects/b4bc26bb161145d88db0ede674ffce12 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:34.736650 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c248a3-c726-46ab-8340-3907f8b9a9fd None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:34.754783 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4021c-7a62-473c-a120-6f412910cd1c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:34.792357 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35a179-b401-4f22-9a6f-2bea5c692a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:34.793044 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35a179-b401-4f22-9a6f-2bea5c692a86 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:34.793297 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35a179-b401-4f22-9a6f-2bea5c692a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:34.793571 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35a179-b401-4f22-9a6f-2bea5c692a86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:34.794457 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35a179-b401-4f22-9a6f-2bea5c692a86 None admin] RBAC: Adding query filter params (role.id=e4d5af06c5a44d479d25ce8490ce71a0, scope.project.id=b4bc26bb161145d88db0ede674ffce12, user.id=bfbd69c569bb4d438a759fb82fb7b452) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:34.794771 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35a179-b401-4f22-9a6f-2bea5c692a86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:34.796511 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35a179-b401-4f22-9a6f-2bea5c692a86 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:34.798454 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:34.808105 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 116/233] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:22:34 2022] GET /identity/v3/role_assignments?user.id=bfbd69c569bb4d438a759fb82fb7b452&scope.project.id=b4bc26bb161145d88db0ede674ffce12&role.id=e4d5af06c5a44d479d25ce8490ce71a0 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:34.823801 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:34.905645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c248a3-c726-46ab-8340-3907f8b9a9fd None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:34.964024 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94321a-0b50-4e5a-a6ee-da1035219847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:34.965025 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94321a-0b50-4e5a-a6ee-da1035219847 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:34.965315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94321a-0b50-4e5a-a6ee-da1035219847 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:34.965591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94321a-0b50-4e5a-a6ee-da1035219847 None admin] PATH_INFO: `/v3/projects/b4bc26bb161145d88db0ede674ffce12/users/f12cb35a2c4a402b8f1f84d889d0f298/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:34.973351 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94321a-0b50-4e5a-a6ee-da1035219847 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4bc26bb161145d88db0ede674ffce12, user_id=f12cb35a2c4a402b8f1f84d889d0f298, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:34.974858 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94321a-0b50-4e5a-a6ee-da1035219847 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:34.996793 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 118/234] 10.222.0.32 () {58 vars in 1439 bytes} [Thu Jun 2 13:22:34 2022] PUT /identity/v3/projects/b4bc26bb161145d88db0ede674ffce12/users/f12cb35a2c4a402b8f1f84d889d0f298/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:36.243707 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dcdb7-9797-4881-bc7f-ec6fca569140 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:36.243707 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dcdb7-9797-4881-bc7f-ec6fca569140 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:36.243707 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dcdb7-9797-4881-bc7f-ec6fca569140 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:36.244984 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 117/235] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:36.250534 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf548e-4f94-43a1-a2ed-d0a3930edef9 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:36.250930 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf548e-4f94-43a1-a2ed-d0a3930edef9 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:36.251117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf548e-4f94-43a1-a2ed-d0a3930edef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:36.273355 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-2ecf548e-4f94-43a1-a2ed-d0a3930edef9 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:36.274529 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2ecf548e-4f94-43a1-a2ed-d0a3930edef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:36.365596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 119/236] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:36.400973 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dcdb7-9797-4881-bc7f-ec6fca569140 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:36.510013 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913e851-ff00-4437-9f0b-1d25b505f3b5 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:36.510331 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913e851-ff00-4437-9f0b-1d25b505f3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:36.510592 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913e851-ff00-4437-9f0b-1d25b505f3b5 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:36.512239 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 120/237] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:36.517031 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419519ac-9236-4fd4-9128-8e9f2f5879ba None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:36.517322 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419519ac-9236-4fd4-9128-8e9f2f5879ba None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:36.517731 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419519ac-9236-4fd4-9128-8e9f2f5879ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:36.535986 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dcdb7-9797-4881-bc7f-ec6fca569140 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:36.561352 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-419519ac-9236-4fd4-9128-8e9f2f5879ba None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:36.562558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-419519ac-9236-4fd4-9128-8e9f2f5879ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:36.581263 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fba98-d147-429a-b105-cff820128493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:36.582587 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fba98-d147-429a-b105-cff820128493 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:36.583094 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fba98-d147-429a-b105-cff820128493 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:36.583544 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fba98-d147-429a-b105-cff820128493 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:36.598409 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170fba98-d147-429a-b105-cff820128493 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:36.611013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-170fba98-d147-429a-b105-cff820128493 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:22:36.611013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:36.611013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:36.611013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:36.611013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:36.611013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:36.611013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:36.611013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:36.611013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:36.611013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:36.611013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:36.611013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:36.611013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:36.611013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:36.611013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:36.611013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:36.612239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:36.612239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:36.612239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:36.612239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:36.612239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:36.612239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:36.612239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:36.612239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:36.612239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:36.612239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:36.612239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:36.612239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:36.612239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:36.612239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:36.612239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:36.612239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:36.613063 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:36.613063 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:36.613063 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:36.613063 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:36.613063 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:36.613063 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:36.613063 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:36.613063 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:36.613063 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:36.613063 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:36.613063 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:22:36.613063 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:22:36.613063 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 118/238] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:36.620240 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fba98-d147-429a-b105-cff820128493 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:36.669331 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:36.706727 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 121/239] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:22:36.725393 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:36.764484 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419519ac-9236-4fd4-9128-8e9f2f5879ba None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:36.811499 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fba98-d147-429a-b105-cff820128493 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:36.905176 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdeb95-c6c2-4977-8d2c-7e0db27a9ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:36.905966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdeb95-c6c2-4977-8d2c-7e0db27a9ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:36.906254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdeb95-c6c2-4977-8d2c-7e0db27a9ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:36.906536 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdeb95-c6c2-4977-8d2c-7e0db27a9ba4 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:36.906756 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419519ac-9236-4fd4-9128-8e9f2f5879ba None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:36.907318 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdeb95-c6c2-4977-8d2c-7e0db27a9ba4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:36.907607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdeb95-c6c2-4977-8d2c-7e0db27a9ba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:36.909073 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdeb95-c6c2-4977-8d2c-7e0db27a9ba4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:36.925427 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 119/240] 10.222.0.32 () {56 vars in 1101 bytes} [Thu Jun 2 13:22:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:22:36.936640 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdeb95-c6c2-4977-8d2c-7e0db27a9ba4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:36.951919 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bac9b-d027-42c9-b46a-7c7266be530d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:36.953092 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bac9b-d027-42c9-b46a-7c7266be530d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:36.954021 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bac9b-d027-42c9-b46a-7c7266be530d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:36.954509 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bac9b-d027-42c9-b46a-7c7266be530d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:36.955929 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bac9b-d027-42c9-b46a-7c7266be530d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:36.957667 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bac9b-d027-42c9-b46a-7c7266be530d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:36.960094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 122/241] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:22:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:36.966200 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bac9b-d027-42c9-b46a-7c7266be530d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:37.027900 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:37.091197 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bac9b-d027-42c9-b46a-7c7266be530d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:37.131387 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d00d9-0429-4841-8d9a-8eb821301a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:37.132846 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d00d9-0429-4841-8d9a-8eb821301a9e None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:37.133347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d00d9-0429-4841-8d9a-8eb821301a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:37.133823 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d00d9-0429-4841-8d9a-8eb821301a9e None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:37.134814 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d00d9-0429-4841-8d9a-8eb821301a9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:37.136732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d00d9-0429-4841-8d9a-8eb821301a9e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:37.171466 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 123/242] 10.222.0.32 () {60 vars in 1132 bytes} [Thu Jun 2 13:22:36 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:22:37.190219 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdeb95-c6c2-4977-8d2c-7e0db27a9ba4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:37.215079 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:37.231534 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992d579-8938-4ef5-b68e-aab2bb49d2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:37.232478 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992d579-8938-4ef5-b68e-aab2bb49d2bd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:37.232998 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992d579-8938-4ef5-b68e-aab2bb49d2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:37.233349 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992d579-8938-4ef5-b68e-aab2bb49d2bd None admin] PATH_INFO: `/v3/users/33073063f9b644e3b3324b90e8b21396` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:37.253141 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992d579-8938-4ef5-b68e-aab2bb49d2bd None admin] RBAC: Authorizing `identity:get_user(user_id=33073063f9b644e3b3324b90e8b21396)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:37.255070 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992d579-8938-4ef5-b68e-aab2bb49d2bd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:37.257236 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 120/243] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:36 2022] GET /identity/v3/users/33073063f9b644e3b3324b90e8b21396 => generated 297 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:37.262984 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d00d9-0429-4841-8d9a-8eb821301a9e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:37.379682 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d00d9-0429-4841-8d9a-8eb821301a9e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:37.381770 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a1918-b18c-447c-bfe7-0204939c2d0f None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:37.382254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a1918-b18c-447c-bfe7-0204939c2d0f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:37.382729 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a1918-b18c-447c-bfe7-0204939c2d0f None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:37.384312 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 121/244] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:22:37.386454 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:37.393882 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9f636-9acc-42b0-bb5d-5f46ffafa967 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:37.394319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9f636-9acc-42b0-bb5d-5f46ffafa967 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:37.394702 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9f636-9acc-42b0-bb5d-5f46ffafa967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:37.425450 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d2a9f636-9acc-42b0-bb5d-5f46ffafa967 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:37.427855 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d2a9f636-9acc-42b0-bb5d-5f46ffafa967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:37.430366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907b4b5-3e5b-4342-97d9-f472b9aa7053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:37.431271 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907b4b5-3e5b-4342-97d9-f472b9aa7053 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:37.431588 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907b4b5-3e5b-4342-97d9-f472b9aa7053 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:37.431870 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907b4b5-3e5b-4342-97d9-f472b9aa7053 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:37.518121 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907b4b5-3e5b-4342-97d9-f472b9aa7053 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:37.518998 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 122/245] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:37.524391 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907b4b5-3e5b-4342-97d9-f472b9aa7053 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:37.545333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9f636-9acc-42b0-bb5d-5f46ffafa967 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:37.649564 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 124/246] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:22:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:37.651758 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db4660-16d6-4cd2-a669-bee48eeadba4 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:37.652048 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db4660-16d6-4cd2-a669-bee48eeadba4 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:37.652424 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db4660-16d6-4cd2-a669-bee48eeadba4 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:37.654145 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 125/247] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:37.655945 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db4660-16d6-4cd2-a669-bee48eeadba4 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:37.661536 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:37.687963 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9f636-9acc-42b0-bb5d-5f46ffafa967 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:37.703650 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:37.734459 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3fe5f-7f12-4a83-aedd-09c7258c7777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:37.735439 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3fe5f-7f12-4a83-aedd-09c7258c7777 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:37.736195 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3fe5f-7f12-4a83-aedd-09c7258c7777 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:37.736521 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3fe5f-7f12-4a83-aedd-09c7258c7777 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:37.751074 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3fe5f-7f12-4a83-aedd-09c7258c7777 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:37.762352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e3d3fe5f-7f12-4a83-aedd-09c7258c7777 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:22:37.762352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:37.762352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:37.762352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:37.762352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:37.762352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:37.762352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:37.762352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:37.762352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:37.762352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:37.762352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:37.762352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:37.762352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:37.762352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:37.762352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:37.762352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:37.763377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:37.763377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:37.763377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:37.763377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:37.763377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:37.763377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:37.763377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:37.763377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:37.763377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:37.763377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:37.763377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:37.763377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:37.763377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:37.763377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:37.763377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:37.763377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:37.764168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:37.764168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:37.764168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:37.764168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:37.764168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:37.764168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:37.764168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:37.764168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:37.764168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:37.764168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:37.764168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:22:37.764168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:22:37.764818 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 123/248] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Jun 2 13:22:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:37.768347 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095efef6-45ec-4fb7-bcc3-15d165c25353 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:37.768347 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095efef6-45ec-4fb7-bcc3-15d165c25353 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:37.768347 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095efef6-45ec-4fb7-bcc3-15d165c25353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:37.787931 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db4660-16d6-4cd2-a669-bee48eeadba4 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:37.797014 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-095efef6-45ec-4fb7-bcc3-15d165c25353 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:37.798275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-095efef6-45ec-4fb7-bcc3-15d165c25353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:37.830392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cde306-65ec-4e74-b81e-4ef2838dd446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:37.831250 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cde306-65ec-4e74-b81e-4ef2838dd446 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:37.831526 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cde306-65ec-4e74-b81e-4ef2838dd446 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:37.831805 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cde306-65ec-4e74-b81e-4ef2838dd446 None admin] PATH_INFO: `/v3/projects/b4bc26bb161145d88db0ede674ffce12` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:37.833115 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cde306-65ec-4e74-b81e-4ef2838dd446 None admin] RBAC: Authorizing `identity:get_project(project_id=b4bc26bb161145d88db0ede674ffce12)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:37.834923 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cde306-65ec-4e74-b81e-4ef2838dd446 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:37.837643 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 126/249] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:37 2022] GET /identity/v3/projects/b4bc26bb161145d88db0ede674ffce12 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:37.838307 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cde306-65ec-4e74-b81e-4ef2838dd446 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:37.894250 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 124/250] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:37.895175 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095efef6-45ec-4fb7-bcc3-15d165c25353 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:37.923850 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:37.961852 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cde306-65ec-4e74-b81e-4ef2838dd446 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:38.001723 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e497728-2f9a-4dff-a8b0-5e3a102c5af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:38.002396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e497728-2f9a-4dff-a8b0-5e3a102c5af3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:38.002681 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e497728-2f9a-4dff-a8b0-5e3a102c5af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:38.002962 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e497728-2f9a-4dff-a8b0-5e3a102c5af3 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:38.003826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e497728-2f9a-4dff-a8b0-5e3a102c5af3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:38.004147 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e497728-2f9a-4dff-a8b0-5e3a102c5af3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:38.007194 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e497728-2f9a-4dff-a8b0-5e3a102c5af3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:38.021027 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 127/251] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:22:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:38.022328 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e497728-2f9a-4dff-a8b0-5e3a102c5af3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:38.028397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:38.032287 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095efef6-45ec-4fb7-bcc3-15d165c25353 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:38.073091 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00da6ac-a723-4c81-ab59-0cc83a5b575e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:38.073752 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00da6ac-a723-4c81-ab59-0cc83a5b575e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:38.074031 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00da6ac-a723-4c81-ab59-0cc83a5b575e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:38.078689 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00da6ac-a723-4c81-ab59-0cc83a5b575e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:38.078689 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00da6ac-a723-4c81-ab59-0cc83a5b575e None admin] RBAC: Adding query filter params (role.id=2ea21d1487064d41a2ce42f381b455cc, scope.project.id=b4bc26bb161145d88db0ede674ffce12, user.id=33073063f9b644e3b3324b90e8b21396) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:38.078689 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00da6ac-a723-4c81-ab59-0cc83a5b575e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:38.078689 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00da6ac-a723-4c81-ab59-0cc83a5b575e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:38.084681 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 125/252] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:22:37 2022] GET /identity/v3/role_assignments?user.id=33073063f9b644e3b3324b90e8b21396&scope.project.id=b4bc26bb161145d88db0ede674ffce12&role.id=2ea21d1487064d41a2ce42f381b455cc => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:38.085706 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00da6ac-a723-4c81-ab59-0cc83a5b575e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:38.187829 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e497728-2f9a-4dff-a8b0-5e3a102c5af3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:38.233995 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00da6ac-a723-4c81-ab59-0cc83a5b575e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:38.247006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:38.254799 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535db54-e1cc-4233-aa08-a011a6221eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:38.255680 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535db54-e1cc-4233-aa08-a011a6221eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:38.255971 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535db54-e1cc-4233-aa08-a011a6221eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:38.256249 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535db54-e1cc-4233-aa08-a011a6221eb5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:38.280036 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535db54-e1cc-4233-aa08-a011a6221eb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:38.288881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-8535db54-e1cc-4233-aa08-a011a6221eb5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:38.288881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:38.288881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:38.288881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:38.288881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:38.288881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:38.288881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:38.288881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:38.288881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:38.288881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:38.288881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:38.288881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:38.288881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:38.288881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:38.288881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:38.288881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:38.289883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:38.289883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:38.289883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:38.289883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:38.289883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:38.289883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:38.289883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:38.289883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:38.289883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:38.289883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:38.289883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:38.289883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:38.289883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:38.289883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:38.289883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:38.289883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:38.290666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:38.290666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:38.290666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:38.290666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:38.290666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:38.290666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:38.290666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:38.290666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:38.290666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:38.290666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:38.290666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:38.290666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:22:38.290666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 128/253] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:38.293291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c2a7e-227b-4007-a37b-860364172dfa None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:38.294413 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c2a7e-227b-4007-a37b-860364172dfa None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:38.297790 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c2a7e-227b-4007-a37b-860364172dfa None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:38.302970 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 129/254] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:38 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:38.303847 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c2a7e-227b-4007-a37b-860364172dfa None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:38.310311 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37ee37-16c1-4b9b-9466-a609ce975d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:38.311273 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37ee37-16c1-4b9b-9466-a609ce975d1a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:38.311560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37ee37-16c1-4b9b-9466-a609ce975d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:38.311840 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37ee37-16c1-4b9b-9466-a609ce975d1a None admin] PATH_INFO: `/v3/users/f12cb35a2c4a402b8f1f84d889d0f298` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:38.313503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37ee37-16c1-4b9b-9466-a609ce975d1a None admin] RBAC: Authorizing `identity:get_user(user_id=f12cb35a2c4a402b8f1f84d889d0f298)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:38.314989 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37ee37-16c1-4b9b-9466-a609ce975d1a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:38.319794 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 126/255] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:38 2022] GET /identity/v3/users/f12cb35a2c4a402b8f1f84d889d0f298 => generated 283 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:38.321894 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec2560-a11f-4191-8dbf-c1817acefd44 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:38.322244 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec2560-a11f-4191-8dbf-c1817acefd44 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:38.327163 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec2560-a11f-4191-8dbf-c1817acefd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:38.347875 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2cec2560-a11f-4191-8dbf-c1817acefd44 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:38.349102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2cec2560-a11f-4191-8dbf-c1817acefd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:38.378936 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:38.428247 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 127/256] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:38.429480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec2560-a11f-4191-8dbf-c1817acefd44 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:38.505159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c2a7e-227b-4007-a37b-860364172dfa None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:38.537815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec2560-a11f-4191-8dbf-c1817acefd44 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:38.563047 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cccc1-b15f-4347-b79a-76f7553b8b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:38.563729 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cccc1-b15f-4347-b79a-76f7553b8b4a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:38.564017 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cccc1-b15f-4347-b79a-76f7553b8b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:38.564315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cccc1-b15f-4347-b79a-76f7553b8b4a None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:38.565191 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cccc1-b15f-4347-b79a-76f7553b8b4a None admin] RBAC: Adding query filter params (name=member) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:38.565507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cccc1-b15f-4347-b79a-76f7553b8b4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:38.567069 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cccc1-b15f-4347-b79a-76f7553b8b4a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:38.577467 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b8a09-1f6e-4f43-b9fc-34fd6251b464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:38.578526 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b8a09-1f6e-4f43-b9fc-34fd6251b464 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:38.579012 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b8a09-1f6e-4f43-b9fc-34fd6251b464 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:38.579496 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b8a09-1f6e-4f43-b9fc-34fd6251b464 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:38.584435 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 130/257] 10.222.0.32 () {56 vars in 1101 bytes} [Thu Jun 2 13:22:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:38.585274 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cccc1-b15f-4347-b79a-76f7553b8b4a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:38.619759 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:38.654329 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b8a09-1f6e-4f43-b9fc-34fd6251b464 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:38.655867 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b8a09-1f6e-4f43-b9fc-34fd6251b464 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:38.764066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 128/258] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:22:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:38.769156 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b8a09-1f6e-4f43-b9fc-34fd6251b464 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:38.778104 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:38.848156 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:38.878443 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cccc1-b15f-4347-b79a-76f7553b8b4a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:38.929685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b8a09-1f6e-4f43-b9fc-34fd6251b464 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:38.950122 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ad804-0d92-463a-a75e-7873bc0ada50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:38.951265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ad804-0d92-463a-a75e-7873bc0ada50 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:38.951820 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ad804-0d92-463a-a75e-7873bc0ada50 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:38.952325 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ad804-0d92-463a-a75e-7873bc0ada50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:38.971355 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ad804-0d92-463a-a75e-7873bc0ada50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:38.984377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6d76e-b90f-4ef0-98d0-ed87932172c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:38.985486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6d76e-b90f-4ef0-98d0-ed87932172c9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:38.985613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-3c6ad804-0d92-463a-a75e-7873bc0ada50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:22:38.985613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:38.985613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:38.985613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:38.985613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:38.985613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:38.985613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:38.985613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:38.985613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:38.985613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:38.985613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:38.985613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:38.985613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:38.985613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:38.985613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:38.985613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:38.986414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:38.986414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:38.986414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:38.986414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:38.986414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:38.986414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:38.986414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:38.986414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:38.986414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:38.986414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:38.986414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:38.986414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:38.986414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:38.986414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:38.986414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:38.986414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:38.987203 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:38.987203 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:38.987203 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:38.987203 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:38.987203 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:38.987203 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:38.987203 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:38.987203 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:38.987203 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:38.987203 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:38.987203 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:22:38.987203 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:22:38.987203 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 131/259] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:22:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:38.987924 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ad804-0d92-463a-a75e-7873bc0ada50 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:38.988899 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6d76e-b90f-4ef0-98d0-ed87932172c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:38.989413 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6d76e-b90f-4ef0-98d0-ed87932172c9 None admin] PATH_INFO: `/v3/users/bfbd69c569bb4d438a759fb82fb7b452` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:38.990875 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6d76e-b90f-4ef0-98d0-ed87932172c9 None admin] RBAC: Authorizing `identity:get_user(user_id=bfbd69c569bb4d438a759fb82fb7b452)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:38.992892 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6d76e-b90f-4ef0-98d0-ed87932172c9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:38.995098 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 129/260] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:38 2022] GET /identity/v3/users/bfbd69c569bb4d438a759fb82fb7b452 => generated 297 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:38.996148 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6d76e-b90f-4ef0-98d0-ed87932172c9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:39.173917 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ad804-0d92-463a-a75e-7873bc0ada50 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:39.175008 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6d76e-b90f-4ef0-98d0-ed87932172c9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:39.202063 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:39.207586 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:39.222939 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313b56c-c332-4cfb-b2b8-0456bf09b6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:39.223621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313b56c-c332-4cfb-b2b8-0456bf09b6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:39.223906 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313b56c-c332-4cfb-b2b8-0456bf09b6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:39.224181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313b56c-c332-4cfb-b2b8-0456bf09b6f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:39.224965 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313b56c-c332-4cfb-b2b8-0456bf09b6f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:39.225266 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313b56c-c332-4cfb-b2b8-0456bf09b6f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:39.226656 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313b56c-c332-4cfb-b2b8-0456bf09b6f7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:39.237940 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 130/261] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:39.238943 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313b56c-c332-4cfb-b2b8-0456bf09b6f7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:39.242087 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a8815-2a48-4ea5-8028-8618774fb155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:39.244642 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a8815-2a48-4ea5-8028-8618774fb155 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:39.245114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a8815-2a48-4ea5-8028-8618774fb155 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:39.245541 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a8815-2a48-4ea5-8028-8618774fb155 None admin] PATH_INFO: `/v3/projects/b4bc26bb161145d88db0ede674ffce12` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:39.246925 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a8815-2a48-4ea5-8028-8618774fb155 None admin] RBAC: Authorizing `identity:get_project(project_id=b4bc26bb161145d88db0ede674ffce12)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:39.248601 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a8815-2a48-4ea5-8028-8618774fb155 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:39.251330 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 132/262] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:38 2022] GET /identity/v3/projects/b4bc26bb161145d88db0ede674ffce12 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:39.252557 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a8815-2a48-4ea5-8028-8618774fb155 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:39.400752 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313b56c-c332-4cfb-b2b8-0456bf09b6f7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:39.436778 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506c4fb-462a-4e54-9e13-831aba64dca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:39.437873 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506c4fb-462a-4e54-9e13-831aba64dca3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:39.438303 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506c4fb-462a-4e54-9e13-831aba64dca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:39.438746 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506c4fb-462a-4e54-9e13-831aba64dca3 None admin] PATH_INFO: `/v3/projects/b4bc26bb161145d88db0ede674ffce12` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:39.440317 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506c4fb-462a-4e54-9e13-831aba64dca3 None admin] RBAC: Authorizing `identity:get_project(project_id=b4bc26bb161145d88db0ede674ffce12)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:39.441946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506c4fb-462a-4e54-9e13-831aba64dca3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:39.444011 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 131/263] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:39 2022] GET /identity/v3/projects/b4bc26bb161145d88db0ede674ffce12 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:39.444951 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506c4fb-462a-4e54-9e13-831aba64dca3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:39.463564 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a8815-2a48-4ea5-8028-8618774fb155 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:39.538581 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9c9ed-c31e-4d19-a66f-5e6287f5bb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:39.539707 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9c9ed-c31e-4d19-a66f-5e6287f5bb62 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:39.540140 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9c9ed-c31e-4d19-a66f-5e6287f5bb62 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:39.540586 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9c9ed-c31e-4d19-a66f-5e6287f5bb62 None admin] PATH_INFO: `/v3/users/f12cb35a2c4a402b8f1f84d889d0f298` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:39.543524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9c9ed-c31e-4d19-a66f-5e6287f5bb62 None admin] RBAC: Authorizing `identity:get_user(user_id=f12cb35a2c4a402b8f1f84d889d0f298)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:39.546681 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9c9ed-c31e-4d19-a66f-5e6287f5bb62 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:39.552334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 133/264] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:39 2022] GET /identity/v3/users/f12cb35a2c4a402b8f1f84d889d0f298 => generated 283 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:39.553291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9c9ed-c31e-4d19-a66f-5e6287f5bb62 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:39.577203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:39.638522 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:39.653711 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506c4fb-462a-4e54-9e13-831aba64dca3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:39.716752 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50c7ee-55bb-459d-afa7-fbf6a6f2ff11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:39.718400 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50c7ee-55bb-459d-afa7-fbf6a6f2ff11 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:39.719468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50c7ee-55bb-459d-afa7-fbf6a6f2ff11 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:39.721063 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50c7ee-55bb-459d-afa7-fbf6a6f2ff11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:39.722086 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50c7ee-55bb-459d-afa7-fbf6a6f2ff11 None admin] RBAC: Adding query filter params (role.id=5fe1cb1c673a407bb1025d500f111390, scope.project.id=b4bc26bb161145d88db0ede674ffce12, user.id=f12cb35a2c4a402b8f1f84d889d0f298) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:39.722732 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50c7ee-55bb-459d-afa7-fbf6a6f2ff11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:39.725827 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50c7ee-55bb-459d-afa7-fbf6a6f2ff11 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:39.734999 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 132/265] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:22:39 2022] GET /identity/v3/role_assignments?user.id=f12cb35a2c4a402b8f1f84d889d0f298&scope.project.id=b4bc26bb161145d88db0ede674ffce12&role.id=5fe1cb1c673a407bb1025d500f111390 => generated 608 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:39.737046 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9c9ed-c31e-4d19-a66f-5e6287f5bb62 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:39.739644 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50c7ee-55bb-459d-afa7-fbf6a6f2ff11 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:39.831464 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02d74d-a452-4f77-bd3d-6c0122060a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:39.832693 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02d74d-a452-4f77-bd3d-6c0122060a76 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:39.834078 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02d74d-a452-4f77-bd3d-6c0122060a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:39.834733 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02d74d-a452-4f77-bd3d-6c0122060a76 None admin] PATH_INFO: `/v3/projects/b4bc26bb161145d88db0ede674ffce12/users/bfbd69c569bb4d438a759fb82fb7b452/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:39.840012 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b02d74d-a452-4f77-bd3d-6c0122060a76 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4bc26bb161145d88db0ede674ffce12, user_id=bfbd69c569bb4d438a759fb82fb7b452, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:39.841782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b02d74d-a452-4f77-bd3d-6c0122060a76 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:39.867550 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 134/266] 10.222.0.32 () {58 vars in 1439 bytes} [Thu Jun 2 13:22:39 2022] PUT /identity/v3/projects/b4bc26bb161145d88db0ede674ffce12/users/bfbd69c569bb4d438a759fb82fb7b452/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:39.935802 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50c7ee-55bb-459d-afa7-fbf6a6f2ff11 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:39.966444 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:39.980609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fcd7e-daa7-4a8e-99d1-05bc425b8493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:39.981208 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fcd7e-daa7-4a8e-99d1-05bc425b8493 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:39.981497 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fcd7e-daa7-4a8e-99d1-05bc425b8493 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:39.981782 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fcd7e-daa7-4a8e-99d1-05bc425b8493 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:40.073209 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0fcd7e-daa7-4a8e-99d1-05bc425b8493 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:40.074728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0fcd7e-daa7-4a8e-99d1-05bc425b8493 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:40.191834 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 133/267] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:22:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:40.197651 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02d74d-a452-4f77-bd3d-6c0122060a76 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:40.320998 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02d74d-a452-4f77-bd3d-6c0122060a76 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:40.334447 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:40.365556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105144c-02eb-4055-96a5-cb689d3e1365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:40.366440 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105144c-02eb-4055-96a5-cb689d3e1365 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:40.366729 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105144c-02eb-4055-96a5-cb689d3e1365 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:40.367012 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105144c-02eb-4055-96a5-cb689d3e1365 None admin] PATH_INFO: `/v3/projects/b4bc26bb161145d88db0ede674ffce12` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:40.368316 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105144c-02eb-4055-96a5-cb689d3e1365 None admin] RBAC: Authorizing `identity:get_project(project_id=b4bc26bb161145d88db0ede674ffce12)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:40.372187 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105144c-02eb-4055-96a5-cb689d3e1365 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:40.374292 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 135/268] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:40 2022] GET /identity/v3/projects/b4bc26bb161145d88db0ede674ffce12 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:40.379883 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fcd7e-daa7-4a8e-99d1-05bc425b8493 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:40.406994 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:40.423140 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79f232-935e-44bf-91dd-218703c8ffd4 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:40.423788 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79f232-935e-44bf-91dd-218703c8ffd4 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:40.424150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79f232-935e-44bf-91dd-218703c8ffd4 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:40.426042 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 136/269] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:22:40.430894 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdcefb-8952-4516-a45c-c4507be57950 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:40.431183 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdcefb-8952-4516-a45c-c4507be57950 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:40.431995 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdcefb-8952-4516-a45c-c4507be57950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:40.450989 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c1bdcefb-8952-4516-a45c-c4507be57950 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:40.452426 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c1bdcefb-8952-4516-a45c-c4507be57950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:40.504920 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fcd7e-daa7-4a8e-99d1-05bc425b8493 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:40.538671 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 137/270] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:22:40.552022 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b008183-e0ee-4b4c-9b52-b280421aef80 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:40.552618 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b008183-e0ee-4b4c-9b52-b280421aef80 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:40.553068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b008183-e0ee-4b4c-9b52-b280421aef80 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:40.554607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 138/271] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:22:40.560180 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec54c0e-16a6-416f-883e-1d0a84ff482e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:40.560985 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af816812-da71-453d-a497-4d45875a0b07 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:40.561302 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec54c0e-16a6-416f-883e-1d0a84ff482e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:40.561415 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af816812-da71-453d-a497-4d45875a0b07 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:40.561784 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af816812-da71-453d-a497-4d45875a0b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:40.561962 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec54c0e-16a6-416f-883e-1d0a84ff482e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:40.562388 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec54c0e-16a6-416f-883e-1d0a84ff482e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:40.563356 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec54c0e-16a6-416f-883e-1d0a84ff482e None admin] RBAC: Adding query filter params (role.id=128feb04d1e042ac844f9ad70b89bb02, scope.project.id=b4bc26bb161145d88db0ede674ffce12, user.id=f12cb35a2c4a402b8f1f84d889d0f298) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:40.563797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec54c0e-16a6-416f-883e-1d0a84ff482e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:40.565447 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec54c0e-16a6-416f-883e-1d0a84ff482e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:40.573564 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 134/272] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:22:40 2022] GET /identity/v3/role_assignments?user.id=f12cb35a2c4a402b8f1f84d889d0f298&scope.project.id=b4bc26bb161145d88db0ede674ffce12&role.id=128feb04d1e042ac844f9ad70b89bb02 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:40.580333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec54c0e-16a6-416f-883e-1d0a84ff482e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:40.587661 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-af816812-da71-453d-a497-4d45875a0b07 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:40.589197 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-af816812-da71-453d-a497-4d45875a0b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:40.669771 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 139/273] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 02 13:22:40.707880 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af816812-da71-453d-a497-4d45875a0b07 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:40.765291 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:40.788688 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:40.802774 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec54c0e-16a6-416f-883e-1d0a84ff482e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:40.867045 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd6f33-ebef-4a15-b8a9-563dcd9a6004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:40.867769 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd6f33-ebef-4a15-b8a9-563dcd9a6004 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:40.868053 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd6f33-ebef-4a15-b8a9-563dcd9a6004 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:40.868345 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd6f33-ebef-4a15-b8a9-563dcd9a6004 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:40.889121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd6f33-ebef-4a15-b8a9-563dcd9a6004 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:40.897992 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4ddd6f33-ebef-4a15-b8a9-563dcd9a6004 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:40.897992 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:40.897992 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:40.897992 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:40.897992 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:40.897992 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:40.897992 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:40.897992 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:40.897992 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:40.897992 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:40.897992 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:40.897992 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:40.897992 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:40.897992 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:40.897992 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:40.897992 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:40.898889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:40.898889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:40.898889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:40.898889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:40.898889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:40.898889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:40.898889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:40.898889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:40.898889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:40.898889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:40.898889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:40.898889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:40.898889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:40.898889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:40.898889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:40.898889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:40.899663 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:40.899663 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:40.899663 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:40.899663 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:40.899663 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:40.899663 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:40.899663 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:40.899663 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:40.899663 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:40.899663 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:40.899663 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:40.899663 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:22:40.899663 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 135/274] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:40.906847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd6f33-ebef-4a15-b8a9-563dcd9a6004 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:40.912047 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af816812-da71-453d-a497-4d45875a0b07 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:40.954498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261f256-ba42-44d8-8923-1d7fccfcf3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:40.955294 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261f256-ba42-44d8-8923-1d7fccfcf3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:40.955578 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261f256-ba42-44d8-8923-1d7fccfcf3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:40.955853 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261f256-ba42-44d8-8923-1d7fccfcf3e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:40.959115 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261f256-ba42-44d8-8923-1d7fccfcf3e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:40.960478 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261f256-ba42-44d8-8923-1d7fccfcf3e2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:40.962741 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 140/275] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:22:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:40.964147 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9e259-6157-4e89-a78d-7a572a5c0886 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:40.966146 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9e259-6157-4e89-a78d-7a572a5c0886 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:40.966146 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9e259-6157-4e89-a78d-7a572a5c0886 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:40.967147 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 141/276] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:40.971986 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9e259-6157-4e89-a78d-7a572a5c0886 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:41.048908 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd6f33-ebef-4a15-b8a9-563dcd9a6004 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:41.085865 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bed247-ba1b-495c-a7be-6026b4d1c37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:41.086643 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bed247-ba1b-495c-a7be-6026b4d1c37a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:41.086934 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bed247-ba1b-495c-a7be-6026b4d1c37a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:41.087209 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bed247-ba1b-495c-a7be-6026b4d1c37a None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:41.087459 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9e259-6157-4e89-a78d-7a572a5c0886 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:41.088501 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bed247-ba1b-495c-a7be-6026b4d1c37a None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:41.088811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bed247-ba1b-495c-a7be-6026b4d1c37a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:41.090862 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bed247-ba1b-495c-a7be-6026b4d1c37a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:41.095826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:41.099835 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 136/277] 10.222.0.32 () {56 vars in 1101 bytes} [Thu Jun 2 13:22:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:41.102398 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35795228-4266-474c-97e1-5d7dc133fc6a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:41.102685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35795228-4266-474c-97e1-5d7dc133fc6a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:41.102961 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35795228-4266-474c-97e1-5d7dc133fc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:41.121526 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-35795228-4266-474c-97e1-5d7dc133fc6a None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:41.122686 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-35795228-4266-474c-97e1-5d7dc133fc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:41.124785 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:41.129243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636d16e-833b-40f3-b2c4-1c3191bbb0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:41.129915 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636d16e-833b-40f3-b2c4-1c3191bbb0db None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:41.130200 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636d16e-833b-40f3-b2c4-1c3191bbb0db None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:41.130479 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636d16e-833b-40f3-b2c4-1c3191bbb0db None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:41.131198 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636d16e-833b-40f3-b2c4-1c3191bbb0db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:41.132680 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636d16e-833b-40f3-b2c4-1c3191bbb0db None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:41.154791 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 142/278] 10.222.0.32 () {60 vars in 1132 bytes} [Thu Jun 2 13:22:40 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:41.167138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636d16e-833b-40f3-b2c4-1c3191bbb0db None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:41.208346 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 137/279] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:41.232960 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35795228-4266-474c-97e1-5d7dc133fc6a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:41.330011 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636d16e-833b-40f3-b2c4-1c3191bbb0db None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:41.349628 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35795228-4266-474c-97e1-5d7dc133fc6a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:41.375588 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293c6b7-44c1-4ead-9b0a-af53c84a06fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:41.376810 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293c6b7-44c1-4ead-9b0a-af53c84a06fa None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:41.377315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293c6b7-44c1-4ead-9b0a-af53c84a06fa None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:41.378386 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293c6b7-44c1-4ead-9b0a-af53c84a06fa None admin] PATH_INFO: `/v3/users/4bdbf0de47b342a9beeeccea9b5163da` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:41.394021 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293c6b7-44c1-4ead-9b0a-af53c84a06fa None admin] RBAC: Authorizing `identity:get_user(user_id=4bdbf0de47b342a9beeeccea9b5163da)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:41.395594 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293c6b7-44c1-4ead-9b0a-af53c84a06fa None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:41.396339 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf6da1-958d-4781-8fef-f492fee69e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:41.398068 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf6da1-958d-4781-8fef-f492fee69e08 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:41.398180 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 143/280] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:41 2022] GET /identity/v3/users/4bdbf0de47b342a9beeeccea9b5163da => generated 293 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:41.398713 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf6da1-958d-4781-8fef-f492fee69e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:41.399009 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf6da1-958d-4781-8fef-f492fee69e08 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:41.404093 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293c6b7-44c1-4ead-9b0a-af53c84a06fa None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:41.409582 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:41.412483 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf6da1-958d-4781-8fef-f492fee69e08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:41.422386 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-53bf6da1-958d-4781-8fef-f492fee69e08 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:22:41.422386 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:41.422386 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:41.422386 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:41.422386 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:41.422386 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:41.422386 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:41.422386 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:41.422386 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:41.422386 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:41.422386 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:41.422386 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:41.422386 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:41.422386 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:41.422386 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:41.422386 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:41.423306 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:41.423306 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:41.423306 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:41.423306 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:41.423306 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:41.423306 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:41.423306 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:41.423306 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:41.423306 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:41.423306 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:41.423306 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:41.423306 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:41.423306 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:41.423306 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:41.423306 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:41.423306 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:41.424101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:41.424101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:41.424101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:41.424101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:41.424101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:41.424101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:41.424101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:41.424101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:41.424101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:41.424101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:41.424101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:22:41.424101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:22:41.428651 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 138/281] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:22:41.429401 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf6da1-958d-4781-8fef-f492fee69e08 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:41.433454 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:41.542349 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293c6b7-44c1-4ead-9b0a-af53c84a06fa None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:41.562428 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf6da1-958d-4781-8fef-f492fee69e08 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:41.596952 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7b216-b73d-43fa-ad76-5f36234589f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:41.597792 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7b216-b73d-43fa-ad76-5f36234589f1 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:41.598423 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7b216-b73d-43fa-ad76-5f36234589f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:41.598712 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7b216-b73d-43fa-ad76-5f36234589f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:41.599731 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d7b216-b73d-43fa-ad76-5f36234589f1 None admin] RBAC: Adding query filter params (role.id=e4d5af06c5a44d479d25ce8490ce71a0, user.id=4bdbf0de47b342a9beeeccea9b5163da, scope.system=all) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:41.600151 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d7b216-b73d-43fa-ad76-5f36234589f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:41.601634 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d7b216-b73d-43fa-ad76-5f36234589f1 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:41.603451 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a0b86-67c8-4dc4-a8e6-ad875fe4c466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:41.604540 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a0b86-67c8-4dc4-a8e6-ad875fe4c466 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:41.605005 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a0b86-67c8-4dc4-a8e6-ad875fe4c466 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:41.605466 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a0b86-67c8-4dc4-a8e6-ad875fe4c466 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:41.606389 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a0b86-67c8-4dc4-a8e6-ad875fe4c466 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:41.606864 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a0b86-67c8-4dc4-a8e6-ad875fe4c466 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:41.607613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 144/282] 10.222.0.32 () {56 vars in 1308 bytes} [Thu Jun 2 13:22:41 2022] GET /identity/v3/role_assignments?user.id=4bdbf0de47b342a9beeeccea9b5163da&scope.system=all&role.id=e4d5af06c5a44d479d25ce8490ce71a0 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:22:41.609125 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a0b86-67c8-4dc4-a8e6-ad875fe4c466 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:41.619225 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 139/283] 10.222.0.32 () {56 vars in 1101 bytes} [Thu Jun 2 13:22:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:41.626733 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7b216-b73d-43fa-ad76-5f36234589f1 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:41.725506 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:41.738150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7b216-b73d-43fa-ad76-5f36234589f1 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:41.776052 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f4a94-9806-4038-a7ff-88b817169e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:41.777019 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f4a94-9806-4038-a7ff-88b817169e62 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:41.777361 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f4a94-9806-4038-a7ff-88b817169e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:41.777646 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f4a94-9806-4038-a7ff-88b817169e62 None admin] PATH_INFO: `/v3/users/33073063f9b644e3b3324b90e8b21396` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:41.779057 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f4a94-9806-4038-a7ff-88b817169e62 None admin] RBAC: Authorizing `identity:get_user(user_id=33073063f9b644e3b3324b90e8b21396)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:41.780564 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f4a94-9806-4038-a7ff-88b817169e62 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:41.782594 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 145/284] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:41 2022] GET /identity/v3/users/33073063f9b644e3b3324b90e8b21396 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:41.788321 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a0b86-67c8-4dc4-a8e6-ad875fe4c466 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:41.855299 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:41.902393 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a0b86-67c8-4dc4-a8e6-ad875fe4c466 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:41.938599 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881a687-986c-4093-9b6a-3e859fd40870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:41.939468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881a687-986c-4093-9b6a-3e859fd40870 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:41.939752 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881a687-986c-4093-9b6a-3e859fd40870 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:41.940033 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881a687-986c-4093-9b6a-3e859fd40870 None admin] PATH_INFO: `/v3/projects/b4bc26bb161145d88db0ede674ffce12` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:41.941265 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881a687-986c-4093-9b6a-3e859fd40870 None admin] RBAC: Authorizing `identity:get_project(project_id=b4bc26bb161145d88db0ede674ffce12)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:41.942801 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881a687-986c-4093-9b6a-3e859fd40870 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:41.944930 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 140/285] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:41 2022] GET /identity/v3/projects/b4bc26bb161145d88db0ede674ffce12 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:41.951356 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f4a94-9806-4038-a7ff-88b817169e62 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:42.081998 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f4a94-9806-4038-a7ff-88b817169e62 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:42.129024 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19878ac-3c9e-4939-8828-9ec9c0a7118b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:42.130270 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19878ac-3c9e-4939-8828-9ec9c0a7118b None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:42.130752 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19878ac-3c9e-4939-8828-9ec9c0a7118b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:42.131247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19878ac-3c9e-4939-8828-9ec9c0a7118b None admin] PATH_INFO: `/v3/projects/b4bc26bb161145d88db0ede674ffce12/users/33073063f9b644e3b3324b90e8b21396/roles/2ea21d1487064d41a2ce42f381b455cc` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:42.137622 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19878ac-3c9e-4939-8828-9ec9c0a7118b None admin] RBAC: Authorizing `identity:create_grant(project_id=b4bc26bb161145d88db0ede674ffce12, user_id=33073063f9b644e3b3324b90e8b21396, role_id=2ea21d1487064d41a2ce42f381b455cc)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:42.139314 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19878ac-3c9e-4939-8828-9ec9c0a7118b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:42.157514 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 146/286] 10.222.0.32 () {58 vars in 1439 bytes} [Thu Jun 2 13:22:41 2022] PUT /identity/v3/projects/b4bc26bb161145d88db0ede674ffce12/users/33073063f9b644e3b3324b90e8b21396/roles/2ea21d1487064d41a2ce42f381b455cc => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:42.804952 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2390e-19a9-4463-8697-5071445ebcee None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:42.805497 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2390e-19a9-4463-8697-5071445ebcee None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:42.805497 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2390e-19a9-4463-8697-5071445ebcee None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:42.806911 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 141/287] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:42.812647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f96f2-fa04-4a0b-8a2d-26a8f96606f9 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:42.813518 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f96f2-fa04-4a0b-8a2d-26a8f96606f9 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:42.814024 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f96f2-fa04-4a0b-8a2d-26a8f96606f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:42.835725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-998f96f2-fa04-4a0b-8a2d-26a8f96606f9 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:42.837377 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-998f96f2-fa04-4a0b-8a2d-26a8f96606f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:42.846259 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:42.915647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 147/288] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:42.951211 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2390e-19a9-4463-8697-5071445ebcee None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:43.064594 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2390e-19a9-4463-8697-5071445ebcee None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:43.096658 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:43.104038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a1771-94ab-40d0-9898-913b2d6b88db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:43.104867 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a1771-94ab-40d0-9898-913b2d6b88db None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:43.105154 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a1771-94ab-40d0-9898-913b2d6b88db None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:43.105432 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a1771-94ab-40d0-9898-913b2d6b88db None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:43.119264 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a1771-94ab-40d0-9898-913b2d6b88db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:43.126939 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-281a1771-94ab-40d0-9898-913b2d6b88db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:43.126939 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:43.126939 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:43.126939 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:43.126939 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:43.126939 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:43.126939 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:43.126939 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:43.126939 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:43.126939 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:43.126939 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:43.126939 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:43.126939 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:43.126939 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:43.126939 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:43.126939 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:43.127836 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:43.127836 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:43.127836 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:43.127836 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:43.127836 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:43.127836 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:43.127836 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:43.127836 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:43.127836 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:43.127836 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:43.127836 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:43.127836 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:43.127836 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:43.127836 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:43.127836 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:43.127836 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:43.128788 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:43.128788 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:43.128788 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:43.128788 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:43.128788 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:43.128788 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:43.128788 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:43.128788 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:43.128788 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:43.128788 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:43.128788 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:43.128788 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:22:43.128788 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 142/289] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:43.135180 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f96f2-fa04-4a0b-8a2d-26a8f96606f9 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:43.272610 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f96f2-fa04-4a0b-8a2d-26a8f96606f9 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:43.316448 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588ac20-6d24-49ca-a979-0207be4a96f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:43.317045 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588ac20-6d24-49ca-a979-0207be4a96f4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:43.317335 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588ac20-6d24-49ca-a979-0207be4a96f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:43.317616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588ac20-6d24-49ca-a979-0207be4a96f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:43.318380 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588ac20-6d24-49ca-a979-0207be4a96f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:43.318687 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588ac20-6d24-49ca-a979-0207be4a96f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:43.320090 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588ac20-6d24-49ca-a979-0207be4a96f4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:43.329639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 148/290] 10.222.0.32 () {56 vars in 1101 bytes} [Thu Jun 2 13:22:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:43.334997 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a1771-94ab-40d0-9898-913b2d6b88db None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:43.475456 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a1771-94ab-40d0-9898-913b2d6b88db None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:43.522570 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585612d-b673-482a-8f99-c262323bdada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:43.523456 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585612d-b673-482a-8f99-c262323bdada None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:43.523744 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585612d-b673-482a-8f99-c262323bdada None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:43.524029 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585612d-b673-482a-8f99-c262323bdada None admin] PATH_INFO: `/v3/users/bfbd69c569bb4d438a759fb82fb7b452` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:43.525301 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585612d-b673-482a-8f99-c262323bdada None admin] RBAC: Authorizing `identity:get_user(user_id=bfbd69c569bb4d438a759fb82fb7b452)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:43.526821 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585612d-b673-482a-8f99-c262323bdada None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:43.528691 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 143/291] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:43 2022] GET /identity/v3/users/bfbd69c569bb4d438a759fb82fb7b452 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:43.533949 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588ac20-6d24-49ca-a979-0207be4a96f4 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:43.537953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:43.647969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588ac20-6d24-49ca-a979-0207be4a96f4 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:43.685107 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbc2e7-41a6-42f0-ab55-ba7106287ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:43.685765 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbc2e7-41a6-42f0-ab55-ba7106287ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:43.686055 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbc2e7-41a6-42f0-ab55-ba7106287ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:43.686331 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbc2e7-41a6-42f0-ab55-ba7106287ed3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:43.762806 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fbc2e7-41a6-42f0-ab55-ba7106287ed3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:43.764331 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fbc2e7-41a6-42f0-ab55-ba7106287ed3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:43.767383 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:43.883948 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 149/292] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:22:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:43.889615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585612d-b673-482a-8f99-c262323bdada None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:43.975746 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:44.049686 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585612d-b673-482a-8f99-c262323bdada None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:44.098746 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a9919-11bc-4639-aa48-7642a63470a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:44.099642 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a9919-11bc-4639-aa48-7642a63470a0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:44.099928 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a9919-11bc-4639-aa48-7642a63470a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:44.100207 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a9919-11bc-4639-aa48-7642a63470a0 None admin] PATH_INFO: `/v3/projects/b4bc26bb161145d88db0ede674ffce12` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:44.105627 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a9919-11bc-4639-aa48-7642a63470a0 None admin] RBAC: Authorizing `identity:get_project(project_id=b4bc26bb161145d88db0ede674ffce12)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:44.107127 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a9919-11bc-4639-aa48-7642a63470a0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:44.109200 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 144/293] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:43 2022] GET /identity/v3/projects/b4bc26bb161145d88db0ede674ffce12 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:44.114589 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbc2e7-41a6-42f0-ab55-ba7106287ed3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:44.226812 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04a8d6-6357-4878-9c57-459f06e322d6 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:44.227149 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04a8d6-6357-4878-9c57-459f06e322d6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:44.227323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04a8d6-6357-4878-9c57-459f06e322d6 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:44.229322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 145/294] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:22:44.235095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8341310-89f7-4048-8753-4d537597ba55 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:44.235390 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8341310-89f7-4048-8753-4d537597ba55 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:44.235661 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8341310-89f7-4048-8753-4d537597ba55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:44.265616 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d8341310-89f7-4048-8753-4d537597ba55 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:44.266834 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d8341310-89f7-4048-8753-4d537597ba55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:44.284728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbc2e7-41a6-42f0-ab55-ba7106287ed3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:44.289524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:44.355036 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 146/295] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:22:44.376062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d60eb-8e9c-4f6a-9c9a-3c6f1e7fd2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:44.376742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8341310-89f7-4048-8753-4d537597ba55 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:44.377312 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d60eb-8e9c-4f6a-9c9a-3c6f1e7fd2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:44.377788 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d60eb-8e9c-4f6a-9c9a-3c6f1e7fd2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:44.378255 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d60eb-8e9c-4f6a-9c9a-3c6f1e7fd2d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:44.379400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d60eb-8e9c-4f6a-9c9a-3c6f1e7fd2d1 None admin] RBAC: Adding query filter params (role.id=e4d5af06c5a44d479d25ce8490ce71a0, scope.project.id=b4bc26bb161145d88db0ede674ffce12, user.id=bfbd69c569bb4d438a759fb82fb7b452) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:44.379970 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d60eb-8e9c-4f6a-9c9a-3c6f1e7fd2d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:44.381653 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d60eb-8e9c-4f6a-9c9a-3c6f1e7fd2d1 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:44.388732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 150/296] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:22:44 2022] GET /identity/v3/role_assignments?user.id=bfbd69c569bb4d438a759fb82fb7b452&scope.project.id=b4bc26bb161145d88db0ede674ffce12&role.id=e4d5af06c5a44d479d25ce8490ce71a0 => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:44.465378 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:44.478840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318cd11-f344-43e2-856d-2983e65f8097 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:44.479486 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318cd11-f344-43e2-856d-2983e65f8097 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:44.480046 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318cd11-f344-43e2-856d-2983e65f8097 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:44.481842 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 151/297] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:22:44.492933 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ce2b0-bc20-46ca-814d-1b224b5aed5a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:44.493545 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ce2b0-bc20-46ca-814d-1b224b5aed5a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:44.494058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ce2b0-bc20-46ca-814d-1b224b5aed5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:44.524199 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8341310-89f7-4048-8753-4d537597ba55 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:44.532057 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c53ce2b0-bc20-46ca-814d-1b224b5aed5a None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:44.533551 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c53ce2b0-bc20-46ca-814d-1b224b5aed5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:44.563279 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f4b06-ef3d-4e53-a5e5-2515173f3a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:44.564101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f4b06-ef3d-4e53-a5e5-2515173f3a93 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:44.564492 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f4b06-ef3d-4e53-a5e5-2515173f3a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:44.564777 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f4b06-ef3d-4e53-a5e5-2515173f3a93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:44.566080 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f4b06-ef3d-4e53-a5e5-2515173f3a93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:44.567586 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f4b06-ef3d-4e53-a5e5-2515173f3a93 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:44.569645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 147/298] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:22:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:22:44.577498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f4b06-ef3d-4e53-a5e5-2515173f3a93 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:44.643245 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 152/299] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:22:44.663218 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b04ab-d6da-4cb0-b264-1ac9e770b10a None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:44.663741 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b04ab-d6da-4cb0-b264-1ac9e770b10a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:44.664160 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b04ab-d6da-4cb0-b264-1ac9e770b10a None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:44.666164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 153/300] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:22:44.671422 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b04ab-d6da-4cb0-b264-1ac9e770b10a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:44.730381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f4b06-ef3d-4e53-a5e5-2515173f3a93 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:44.754389 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:44.768614 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373d18d-7867-404c-8692-560dd756ea0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:44.769283 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373d18d-7867-404c-8692-560dd756ea0a None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:44.769563 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373d18d-7867-404c-8692-560dd756ea0a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:44.769839 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373d18d-7867-404c-8692-560dd756ea0a None admin] PATH_INFO: `/v3/groups` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:44.770524 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373d18d-7867-404c-8692-560dd756ea0a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:44.771968 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373d18d-7867-404c-8692-560dd756ea0a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:44.788053 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 148/301] 10.222.0.32 () {60 vars in 1134 bytes} [Thu Jun 2 13:22:44 2022] POST /identity/v3/groups => generated 229 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:44.789330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a401aed-df9b-43c9-b3bc-b9df35848153 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:44.789619 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a401aed-df9b-43c9-b3bc-b9df35848153 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:44.790089 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a401aed-df9b-43c9-b3bc-b9df35848153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:44.793828 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:44.804798 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b04ab-d6da-4cb0-b264-1ac9e770b10a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:44.810199 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4a401aed-df9b-43c9-b3bc-b9df35848153 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:44.810722 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4a401aed-df9b-43c9-b3bc-b9df35848153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:44.856348 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116adec-869d-4912-a900-de3b7179695d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:44.857551 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116adec-869d-4912-a900-de3b7179695d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:44.858041 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116adec-869d-4912-a900-de3b7179695d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:44.858608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116adec-869d-4912-a900-de3b7179695d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:44.872569 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116adec-869d-4912-a900-de3b7179695d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:44.881363 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-4116adec-869d-4912-a900-de3b7179695d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:22:44.881363 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:44.881363 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:44.881363 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:44.881363 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:44.881363 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:44.881363 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:44.881363 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:44.881363 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:44.881363 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:44.881363 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:44.881363 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:44.881363 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:44.881363 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:44.881363 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:44.881363 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:44.882320 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:44.882320 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:44.882320 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:44.882320 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:44.882320 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:44.882320 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:44.882320 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:44.882320 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:44.882320 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:44.882320 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:44.882320 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:44.882320 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:44.882320 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:44.882320 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:44.882320 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:44.882320 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:44.883111 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:44.883111 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:44.883111 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:44.883111 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:44.883111 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:44.883111 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:44.883111 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:44.883111 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:44.883111 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:44.883111 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:44.883111 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:22:44.883111 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:22:44.891424 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 154/302] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:44.893262 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116adec-869d-4912-a900-de3b7179695d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:44.894479 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 149/303] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:44.916662 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a401aed-df9b-43c9-b3bc-b9df35848153 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:45.008231 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116adec-869d-4912-a900-de3b7179695d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:45.034455 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a401aed-df9b-43c9-b3bc-b9df35848153 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:45.048060 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:45.051282 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dad116-9c01-4691-8fb4-9e08814834d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:45.051964 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dad116-9c01-4691-8fb4-9e08814834d5 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:45.052247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dad116-9c01-4691-8fb4-9e08814834d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:45.052554 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dad116-9c01-4691-8fb4-9e08814834d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:45.053479 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dad116-9c01-4691-8fb4-9e08814834d5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:45.054085 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dad116-9c01-4691-8fb4-9e08814834d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:45.055489 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dad116-9c01-4691-8fb4-9e08814834d5 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:45.067020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 155/304] 10.222.0.32 () {56 vars in 1101 bytes} [Thu Jun 2 13:22:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:45.068619 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895e268-561d-4369-9c80-47b45ab98534 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:45.069174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895e268-561d-4369-9c80-47b45ab98534 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:45.069460 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895e268-561d-4369-9c80-47b45ab98534 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:45.070827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 156/305] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:45.073521 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7056306-5f7c-4a67-a1fa-4e0c057654ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:45.074323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7056306-5f7c-4a67-a1fa-4e0c057654ed None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:45.074606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7056306-5f7c-4a67-a1fa-4e0c057654ed None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:45.074882 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7056306-5f7c-4a67-a1fa-4e0c057654ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:45.075994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895e268-561d-4369-9c80-47b45ab98534 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:45.085639 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7056306-5f7c-4a67-a1fa-4e0c057654ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:45.093847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c7056306-5f7c-4a67-a1fa-4e0c057654ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:45.093847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:45.093847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:45.093847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:45.093847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:45.093847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:45.093847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:45.093847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:45.093847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:45.093847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:45.093847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:45.093847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:45.093847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:45.093847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:45.093847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:45.093847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:45.094794 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:45.094794 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:45.094794 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:45.094794 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:45.094794 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:45.094794 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:45.094794 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:45.094794 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:45.094794 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:45.094794 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:45.094794 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:45.094794 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:45.094794 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:45.094794 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:45.094794 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:45.094794 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:45.096503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:45.096503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:45.096503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:45.096503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:45.096503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:45.096503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:45.096503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:45.096503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:45.096503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:45.096503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:45.096503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:45.096503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:22:45.096503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 150/306] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:22:45.096503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99eb70-d997-4e2c-b4d8-705a5fb348fa None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:45.097215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99eb70-d997-4e2c-b4d8-705a5fb348fa None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:45.097215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99eb70-d997-4e2c-b4d8-705a5fb348fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:45.106885 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:45.114872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8c99eb70-d997-4e2c-b4d8-705a5fb348fa None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:45.116044 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8c99eb70-d997-4e2c-b4d8-705a5fb348fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:45.186551 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 151/307] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:45.190594 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895e268-561d-4369-9c80-47b45ab98534 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:45.197757 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99eb70-d997-4e2c-b4d8-705a5fb348fa None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:45.229904 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df446ba-e48b-47bc-8a2f-ce32f536c797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:45.230764 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df446ba-e48b-47bc-8a2f-ce32f536c797 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:45.231045 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df446ba-e48b-47bc-8a2f-ce32f536c797 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:45.231312 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df446ba-e48b-47bc-8a2f-ce32f536c797 None admin] PATH_INFO: `/v3/users/c957e00c622f45b7bf0ebab46e79c53f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:45.245791 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df446ba-e48b-47bc-8a2f-ce32f536c797 None admin] RBAC: Authorizing `identity:get_user(user_id=c957e00c622f45b7bf0ebab46e79c53f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:45.247349 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df446ba-e48b-47bc-8a2f-ce32f536c797 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:45.249504 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 157/308] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:45 2022] GET /identity/v3/users/c957e00c622f45b7bf0ebab46e79c53f => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:45.250473 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df446ba-e48b-47bc-8a2f-ce32f536c797 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:45.304371 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99eb70-d997-4e2c-b4d8-705a5fb348fa None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:45.306346 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:45.336592 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:45.342993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a7316-957c-438e-b96c-1d7b749ae7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:45.343671 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a7316-957c-438e-b96c-1d7b749ae7d6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:45.343958 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a7316-957c-438e-b96c-1d7b749ae7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:45.344221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a7316-957c-438e-b96c-1d7b749ae7d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:45.344997 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a7316-957c-438e-b96c-1d7b749ae7d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:45.345302 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a7316-957c-438e-b96c-1d7b749ae7d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:45.346693 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a7316-957c-438e-b96c-1d7b749ae7d6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:45.356429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 152/309] 10.222.0.32 () {56 vars in 1101 bytes} [Thu Jun 2 13:22:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:45.357252 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a7316-957c-438e-b96c-1d7b749ae7d6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:45.366372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df446ba-e48b-47bc-8a2f-ce32f536c797 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:45.400894 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfb40b-8344-436e-aaf1-d8d30430b9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:45.401696 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfb40b-8344-436e-aaf1-d8d30430b9cf None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:45.401976 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfb40b-8344-436e-aaf1-d8d30430b9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:45.402250 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfb40b-8344-436e-aaf1-d8d30430b9cf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:45.412843 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dfb40b-8344-436e-aaf1-d8d30430b9cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:45.420674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-72dfb40b-8344-436e-aaf1-d8d30430b9cf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:22:45.420674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:45.420674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:45.420674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:45.420674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:45.420674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:45.420674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:45.420674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:45.420674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:45.420674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:45.420674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:45.420674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:45.420674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:45.420674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:45.420674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:45.420674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:45.421558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:45.421558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:45.421558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:45.421558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:45.421558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:45.421558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:45.421558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:45.421558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:45.421558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:45.421558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:45.421558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:45.421558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:45.421558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:45.421558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:45.421558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:45.421558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:45.422375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:45.422375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:45.422375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:45.422375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:45.422375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:45.422375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:45.422375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:45.422375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:45.422375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:45.422375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:45.422375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:22:45.422375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:22:45.422375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 158/310] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:45.423691 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfb40b-8344-436e-aaf1-d8d30430b9cf None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:45.468194 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a7316-957c-438e-b96c-1d7b749ae7d6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:45.503463 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffaec28-4ff0-4abc-8c66-61adfef97533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:45.504556 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffaec28-4ff0-4abc-8c66-61adfef97533 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:45.504847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffaec28-4ff0-4abc-8c66-61adfef97533 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:45.505125 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffaec28-4ff0-4abc-8c66-61adfef97533 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:45.506337 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffaec28-4ff0-4abc-8c66-61adfef97533 None admin] RBAC: Adding query filter params (role.id=2ea21d1487064d41a2ce42f381b455cc, user.id=c957e00c622f45b7bf0ebab46e79c53f, scope.system=all) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:45.506676 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffaec28-4ff0-4abc-8c66-61adfef97533 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:45.508475 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffaec28-4ff0-4abc-8c66-61adfef97533 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:45.514556 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 153/311] 10.222.0.32 () {56 vars in 1308 bytes} [Thu Jun 2 13:22:45 2022] GET /identity/v3/role_assignments?user.id=c957e00c622f45b7bf0ebab46e79c53f&scope.system=all&role.id=2ea21d1487064d41a2ce42f381b455cc => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:45.515338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffaec28-4ff0-4abc-8c66-61adfef97533 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:45.543642 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfb40b-8344-436e-aaf1-d8d30430b9cf None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:45.559350 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:45.586674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df71c2-1f3f-48e7-b692-28515cd17a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:45.588027 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df71c2-1f3f-48e7-b692-28515cd17a4e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:45.588654 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df71c2-1f3f-48e7-b692-28515cd17a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:45.588972 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df71c2-1f3f-48e7-b692-28515cd17a4e None admin] PATH_INFO: `/v3/users/4bdbf0de47b342a9beeeccea9b5163da` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:45.590302 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df71c2-1f3f-48e7-b692-28515cd17a4e None admin] RBAC: Authorizing `identity:get_user(user_id=4bdbf0de47b342a9beeeccea9b5163da)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:45.591793 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df71c2-1f3f-48e7-b692-28515cd17a4e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:45.596468 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 159/312] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:45 2022] GET /identity/v3/users/4bdbf0de47b342a9beeeccea9b5163da => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:45.601688 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df71c2-1f3f-48e7-b692-28515cd17a4e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:45.616674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:45.659077 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffaec28-4ff0-4abc-8c66-61adfef97533 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:45.698192 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab98735-d913-4dd3-ab2e-44bdd01bea18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:45.699228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab98735-d913-4dd3-ab2e-44bdd01bea18 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:45.699729 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab98735-d913-4dd3-ab2e-44bdd01bea18 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:45.700212 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab98735-d913-4dd3-ab2e-44bdd01bea18 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:45.701219 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab98735-d913-4dd3-ab2e-44bdd01bea18 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:45.701725 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab98735-d913-4dd3-ab2e-44bdd01bea18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:45.703348 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab98735-d913-4dd3-ab2e-44bdd01bea18 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:45.714917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 154/313] 10.222.0.32 () {56 vars in 1101 bytes} [Thu Jun 2 13:22:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:45.721616 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab98735-d913-4dd3-ab2e-44bdd01bea18 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:45.735414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df71c2-1f3f-48e7-b692-28515cd17a4e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:45.771681 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd135f2a-d198-49be-8b71-57f0f7df8c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:45.772767 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd135f2a-d198-49be-8b71-57f0f7df8c3b None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:45.773049 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd135f2a-d198-49be-8b71-57f0f7df8c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:45.774107 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd135f2a-d198-49be-8b71-57f0f7df8c3b None admin] PATH_INFO: `/v3/system/users/4bdbf0de47b342a9beeeccea9b5163da/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:45.775649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd135f2a-d198-49be-8b71-57f0f7df8c3b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4bdbf0de47b342a9beeeccea9b5163da, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:45.777233 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd135f2a-d198-49be-8b71-57f0f7df8c3b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:45.790176 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 160/314] 10.222.0.32 () {58 vars in 1334 bytes} [Thu Jun 2 13:22:45 2022] PUT /identity/v3/system/users/4bdbf0de47b342a9beeeccea9b5163da/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:45.848075 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:45.861171 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab98735-d913-4dd3-ab2e-44bdd01bea18 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:45.901190 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3e5a3-130e-4729-8403-603fb8a2e237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:45.902092 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3e5a3-130e-4729-8403-603fb8a2e237 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:45.902380 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3e5a3-130e-4729-8403-603fb8a2e237 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:45.902661 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3e5a3-130e-4729-8403-603fb8a2e237 None admin] PATH_INFO: `/v3/users/33073063f9b644e3b3324b90e8b21396` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:45.903995 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c3e5a3-130e-4729-8403-603fb8a2e237 None admin] RBAC: Authorizing `identity:get_user(user_id=33073063f9b644e3b3324b90e8b21396)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:45.905518 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c3e5a3-130e-4729-8403-603fb8a2e237 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:45.907662 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 155/315] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:45 2022] GET /identity/v3/users/33073063f9b644e3b3324b90e8b21396 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:45.913470 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd135f2a-d198-49be-8b71-57f0f7df8c3b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:45.991734 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:46.037819 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd135f2a-d198-49be-8b71-57f0f7df8c3b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:46.077968 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e43ad8-ed72-4ccd-b525-c415fa926000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:46.078618 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e43ad8-ed72-4ccd-b525-c415fa926000 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:46.078908 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e43ad8-ed72-4ccd-b525-c415fa926000 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:46.079188 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e43ad8-ed72-4ccd-b525-c415fa926000 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:46.150559 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e43ad8-ed72-4ccd-b525-c415fa926000 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:46.151955 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e43ad8-ed72-4ccd-b525-c415fa926000 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:46.221358 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:46.255596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 161/316] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:22:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:46.260781 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3e5a3-130e-4729-8403-603fb8a2e237 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:46.363132 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3e5a3-130e-4729-8403-603fb8a2e237 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:46.396754 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89eed37-9017-430e-b296-462111a5570a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:46.397617 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89eed37-9017-430e-b296-462111a5570a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:46.397903 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89eed37-9017-430e-b296-462111a5570a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:46.398179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89eed37-9017-430e-b296-462111a5570a None admin] PATH_INFO: `/v3/projects/b4bc26bb161145d88db0ede674ffce12` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:46.399381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89eed37-9017-430e-b296-462111a5570a None admin] RBAC: Authorizing `identity:get_project(project_id=b4bc26bb161145d88db0ede674ffce12)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:46.401441 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89eed37-9017-430e-b296-462111a5570a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:46.403380 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 156/317] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:46 2022] GET /identity/v3/projects/b4bc26bb161145d88db0ede674ffce12 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:46.409112 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e43ad8-ed72-4ccd-b525-c415fa926000 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:46.520280 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e43ad8-ed72-4ccd-b525-c415fa926000 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:46.556913 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677af02f-5edf-402c-b920-12df1c5e27ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:46.557573 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677af02f-5edf-402c-b920-12df1c5e27ab None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:46.557859 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677af02f-5edf-402c-b920-12df1c5e27ab None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:46.558138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677af02f-5edf-402c-b920-12df1c5e27ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:46.558978 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677af02f-5edf-402c-b920-12df1c5e27ab None admin] RBAC: Adding query filter params (role.id=2ea21d1487064d41a2ce42f381b455cc, scope.project.id=b4bc26bb161145d88db0ede674ffce12, user.id=33073063f9b644e3b3324b90e8b21396) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:46.559297 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677af02f-5edf-402c-b920-12df1c5e27ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:46.560776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677af02f-5edf-402c-b920-12df1c5e27ab None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:46.567267 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 162/318] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:22:46 2022] GET /identity/v3/role_assignments?user.id=33073063f9b644e3b3324b90e8b21396&scope.project.id=b4bc26bb161145d88db0ede674ffce12&role.id=2ea21d1487064d41a2ce42f381b455cc => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:47.130324 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e315d12-e50d-4f43-a32f-278df27437eb None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:47.130835 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e315d12-e50d-4f43-a32f-278df27437eb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:47.130940 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e315d12-e50d-4f43-a32f-278df27437eb None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:47.132213 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 157/319] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:47.138120 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406319d3-0eb3-4897-941b-226ae5a5cb30 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:47.138517 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406319d3-0eb3-4897-941b-226ae5a5cb30 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:47.138674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406319d3-0eb3-4897-941b-226ae5a5cb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:47.155438 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-406319d3-0eb3-4897-941b-226ae5a5cb30 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:47.156667 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-406319d3-0eb3-4897-941b-226ae5a5cb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:47.186991 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:47.228942 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 163/320] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:47.251278 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e315d12-e50d-4f43-a32f-278df27437eb None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:47.279960 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:47.355429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e315d12-e50d-4f43-a32f-278df27437eb None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:47.389311 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369e837-2449-4028-a774-ad936527436b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:47.390109 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369e837-2449-4028-a774-ad936527436b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:47.390394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369e837-2449-4028-a774-ad936527436b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:47.390672 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369e837-2449-4028-a774-ad936527436b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:47.391835 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369e837-2449-4028-a774-ad936527436b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:47.393334 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369e837-2449-4028-a774-ad936527436b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:47.395153 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 158/321] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:22:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:47.400508 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406319d3-0eb3-4897-941b-226ae5a5cb30 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:47.501325 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406319d3-0eb3-4897-941b-226ae5a5cb30 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:47.537215 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f33872-e83e-4ffe-8098-1da4582b7b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:47.537801 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f33872-e83e-4ffe-8098-1da4582b7b22 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:47.538086 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f33872-e83e-4ffe-8098-1da4582b7b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:47.538363 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f33872-e83e-4ffe-8098-1da4582b7b22 None admin] PATH_INFO: `/v3/groups` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:47.539063 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f33872-e83e-4ffe-8098-1da4582b7b22 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:47.540532 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f33872-e83e-4ffe-8098-1da4582b7b22 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:47.564342 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 164/322] 10.222.0.32 () {60 vars in 1134 bytes} [Thu Jun 2 13:22:47 2022] POST /identity/v3/groups => generated 226 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:22:47.836910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6764aad-6e5d-4768-9dea-8adeaee0d1bb None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:47.836910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6764aad-6e5d-4768-9dea-8adeaee0d1bb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:47.836910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6764aad-6e5d-4768-9dea-8adeaee0d1bb None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:47.838186 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 159/323] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:47.842742 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00116d71-5990-4251-a39c-41343f0648b8 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:47.843273 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00116d71-5990-4251-a39c-41343f0648b8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:47.843734 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00116d71-5990-4251-a39c-41343f0648b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:47.863215 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-00116d71-5990-4251-a39c-41343f0648b8 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:47.864424 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-00116d71-5990-4251-a39c-41343f0648b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:47.883641 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:47.943921 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 165/324] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:47.968696 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6764aad-6e5d-4768-9dea-8adeaee0d1bb None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:48.083730 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:48.091960 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6764aad-6e5d-4768-9dea-8adeaee0d1bb None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:48.128007 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46f460-b7fc-43a6-b99d-5300173b6fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:48.128853 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46f460-b7fc-43a6-b99d-5300173b6fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:48.129138 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46f460-b7fc-43a6-b99d-5300173b6fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:48.129417 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46f460-b7fc-43a6-b99d-5300173b6fb6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:48.141232 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46f460-b7fc-43a6-b99d-5300173b6fb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:48.149286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-bc46f460-b7fc-43a6-b99d-5300173b6fb6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:22:48.149286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:48.149286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:48.149286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:48.149286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:48.149286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:48.149286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:48.149286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:48.149286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:48.149286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:48.149286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:48.149286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:48.149286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:48.149286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:48.149286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:48.149286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:48.150215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:48.150215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:48.150215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:48.150215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:48.150215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:48.150215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:48.150215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:48.150215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:48.150215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:48.150215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:48.150215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:48.150215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:48.150215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:48.150215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:48.150215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:48.150215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:48.151001 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:48.151001 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:48.151001 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:48.151001 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:48.151001 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:48.151001 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:48.151001 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:48.151001 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:48.151001 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:48.151001 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:48.151001 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:22:48.151001 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:22:48.151001 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 160/325] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:48.156338 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00116d71-5990-4251-a39c-41343f0648b8 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:48.264681 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332db20e-a779-4246-bfd6-ac578f26d414 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:48.265155 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00116d71-5990-4251-a39c-41343f0648b8 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:48.265564 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332db20e-a779-4246-bfd6-ac578f26d414 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:48.266061 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332db20e-a779-4246-bfd6-ac578f26d414 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:48.267794 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 161/326] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:48.273231 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bd010-c0db-4869-9830-06d39f053821 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:48.273807 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bd010-c0db-4869-9830-06d39f053821 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:48.274287 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bd010-c0db-4869-9830-06d39f053821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:48.292036 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d52bd010-c0db-4869-9830-06d39f053821 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:48.293561 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d52bd010-c0db-4869-9830-06d39f053821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:48.318338 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847afd4-074d-48f9-8d32-93aa7a339370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:48.319013 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847afd4-074d-48f9-8d32-93aa7a339370 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:48.319298 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847afd4-074d-48f9-8d32-93aa7a339370 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:48.319573 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847afd4-074d-48f9-8d32-93aa7a339370 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:48.320352 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847afd4-074d-48f9-8d32-93aa7a339370 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:48.320666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847afd4-074d-48f9-8d32-93aa7a339370 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:48.322106 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847afd4-074d-48f9-8d32-93aa7a339370 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:48.333580 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 166/327] 10.222.0.32 () {56 vars in 1101 bytes} [Thu Jun 2 13:22:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:48.339172 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847afd4-074d-48f9-8d32-93aa7a339370 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:48.367962 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:48.391443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 162/328] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:22:48.417246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bd010-c0db-4869-9830-06d39f053821 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:48.475584 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847afd4-074d-48f9-8d32-93aa7a339370 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:48.524894 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03c9d5-febc-4cea-b2cb-c7c0e510dede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:48.526148 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03c9d5-febc-4cea-b2cb-c7c0e510dede None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:48.526653 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03c9d5-febc-4cea-b2cb-c7c0e510dede None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:48.527124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03c9d5-febc-4cea-b2cb-c7c0e510dede None admin] PATH_INFO: `/v3/users/c957e00c622f45b7bf0ebab46e79c53f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:48.529280 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03c9d5-febc-4cea-b2cb-c7c0e510dede None admin] RBAC: Authorizing `identity:get_user(user_id=c957e00c622f45b7bf0ebab46e79c53f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:48.531436 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03c9d5-febc-4cea-b2cb-c7c0e510dede None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:48.533776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 167/329] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:48 2022] GET /identity/v3/users/c957e00c622f45b7bf0ebab46e79c53f => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:48.539571 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03c9d5-febc-4cea-b2cb-c7c0e510dede None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:48.550761 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:48.579061 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bd010-c0db-4869-9830-06d39f053821 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:48.653987 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2f9d8-7158-4fed-ad81-647a7aae801d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:48.654757 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2f9d8-7158-4fed-ad81-647a7aae801d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:48.655042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2f9d8-7158-4fed-ad81-647a7aae801d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:48.655317 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2f9d8-7158-4fed-ad81-647a7aae801d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:48.683570 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2f9d8-7158-4fed-ad81-647a7aae801d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:48.691290 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f0e2f9d8-7158-4fed-ad81-647a7aae801d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:48.691290 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:48.691290 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:48.691290 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:48.691290 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:48.691290 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:48.691290 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:48.691290 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:48.691290 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:48.691290 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:48.691290 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:48.691290 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:48.691290 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:48.691290 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:48.691290 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:48.691290 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:48.692203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:48.692203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:48.692203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:48.692203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:48.692203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:48.692203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:48.692203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:48.692203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:48.692203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:48.692203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:48.692203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:48.692203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:48.692203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:48.692203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:48.692203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:48.692203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:48.693018 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:48.693018 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:48.693018 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:48.693018 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:48.693018 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:48.693018 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:48.693018 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:48.693018 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:48.693018 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:48.693018 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:48.693018 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:48.693018 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:22:48.694808 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:48.700227 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03c9d5-febc-4cea-b2cb-c7c0e510dede None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:48.700919 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 163/330] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:48.733378 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2f9d8-7158-4fed-ad81-647a7aae801d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:48.744083 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38297b-825a-4eda-8714-2ceb9a0499df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:48.745326 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38297b-825a-4eda-8714-2ceb9a0499df None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:48.745810 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38297b-825a-4eda-8714-2ceb9a0499df None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:48.746304 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38297b-825a-4eda-8714-2ceb9a0499df None admin] PATH_INFO: `/v3/system/users/c957e00c622f45b7bf0ebab46e79c53f/roles/2ea21d1487064d41a2ce42f381b455cc` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:48.748053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38297b-825a-4eda-8714-2ceb9a0499df None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c957e00c622f45b7bf0ebab46e79c53f, role_id=2ea21d1487064d41a2ce42f381b455cc)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:48.750291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38297b-825a-4eda-8714-2ceb9a0499df None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:48.759758 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 168/331] 10.222.0.32 () {58 vars in 1334 bytes} [Thu Jun 2 13:22:48 2022] PUT /identity/v3/system/users/c957e00c622f45b7bf0ebab46e79c53f/roles/2ea21d1487064d41a2ce42f381b455cc => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:48.919359 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2f9d8-7158-4fed-ad81-647a7aae801d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:48.964103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b67a04-5c36-468e-9a10-4d2b96d1ba81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:48.965183 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b67a04-5c36-468e-9a10-4d2b96d1ba81 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:48.965674 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b67a04-5c36-468e-9a10-4d2b96d1ba81 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:48.966154 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b67a04-5c36-468e-9a10-4d2b96d1ba81 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:48.967114 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b67a04-5c36-468e-9a10-4d2b96d1ba81 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:48.967647 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b67a04-5c36-468e-9a10-4d2b96d1ba81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:48.969304 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b67a04-5c36-468e-9a10-4d2b96d1ba81 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:48.979101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 164/332] 10.222.0.32 () {56 vars in 1101 bytes} [Thu Jun 2 13:22:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:48.985509 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38297b-825a-4eda-8714-2ceb9a0499df None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:49.136507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38297b-825a-4eda-8714-2ceb9a0499df None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:49.174273 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e242b-f494-4234-9dd6-b25e67a8b2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:49.175079 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e242b-f494-4234-9dd6-b25e67a8b2de None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:49.175367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e242b-f494-4234-9dd6-b25e67a8b2de None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:49.175643 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e242b-f494-4234-9dd6-b25e67a8b2de None admin] PATH_INFO: `/v3/users/4bdbf0de47b342a9beeeccea9b5163da` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:49.176886 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e242b-f494-4234-9dd6-b25e67a8b2de None admin] RBAC: Authorizing `identity:get_user(user_id=4bdbf0de47b342a9beeeccea9b5163da)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:49.178328 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e242b-f494-4234-9dd6-b25e67a8b2de None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:49.180269 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 169/333] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:48 2022] GET /identity/v3/users/4bdbf0de47b342a9beeeccea9b5163da => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:22:49.186309 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b67a04-5c36-468e-9a10-4d2b96d1ba81 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:49.195877 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:49.315024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b67a04-5c36-468e-9a10-4d2b96d1ba81 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:49.358856 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745f9a7-94a7-4756-88fc-02329d55114a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:49.359521 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745f9a7-94a7-4756-88fc-02329d55114a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:49.359807 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745f9a7-94a7-4756-88fc-02329d55114a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:49.360088 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745f9a7-94a7-4756-88fc-02329d55114a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:49.360957 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745f9a7-94a7-4756-88fc-02329d55114a None admin] RBAC: Adding query filter params (role.id=e4d5af06c5a44d479d25ce8490ce71a0, user.id=4bdbf0de47b342a9beeeccea9b5163da, scope.system=all) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:49.361269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745f9a7-94a7-4756-88fc-02329d55114a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:49.362719 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745f9a7-94a7-4756-88fc-02329d55114a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:49.379721 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 165/334] 10.222.0.32 () {56 vars in 1308 bytes} [Thu Jun 2 13:22:49 2022] GET /identity/v3/role_assignments?user.id=4bdbf0de47b342a9beeeccea9b5163da&scope.system=all&role.id=e4d5af06c5a44d479d25ce8490ce71a0 => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:50.246778 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752120d-cea0-4381-ac42-a4c82139be63 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:50.247827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752120d-cea0-4381-ac42-a4c82139be63 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:50.248332 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752120d-cea0-4381-ac42-a4c82139be63 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:50.250168 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 170/335] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:50.255242 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87f334-30f9-47c0-98e9-58d98d607669 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:50.256087 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87f334-30f9-47c0-98e9-58d98d607669 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:50.256607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87f334-30f9-47c0-98e9-58d98d607669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:50.276068 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3c87f334-30f9-47c0-98e9-58d98d607669 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:50.277594 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3c87f334-30f9-47c0-98e9-58d98d607669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:50.347274 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:50.358348 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 166/336] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:50.398263 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752120d-cea0-4381-ac42-a4c82139be63 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:50.423561 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:50.520972 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752120d-cea0-4381-ac42-a4c82139be63 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:50.562913 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ff21d-bc1d-48a2-bd30-3f65a4efe66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:50.563708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ff21d-bc1d-48a2-bd30-3f65a4efe66f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:50.563991 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ff21d-bc1d-48a2-bd30-3f65a4efe66f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:50.564264 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ff21d-bc1d-48a2-bd30-3f65a4efe66f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:50.579003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ff21d-bc1d-48a2-bd30-3f65a4efe66f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:50.587133 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-246ff21d-bc1d-48a2-bd30-3f65a4efe66f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:50.587133 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:50.587133 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:50.587133 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:50.587133 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:50.587133 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:50.587133 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:50.587133 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:50.587133 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:50.587133 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:50.587133 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:50.587133 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:50.587133 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:50.587133 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:50.587133 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:50.587133 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:50.588090 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:50.588090 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:50.588090 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:50.588090 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:50.588090 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:50.588090 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:50.588090 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:50.588090 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:50.588090 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:50.588090 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:50.588090 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:50.588090 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:50.588090 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:50.588090 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:50.588090 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:50.588090 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:50.588908 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:50.588908 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:50.588908 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:50.588908 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:50.588908 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:50.588908 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:50.588908 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:50.588908 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:50.588908 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:50.588908 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:50.588908 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:50.588908 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:22:50.591325 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 171/337] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:50.596744 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87f334-30f9-47c0-98e9-58d98d607669 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:50.715962 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87f334-30f9-47c0-98e9-58d98d607669 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:50.756070 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22968cb6-fe04-4d95-9d82-b6d18abbe7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:50.756774 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22968cb6-fe04-4d95-9d82-b6d18abbe7ca None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:50.757063 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22968cb6-fe04-4d95-9d82-b6d18abbe7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:50.757338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22968cb6-fe04-4d95-9d82-b6d18abbe7ca None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:50.758088 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22968cb6-fe04-4d95-9d82-b6d18abbe7ca None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:50.758395 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22968cb6-fe04-4d95-9d82-b6d18abbe7ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:50.759809 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22968cb6-fe04-4d95-9d82-b6d18abbe7ca None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:50.768665 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 167/338] 10.222.0.32 () {56 vars in 1101 bytes} [Thu Jun 2 13:22:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:50.777392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ff21d-bc1d-48a2-bd30-3f65a4efe66f None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:50.870372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:50.912678 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ff21d-bc1d-48a2-bd30-3f65a4efe66f None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:50.938544 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58f31b-bde7-4371-a906-6696af3c7b7e None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:50.938835 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58f31b-bde7-4371-a906-6696af3c7b7e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:50.939105 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58f31b-bde7-4371-a906-6696af3c7b7e None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:50.940480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 168/339] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:22:50.945485 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d50f8-2bb3-4741-ac88-64de85909501 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:50.945772 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d50f8-2bb3-4741-ac88-64de85909501 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:50.946049 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d50f8-2bb3-4741-ac88-64de85909501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:50.972329 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b62d50f8-2bb3-4741-ac88-64de85909501 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:50.973557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b62d50f8-2bb3-4741-ac88-64de85909501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:50.982108 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ae061-671a-4b3c-a58e-d1f03a299c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:50.982765 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ae061-671a-4b3c-a58e-d1f03a299c79 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:50.983051 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ae061-671a-4b3c-a58e-d1f03a299c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:50.983332 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ae061-671a-4b3c-a58e-d1f03a299c79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:51.082855 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:51.114286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 169/340] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:22:51.115057 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ae061-671a-4b3c-a58e-d1f03a299c79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:51.116640 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ae061-671a-4b3c-a58e-d1f03a299c79 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:51.141732 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d50f8-2bb3-4741-ac88-64de85909501 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:51.227984 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:51.238886 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 172/341] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:22:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:51.245797 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ae061-671a-4b3c-a58e-d1f03a299c79 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:51.328042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d50f8-2bb3-4741-ac88-64de85909501 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:51.361055 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ae061-671a-4b3c-a58e-d1f03a299c79 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:51.405887 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0efae-7773-471d-b623-3a7b60977b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:51.406971 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0efae-7773-471d-b623-3a7b60977b88 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:51.407399 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0efae-7773-471d-b623-3a7b60977b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:51.407818 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0efae-7773-471d-b623-3a7b60977b88 None admin] PATH_INFO: `/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:51.409521 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0efae-7773-471d-b623-3a7b60977b88 None admin] RBAC: Authorizing `identity:get_project(project_id=f8b3b94854ab4f878d89ba44b09b07ea)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:51.411501 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0efae-7773-471d-b623-3a7b60977b88 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:51.413430 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 173/342] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:51 2022] GET /identity/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:22:51.417123 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ee054-d633-4583-8df8-3339dcde5979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:51.417988 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ee054-d633-4583-8df8-3339dcde5979 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:51.418338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ee054-d633-4583-8df8-3339dcde5979 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:51.418544 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ee054-d633-4583-8df8-3339dcde5979 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:51.419758 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0efae-7773-471d-b623-3a7b60977b88 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:51.453269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ee054-d633-4583-8df8-3339dcde5979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:51.461745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-cd0ee054-d633-4583-8df8-3339dcde5979 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:22:51.461745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:51.461745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:51.461745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:51.461745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:51.461745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:51.461745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:51.461745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:51.461745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:51.461745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:51.461745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:51.461745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:51.461745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:51.461745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:51.461745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:51.461745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:51.463375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:51.463375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:51.463375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:51.463375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:51.463375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:51.463375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:51.463375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:51.463375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:51.463375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:51.463375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:51.463375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:51.463375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:51.463375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:51.463375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:51.463375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:51.463375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:51.464406 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:51.464406 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:51.464406 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:51.464406 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:51.464406 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:51.464406 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:51.464406 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:51.464406 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:51.464406 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:51.464406 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:51.464406 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:22:51.464406 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:22:51.472653 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 170/343] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Jun 2 13:22:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:22:51.473595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ee054-d633-4583-8df8-3339dcde5979 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:51.504807 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:51.564776 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:51.613694 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0efae-7773-471d-b623-3a7b60977b88 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:51.644112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ee054-d633-4583-8df8-3339dcde5979 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:51.705141 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27566a0-61b9-481a-85eb-6fb30c663f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:51.705759 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27566a0-61b9-481a-85eb-6fb30c663f85 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:51.706048 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27566a0-61b9-481a-85eb-6fb30c663f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:51.706370 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27566a0-61b9-481a-85eb-6fb30c663f85 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:51.707084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27566a0-61b9-481a-85eb-6fb30c663f85 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:51.707396 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27566a0-61b9-481a-85eb-6fb30c663f85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:51.708070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8508007-1306-49d1-b67c-9477b8f4bd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:51.708860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27566a0-61b9-481a-85eb-6fb30c663f85 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:51.709548 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8508007-1306-49d1-b67c-9477b8f4bd27 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:51.709989 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8508007-1306-49d1-b67c-9477b8f4bd27 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:51.710410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8508007-1306-49d1-b67c-9477b8f4bd27 None admin] PATH_INFO: `/v3/groups/5caea916cf5e4426a6f13b48a05092d0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:51.724608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 171/344] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:22:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:51.725434 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27566a0-61b9-481a-85eb-6fb30c663f85 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:51.726399 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8508007-1306-49d1-b67c-9477b8f4bd27 None admin] RBAC: Authorizing `identity:get_group(group_id=5caea916cf5e4426a6f13b48a05092d0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:51.728168 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8508007-1306-49d1-b67c-9477b8f4bd27 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:51.730409 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 174/345] 10.222.0.32 () {56 vars in 1180 bytes} [Thu Jun 2 13:22:51 2022] GET /identity/v3/groups/5caea916cf5e4426a6f13b48a05092d0 => generated 226 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:22:51.736546 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8508007-1306-49d1-b67c-9477b8f4bd27 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:51.865466 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27566a0-61b9-481a-85eb-6fb30c663f85 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:51.877746 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:51.929500 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce8644-5be3-4211-8ac4-b888e315100e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:51.930161 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce8644-5be3-4211-8ac4-b888e315100e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:51.930450 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce8644-5be3-4211-8ac4-b888e315100e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:51.930731 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce8644-5be3-4211-8ac4-b888e315100e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:51.952326 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8508007-1306-49d1-b67c-9477b8f4bd27 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:51.971188 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:52.032455 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce8644-5be3-4211-8ac4-b888e315100e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:52.034256 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce8644-5be3-4211-8ac4-b888e315100e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:52.036611 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5579d-4f51-4597-9e19-a387a4f2fc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:52.037285 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5579d-4f51-4597-9e19-a387a4f2fc26 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:52.037577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5579d-4f51-4597-9e19-a387a4f2fc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:52.037861 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5579d-4f51-4597-9e19-a387a4f2fc26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:52.039079 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5579d-4f51-4597-9e19-a387a4f2fc26 None admin] RBAC: Adding query filter params (group.id=5caea916cf5e4426a6f13b48a05092d0, role.id=e4d5af06c5a44d479d25ce8490ce71a0, scope.project.id=f8b3b94854ab4f878d89ba44b09b07ea) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:52.039079 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5579d-4f51-4597-9e19-a387a4f2fc26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:52.040482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5579d-4f51-4597-9e19-a387a4f2fc26 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:52.058753 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 175/346] 10.222.0.32 () {56 vars in 1376 bytes} [Thu Jun 2 13:22:51 2022] GET /identity/v3/role_assignments?group.id=5caea916cf5e4426a6f13b48a05092d0&scope.project.id=f8b3b94854ab4f878d89ba44b09b07ea&role.id=e4d5af06c5a44d479d25ce8490ce71a0 => generated 260 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:52.060054 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ba04b-6100-4703-beea-70d3002accad None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:52.060368 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ba04b-6100-4703-beea-70d3002accad None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:52.060655 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ba04b-6100-4703-beea-70d3002accad None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:52.065974 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 176/347] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:52.086300 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e0035-77ac-4cb3-a4b5-95e76dffd9d6 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:52.086630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e0035-77ac-4cb3-a4b5-95e76dffd9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:52.086871 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e0035-77ac-4cb3-a4b5-95e76dffd9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:52.125390 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-0a8e0035-77ac-4cb3-a4b5-95e76dffd9d6 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:52.126644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0a8e0035-77ac-4cb3-a4b5-95e76dffd9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:52.156021 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 172/348] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:22:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:52.161980 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce8644-5be3-4211-8ac4-b888e315100e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:52.177837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:52.302067 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 177/349] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:22:52.318831 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce8644-5be3-4211-8ac4-b888e315100e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:52.372427 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e451a5d-02d0-44e7-b269-ef8fcfb1bf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:52.372427 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e451a5d-02d0-44e7-b269-ef8fcfb1bf7e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:52.372427 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e451a5d-02d0-44e7-b269-ef8fcfb1bf7e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:52.372427 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e451a5d-02d0-44e7-b269-ef8fcfb1bf7e None admin] PATH_INFO: `/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:52.373268 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e451a5d-02d0-44e7-b269-ef8fcfb1bf7e None admin] RBAC: Authorizing `identity:get_project(project_id=f8b3b94854ab4f878d89ba44b09b07ea)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:52.373268 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e451a5d-02d0-44e7-b269-ef8fcfb1bf7e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:52.374602 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 173/350] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:52 2022] GET /identity/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:22:52.380441 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e0035-77ac-4cb3-a4b5-95e76dffd9d6 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:52.391462 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e451a5d-02d0-44e7-b269-ef8fcfb1bf7e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:52.480266 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:52.506526 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e451a5d-02d0-44e7-b269-ef8fcfb1bf7e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:52.552382 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4f7d5-ad3f-43b4-b4a7-10e6c217e263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:52.553517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4f7d5-ad3f-43b4-b4a7-10e6c217e263 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:52.554007 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4f7d5-ad3f-43b4-b4a7-10e6c217e263 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:52.554478 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4f7d5-ad3f-43b4-b4a7-10e6c217e263 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:52.559172 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e0035-77ac-4cb3-a4b5-95e76dffd9d6 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:52.560816 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:52.567568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4f7d5-ad3f-43b4-b4a7-10e6c217e263 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:52.575724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-17b4f7d5-ad3f-43b4-b4a7-10e6c217e263 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:52.575724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:52.575724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:52.575724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:52.575724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:52.575724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:52.575724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:52.575724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:52.575724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:52.575724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:52.575724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:52.575724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:52.575724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:52.575724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:52.575724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:52.575724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:52.576703 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:52.576703 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:52.576703 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:52.576703 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:52.576703 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:52.576703 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:52.576703 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:52.576703 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:52.576703 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:52.576703 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:52.576703 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:52.576703 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:52.576703 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:52.576703 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:52.576703 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:52.576703 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:52.577568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:52.577568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:52.577568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:52.577568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:52.577568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:52.577568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:52.577568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:52.577568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:52.577568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:52.577568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:52.577568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:52.577568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:22:52.580027 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 174/351] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:52.585910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e572b-d897-483c-84d1-d6b891d6b48b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:52.586445 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e572b-d897-483c-84d1-d6b891d6b48b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:52.586920 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e572b-d897-483c-84d1-d6b891d6b48b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:52.589066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 175/352] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:52.590966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e572b-d897-483c-84d1-d6b891d6b48b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:52.610451 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acafde5-4c3b-4988-ac4a-12135389ab55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:52.611324 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acafde5-4c3b-4988-ac4a-12135389ab55 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:52.611623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acafde5-4c3b-4988-ac4a-12135389ab55 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:52.611899 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acafde5-4c3b-4988-ac4a-12135389ab55 None admin] PATH_INFO: `/v3/groups/5caea916cf5e4426a6f13b48a05092d0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:52.617049 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acafde5-4c3b-4988-ac4a-12135389ab55 None admin] RBAC: Authorizing `identity:get_group(group_id=5caea916cf5e4426a6f13b48a05092d0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:52.618538 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acafde5-4c3b-4988-ac4a-12135389ab55 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:52.624325 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 178/353] 10.222.0.32 () {56 vars in 1180 bytes} [Thu Jun 2 13:22:52 2022] GET /identity/v3/groups/5caea916cf5e4426a6f13b48a05092d0 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:52.624325 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f5bdf-60e3-4f6d-90b2-5edda25dbb09 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:52.624325 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f5bdf-60e3-4f6d-90b2-5edda25dbb09 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:52.624325 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f5bdf-60e3-4f6d-90b2-5edda25dbb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:52.673387 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-438f5bdf-60e3-4f6d-90b2-5edda25dbb09 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:52.674580 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-438f5bdf-60e3-4f6d-90b2-5edda25dbb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:52.717460 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e572b-d897-483c-84d1-d6b891d6b48b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:52.770023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5bfed-e423-4794-b2fc-6997ec64b374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:52.771085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5bfed-e423-4794-b2fc-6997ec64b374 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:52.771562 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5bfed-e423-4794-b2fc-6997ec64b374 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:52.772040 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5bfed-e423-4794-b2fc-6997ec64b374 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:52.773071 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5bfed-e423-4794-b2fc-6997ec64b374 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:52.774014 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5bfed-e423-4794-b2fc-6997ec64b374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:52.776323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5bfed-e423-4794-b2fc-6997ec64b374 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:52.779364 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:52.796021 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 176/354] 10.222.0.32 () {56 vars in 1101 bytes} [Thu Jun 2 13:22:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:22:52.797635 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5bfed-e423-4794-b2fc-6997ec64b374 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:52.861480 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 179/355] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:52.862081 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f5bdf-60e3-4f6d-90b2-5edda25dbb09 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:52.956041 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5bfed-e423-4794-b2fc-6997ec64b374 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:53.022730 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9f655-056d-4fd6-8e48-ee998f1e318c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:53.023371 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9f655-056d-4fd6-8e48-ee998f1e318c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:53.023647 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9f655-056d-4fd6-8e48-ee998f1e318c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:53.023920 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9f655-056d-4fd6-8e48-ee998f1e318c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:53.026466 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9f655-056d-4fd6-8e48-ee998f1e318c None admin] RBAC: Adding query filter params (group.id=5caea916cf5e4426a6f13b48a05092d0, role.id=5fe1cb1c673a407bb1025d500f111390, scope.project.id=f8b3b94854ab4f878d89ba44b09b07ea) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:53.026796 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9f655-056d-4fd6-8e48-ee998f1e318c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:53.028249 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9f655-056d-4fd6-8e48-ee998f1e318c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:53.041108 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 177/356] 10.222.0.32 () {56 vars in 1376 bytes} [Thu Jun 2 13:22:52 2022] GET /identity/v3/role_assignments?group.id=5caea916cf5e4426a6f13b48a05092d0&scope.project.id=f8b3b94854ab4f878d89ba44b09b07ea&role.id=5fe1cb1c673a407bb1025d500f111390 => generated 260 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:53.052099 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9f655-056d-4fd6-8e48-ee998f1e318c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:53.060654 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:53.068593 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f5bdf-60e3-4f6d-90b2-5edda25dbb09 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:53.155333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071041db-59a0-4fd7-933f-3948da70b398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:53.155913 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071041db-59a0-4fd7-933f-3948da70b398 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:53.156203 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071041db-59a0-4fd7-933f-3948da70b398 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:53.156515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071041db-59a0-4fd7-933f-3948da70b398 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:53.173898 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:53.226595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9f655-056d-4fd6-8e48-ee998f1e318c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:53.248904 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071041db-59a0-4fd7-933f-3948da70b398 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:53.250508 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071041db-59a0-4fd7-933f-3948da70b398 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:53.266407 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3bcc4-be4c-4228-ada3-625d6fa53529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:53.267210 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3bcc4-be4c-4228-ada3-625d6fa53529 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:53.267500 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3bcc4-be4c-4228-ada3-625d6fa53529 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:53.267781 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3bcc4-be4c-4228-ada3-625d6fa53529 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:53.280819 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d3bcc4-be4c-4228-ada3-625d6fa53529 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:53.289228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-28d3bcc4-be4c-4228-ada3-625d6fa53529 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:22:53.289228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:53.289228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:53.289228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:53.289228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:53.289228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:53.289228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:53.289228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:53.289228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:53.289228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:53.289228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:53.289228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:53.289228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:53.289228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:53.289228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:53.289228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:53.290206 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:53.290206 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:53.290206 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:53.290206 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:53.290206 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:53.290206 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:53.290206 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:53.290206 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:53.290206 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:53.290206 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:53.290206 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:53.290206 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:53.290206 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:53.290206 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:53.290206 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:53.290206 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:53.291341 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:53.291341 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:53.291341 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:53.291341 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:53.291341 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:53.291341 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:53.291341 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:53.291341 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:53.291341 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:53.291341 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:53.291341 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:22:53.291341 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:22:53.291341 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 178/357] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Jun 2 13:22:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:53.292185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb4c85-2ad3-47ec-99e5-d9b4008b3728 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:53.292521 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb4c85-2ad3-47ec-99e5-d9b4008b3728 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:53.292760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb4c85-2ad3-47ec-99e5-d9b4008b3728 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:53.299210 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 179/358] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:53.300703 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75924e53-3b89-4c35-a9f5-24ea4f30375b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:53.300994 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75924e53-3b89-4c35-a9f5-24ea4f30375b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:53.301275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75924e53-3b89-4c35-a9f5-24ea4f30375b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:53.302952 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 180/359] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:53.303739 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75924e53-3b89-4c35-a9f5-24ea4f30375b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:53.377395 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:53.382971 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 180/360] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:22:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:53.387915 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3fc2d-3b30-4b45-aead-0a9ab1d9a99f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:53.387915 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3fc2d-3b30-4b45-aead-0a9ab1d9a99f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:53.387915 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3fc2d-3b30-4b45-aead-0a9ab1d9a99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:53.403225 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-63d3fc2d-3b30-4b45-aead-0a9ab1d9a99f None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:53.404669 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-63d3fc2d-3b30-4b45-aead-0a9ab1d9a99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:53.450769 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75924e53-3b89-4c35-a9f5-24ea4f30375b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:53.478681 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:53.481516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 181/361] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:53.482980 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b915d7c-9bf5-4697-b1ff-e65ba1fbccc4 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:53.483329 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b915d7c-9bf5-4697-b1ff-e65ba1fbccc4 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:53.483708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b915d7c-9bf5-4697-b1ff-e65ba1fbccc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:53.493332 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182f9b2-0c1d-47d3-81d0-3288d81c4a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:53.494255 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182f9b2-0c1d-47d3-81d0-3288d81c4a25 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:53.494681 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182f9b2-0c1d-47d3-81d0-3288d81c4a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:53.495106 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182f9b2-0c1d-47d3-81d0-3288d81c4a25 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:53.495975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182f9b2-0c1d-47d3-81d0-3288d81c4a25 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:53.496596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182f9b2-0c1d-47d3-81d0-3288d81c4a25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:53.498127 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182f9b2-0c1d-47d3-81d0-3288d81c4a25 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:53.502615 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-5b915d7c-9bf5-4697-b1ff-e65ba1fbccc4 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:53.504193 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5b915d7c-9bf5-4697-b1ff-e65ba1fbccc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:53.508899 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 181/362] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:22:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:53.510490 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182f9b2-0c1d-47d3-81d0-3288d81c4a25 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:53.578558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 182/363] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:53.579610 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b915d7c-9bf5-4697-b1ff-e65ba1fbccc4 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:53.619887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182f9b2-0c1d-47d3-81d0-3288d81c4a25 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:53.660631 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b8aea-61b7-413f-adf8-f1663d0b8ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:53.661906 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b8aea-61b7-413f-adf8-f1663d0b8ffe None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:53.662335 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b8aea-61b7-413f-adf8-f1663d0b8ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:53.662762 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b8aea-61b7-413f-adf8-f1663d0b8ffe None admin] PATH_INFO: `/v3/projects/b4bc26bb161145d88db0ede674ffce12` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:53.664267 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b8aea-61b7-413f-adf8-f1663d0b8ffe None admin] RBAC: Authorizing `identity:get_project(project_id=b4bc26bb161145d88db0ede674ffce12)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:53.666022 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:53.667974 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b8aea-61b7-413f-adf8-f1663d0b8ffe None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:53.670655 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 182/364] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:53 2022] GET /identity/v3/projects/b4bc26bb161145d88db0ede674ffce12 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:53.671771 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b8aea-61b7-413f-adf8-f1663d0b8ffe None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:53.720860 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b915d7c-9bf5-4697-b1ff-e65ba1fbccc4 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:53.739065 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:53.762871 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b29976-297d-4df7-b4ef-56e80be03f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:53.763509 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b29976-297d-4df7-b4ef-56e80be03f51 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:53.763796 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b29976-297d-4df7-b4ef-56e80be03f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:53.764076 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b29976-297d-4df7-b4ef-56e80be03f51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:53.799173 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b8aea-61b7-413f-adf8-f1663d0b8ffe None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:53.840404 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091867c-829b-4a44-8a95-eb0a5e5a788c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:53.841422 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b29976-297d-4df7-b4ef-56e80be03f51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:53.841788 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091867c-829b-4a44-8a95-eb0a5e5a788c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:53.842259 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091867c-829b-4a44-8a95-eb0a5e5a788c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:53.842731 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091867c-829b-4a44-8a95-eb0a5e5a788c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:53.842912 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b29976-297d-4df7-b4ef-56e80be03f51 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:53.857133 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0091867c-829b-4a44-8a95-eb0a5e5a788c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:53.865624 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-0091867c-829b-4a44-8a95-eb0a5e5a788c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:22:53.865624 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:53.865624 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:53.865624 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:53.865624 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:53.865624 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:53.865624 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:53.865624 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:53.865624 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:53.865624 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:53.865624 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:53.865624 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:53.865624 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:53.865624 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:53.865624 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:53.865624 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:53.866516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:53.866516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:53.866516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:53.866516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:53.866516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:53.866516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:53.866516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:53.866516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:53.866516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:53.866516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:53.866516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:53.866516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:53.866516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:53.866516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:53.866516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:53.866516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:53.867323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:53.867323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:53.867323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:53.867323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:53.867323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:53.867323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:53.867323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:53.867323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:53.867323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:53.867323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:53.867323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:22:53.867323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:22:53.870302 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 183/365] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:22:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:53.872216 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091867c-829b-4a44-8a95-eb0a5e5a788c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:53.907087 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:53.951124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 183/366] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:22:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:53.951976 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b29976-297d-4df7-b4ef-56e80be03f51 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:53.993314 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091867c-829b-4a44-8a95-eb0a5e5a788c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:54.022603 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:54.046165 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bbe3a-d20b-4e0e-8d37-6f88de3340c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:54.047765 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bbe3a-d20b-4e0e-8d37-6f88de3340c1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:54.048263 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bbe3a-d20b-4e0e-8d37-6f88de3340c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:54.048801 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bbe3a-d20b-4e0e-8d37-6f88de3340c1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:54.056919 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b29976-297d-4df7-b4ef-56e80be03f51 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:54.061925 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721bbe3a-d20b-4e0e-8d37-6f88de3340c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:54.070284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-721bbe3a-d20b-4e0e-8d37-6f88de3340c1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:22:54.070284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:54.070284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:54.070284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:54.070284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:54.070284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:54.070284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:54.070284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:54.070284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:54.070284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:54.070284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:54.070284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:54.070284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:54.070284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:54.070284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:54.070284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:54.071214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:54.071214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:54.071214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:54.071214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:54.071214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:54.071214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:54.071214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:54.071214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:54.071214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:54.071214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:54.071214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:54.071214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:54.071214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:54.071214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:54.071214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:54.071214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:54.072604 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:54.072604 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:54.072604 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:54.072604 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:54.072604 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:54.072604 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:54.072604 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:54.072604 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:54.072604 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:54.072604 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:54.072604 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:22:54.072604 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:22:54.075491 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 184/367] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:54.076770 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bbe3a-d20b-4e0e-8d37-6f88de3340c1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:54.092742 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326aba5-c090-444b-a35b-d412c0c5deb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:54.093607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326aba5-c090-444b-a35b-d412c0c5deb9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:54.093896 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326aba5-c090-444b-a35b-d412c0c5deb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:54.094166 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326aba5-c090-444b-a35b-d412c0c5deb9 None admin] PATH_INFO: `/v3/groups/5caea916cf5e4426a6f13b48a05092d0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:54.095368 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326aba5-c090-444b-a35b-d412c0c5deb9 None admin] RBAC: Authorizing `identity:get_group(group_id=5caea916cf5e4426a6f13b48a05092d0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:54.097317 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326aba5-c090-444b-a35b-d412c0c5deb9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:54.098473 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 184/368] 10.222.0.32 () {56 vars in 1180 bytes} [Thu Jun 2 13:22:53 2022] GET /identity/v3/groups/5caea916cf5e4426a6f13b48a05092d0 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:54.100484 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326aba5-c090-444b-a35b-d412c0c5deb9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:54.130578 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:54.208582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326aba5-c090-444b-a35b-d412c0c5deb9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:54.210624 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bbe3a-d20b-4e0e-8d37-6f88de3340c1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:54.245940 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5c1b7-905e-4650-b708-25940a46d4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:54.247290 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5c1b7-905e-4650-b708-25940a46d4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:54.247855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5c1b7-905e-4650-b708-25940a46d4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:54.248330 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5c1b7-905e-4650-b708-25940a46d4a7 None admin] PATH_INFO: `/v3/projects/b4bc26bb161145d88db0ede674ffce12` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:54.249808 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5c1b7-905e-4650-b708-25940a46d4a7 None admin] RBAC: Authorizing `identity:get_project(project_id=b4bc26bb161145d88db0ede674ffce12)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:54.251045 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95962198-ddd1-4c73-afa8-0a6bfea057a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:54.251717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95962198-ddd1-4c73-afa8-0a6bfea057a7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:54.251964 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5c1b7-905e-4650-b708-25940a46d4a7 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:54.252066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95962198-ddd1-4c73-afa8-0a6bfea057a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:54.252260 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95962198-ddd1-4c73-afa8-0a6bfea057a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:54.253054 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95962198-ddd1-4c73-afa8-0a6bfea057a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:54.253359 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95962198-ddd1-4c73-afa8-0a6bfea057a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:54.254754 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95962198-ddd1-4c73-afa8-0a6bfea057a7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:54.255232 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 185/369] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:54 2022] GET /identity/v3/projects/b4bc26bb161145d88db0ede674ffce12 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:54.256209 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5c1b7-905e-4650-b708-25940a46d4a7 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:54.264716 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 185/370] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:54.265875 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95962198-ddd1-4c73-afa8-0a6bfea057a7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:54.304384 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:54.357856 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:54.363960 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5c1b7-905e-4650-b708-25940a46d4a7 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:54.386854 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95962198-ddd1-4c73-afa8-0a6bfea057a7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:54.403779 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41439674-ccdd-4198-86c4-3ebd126f7d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:54.404502 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41439674-ccdd-4198-86c4-3ebd126f7d4a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:54.404791 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41439674-ccdd-4198-86c4-3ebd126f7d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:54.405072 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41439674-ccdd-4198-86c4-3ebd126f7d4a None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:54.405834 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41439674-ccdd-4198-86c4-3ebd126f7d4a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:54.406145 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41439674-ccdd-4198-86c4-3ebd126f7d4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:54.407528 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41439674-ccdd-4198-86c4-3ebd126f7d4a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:54.425083 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 186/371] 10.222.0.32 () {56 vars in 1101 bytes} [Thu Jun 2 13:22:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:54.426569 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41439674-ccdd-4198-86c4-3ebd126f7d4a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:54.436737 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a4a57-3bc3-43e5-804b-415326bda4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:54.437400 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a4a57-3bc3-43e5-804b-415326bda4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:54.437688 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a4a57-3bc3-43e5-804b-415326bda4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:54.437970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a4a57-3bc3-43e5-804b-415326bda4e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:54.438810 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a4a57-3bc3-43e5-804b-415326bda4e5 None admin] RBAC: Adding query filter params (group.id=5caea916cf5e4426a6f13b48a05092d0, role.id=e4d5af06c5a44d479d25ce8490ce71a0, scope.project.id=b4bc26bb161145d88db0ede674ffce12) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:54.439184 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a4a57-3bc3-43e5-804b-415326bda4e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:54.441167 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a4a57-3bc3-43e5-804b-415326bda4e5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:54.453216 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 186/372] 10.222.0.32 () {56 vars in 1376 bytes} [Thu Jun 2 13:22:54 2022] GET /identity/v3/role_assignments?group.id=5caea916cf5e4426a6f13b48a05092d0&scope.project.id=b4bc26bb161145d88db0ede674ffce12&role.id=e4d5af06c5a44d479d25ce8490ce71a0 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:54.453216 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a4a57-3bc3-43e5-804b-415326bda4e5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:54.641473 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41439674-ccdd-4198-86c4-3ebd126f7d4a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:54.682798 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb38d60-31ae-4574-b71e-b3298474dae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:54.683677 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb38d60-31ae-4574-b71e-b3298474dae8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:54.683972 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb38d60-31ae-4574-b71e-b3298474dae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:54.684258 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb38d60-31ae-4574-b71e-b3298474dae8 None admin] PATH_INFO: `/v3/groups/5caea916cf5e4426a6f13b48a05092d0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:54.685544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb38d60-31ae-4574-b71e-b3298474dae8 None admin] RBAC: Authorizing `identity:get_group(group_id=5caea916cf5e4426a6f13b48a05092d0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:54.687129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb38d60-31ae-4574-b71e-b3298474dae8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:54.690092 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 187/373] 10.222.0.32 () {56 vars in 1180 bytes} [Thu Jun 2 13:22:54 2022] GET /identity/v3/groups/5caea916cf5e4426a6f13b48a05092d0 => generated 226 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:54.690914 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb38d60-31ae-4574-b71e-b3298474dae8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:54.694128 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:54.703320 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a4a57-3bc3-43e5-804b-415326bda4e5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:54.725673 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:54.808379 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb38d60-31ae-4574-b71e-b3298474dae8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:54.833039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120f402-c144-4dff-9d60-548cc040695f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:54.833711 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120f402-c144-4dff-9d60-548cc040695f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:54.833996 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120f402-c144-4dff-9d60-548cc040695f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:54.834532 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120f402-c144-4dff-9d60-548cc040695f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:54.855943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1acdb-edd6-4428-bb43-ac742dbd080a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:54.857509 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1acdb-edd6-4428-bb43-ac742dbd080a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:54.858007 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1acdb-edd6-4428-bb43-ac742dbd080a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:54.858474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1acdb-edd6-4428-bb43-ac742dbd080a None admin] PATH_INFO: `/v3/users/c957e00c622f45b7bf0ebab46e79c53f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:54.859967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1acdb-edd6-4428-bb43-ac742dbd080a None admin] RBAC: Authorizing `identity:get_user(user_id=c957e00c622f45b7bf0ebab46e79c53f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:54.863409 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1acdb-edd6-4428-bb43-ac742dbd080a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:54.867848 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 188/374] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:22:54 2022] GET /identity/v3/users/c957e00c622f45b7bf0ebab46e79c53f => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:54.869091 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1acdb-edd6-4428-bb43-ac742dbd080a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:54.966642 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120f402-c144-4dff-9d60-548cc040695f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:54.966813 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120f402-c144-4dff-9d60-548cc040695f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:55.064278 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:55.077371 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1acdb-edd6-4428-bb43-ac742dbd080a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:55.097617 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 187/375] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:22:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:22:55.098487 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120f402-c144-4dff-9d60-548cc040695f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:55.100031 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:55.123834 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf60ea-a4c4-47c7-936f-d506d35cacc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:55.124598 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf60ea-a4c4-47c7-936f-d506d35cacc9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:55.124881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf60ea-a4c4-47c7-936f-d506d35cacc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:55.125163 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf60ea-a4c4-47c7-936f-d506d35cacc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:55.126007 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf60ea-a4c4-47c7-936f-d506d35cacc9 None admin] RBAC: Adding query filter params (group.id=5caea916cf5e4426a6f13b48a05092d0, role.id=5fe1cb1c673a407bb1025d500f111390, scope.project.id=b4bc26bb161145d88db0ede674ffce12) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:55.126320 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf60ea-a4c4-47c7-936f-d506d35cacc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:55.128460 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf60ea-a4c4-47c7-936f-d506d35cacc9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:55.135252 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 189/376] 10.222.0.32 () {56 vars in 1376 bytes} [Thu Jun 2 13:22:54 2022] GET /identity/v3/role_assignments?group.id=5caea916cf5e4426a6f13b48a05092d0&scope.project.id=b4bc26bb161145d88db0ede674ffce12&role.id=5fe1cb1c673a407bb1025d500f111390 => generated 260 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:55.137324 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c14db6-ed86-44a8-ba18-b2981addf278 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:55.137616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c14db6-ed86-44a8-ba18-b2981addf278 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:55.137889 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c14db6-ed86-44a8-ba18-b2981addf278 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:55.139179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 190/377] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:55.139919 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c14db6-ed86-44a8-ba18-b2981addf278 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:55.286429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120f402-c144-4dff-9d60-548cc040695f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:55.293651 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c14db6-ed86-44a8-ba18-b2981addf278 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:55.330923 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a749e92-9caf-459f-945d-7c4bc8dcfa89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:55.332432 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a749e92-9caf-459f-945d-7c4bc8dcfa89 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:55.332729 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a749e92-9caf-459f-945d-7c4bc8dcfa89 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:55.333010 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a749e92-9caf-459f-945d-7c4bc8dcfa89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:55.333926 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a749e92-9caf-459f-945d-7c4bc8dcfa89 None admin] RBAC: Adding query filter params (role.id=2ea21d1487064d41a2ce42f381b455cc, user.id=c957e00c622f45b7bf0ebab46e79c53f, scope.system=all) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:55.334560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a749e92-9caf-459f-945d-7c4bc8dcfa89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:55.336785 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a749e92-9caf-459f-945d-7c4bc8dcfa89 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:55.362124 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 188/378] 10.222.0.32 () {56 vars in 1308 bytes} [Thu Jun 2 13:22:55 2022] GET /identity/v3/role_assignments?user.id=c957e00c622f45b7bf0ebab46e79c53f&scope.system=all&role.id=2ea21d1487064d41a2ce42f381b455cc => generated 510 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:55.364444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab32a4a-77c0-49f3-a301-ed1b83ef701c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:55.365659 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab32a4a-77c0-49f3-a301-ed1b83ef701c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:55.366178 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab32a4a-77c0-49f3-a301-ed1b83ef701c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:55.366659 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab32a4a-77c0-49f3-a301-ed1b83ef701c None admin] PATH_INFO: `/v3/projects/0c7119c3fda547cdad0db42ad18b471e` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:55.369262 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3f5c5-f5f7-4b24-ba99-b6aead4e3f21 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:55.370255 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab32a4a-77c0-49f3-a301-ed1b83ef701c None admin] RBAC: Authorizing `identity:get_project(project_id=0c7119c3fda547cdad0db42ad18b471e)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:55.372051 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab32a4a-77c0-49f3-a301-ed1b83ef701c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:55.372672 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3f5c5-f5f7-4b24-ba99-b6aead4e3f21 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:55.373144 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3f5c5-f5f7-4b24-ba99-b6aead4e3f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:55.377217 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 191/379] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:55 2022] GET /identity/v3/projects/0c7119c3fda547cdad0db42ad18b471e => generated 344 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:55.383067 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab32a4a-77c0-49f3-a301-ed1b83ef701c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:55.407608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-57a3f5c5-f5f7-4b24-ba99-b6aead4e3f21 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:55.410183 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-57a3f5c5-f5f7-4b24-ba99-b6aead4e3f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:55.439494 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:55.531008 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:55.568293 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 189/380] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:55.580441 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab32a4a-77c0-49f3-a301-ed1b83ef701c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:55.617153 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3f5c5-f5f7-4b24-ba99-b6aead4e3f21 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:55.636974 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cb7fa-97a3-4123-bb92-1fdac30f6ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:55.638199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cb7fa-97a3-4123-bb92-1fdac30f6ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:55.638852 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cb7fa-97a3-4123-bb92-1fdac30f6ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:55.640387 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cb7fa-97a3-4123-bb92-1fdac30f6ea7 None admin] PATH_INFO: `/v3/groups/851ad5590e384c79a873c08a5d430339` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:55.652878 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26cb7fa-97a3-4123-bb92-1fdac30f6ea7 None admin] RBAC: Authorizing `identity:get_group(group_id=851ad5590e384c79a873c08a5d430339)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:55.654681 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26cb7fa-97a3-4123-bb92-1fdac30f6ea7 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:55.658051 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 192/381] 10.222.0.32 () {56 vars in 1180 bytes} [Thu Jun 2 13:22:55 2022] GET /identity/v3/groups/851ad5590e384c79a873c08a5d430339 => generated 229 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:22:55.665188 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cb7fa-97a3-4123-bb92-1fdac30f6ea7 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:55.807960 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3f5c5-f5f7-4b24-ba99-b6aead4e3f21 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:55.824102 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:55.842324 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cb7fa-97a3-4123-bb92-1fdac30f6ea7 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:55.863020 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c7c55-d930-4aa8-abb0-683f21c665f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:55.863829 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c7c55-d930-4aa8-abb0-683f21c665f9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:55.864111 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c7c55-d930-4aa8-abb0-683f21c665f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:55.864406 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c7c55-d930-4aa8-abb0-683f21c665f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:55.876080 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c7c55-d930-4aa8-abb0-683f21c665f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:55.883811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-496c7c55-d930-4aa8-abb0-683f21c665f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:55.883811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:55.883811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:55.883811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:55.883811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:55.883811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:55.883811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:55.883811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:55.883811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:55.883811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:55.883811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:55.883811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:55.883811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:55.883811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:55.883811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:55.883811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:55.884779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:55.884779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:55.884779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:55.884779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:55.884779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:55.884779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:55.884779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:55.884779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:55.884779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:55.884779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:55.884779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:55.884779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:55.884779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:55.884779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:55.884779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:55.884779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:55.886004 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:55.886004 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:55.886004 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:55.886004 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:55.886004 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:55.886004 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:55.886004 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:55.886004 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:55.886004 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:55.886004 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:55.886004 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:55.886004 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:22:55.886004 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 190/382] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:22:55.891025 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c7c55-d930-4aa8-abb0-683f21c665f9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:55.937597 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44447998-7632-4306-92f8-024ca967b7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:55.938271 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44447998-7632-4306-92f8-024ca967b7dd None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:55.938553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44447998-7632-4306-92f8-024ca967b7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:55.938823 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44447998-7632-4306-92f8-024ca967b7dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:55.939674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44447998-7632-4306-92f8-024ca967b7dd None admin] RBAC: Adding query filter params (group.id=851ad5590e384c79a873c08a5d430339, role.id=128feb04d1e042ac844f9ad70b89bb02, scope.project.id=0c7119c3fda547cdad0db42ad18b471e) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:55.939985 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44447998-7632-4306-92f8-024ca967b7dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:55.942576 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:55.945662 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44447998-7632-4306-92f8-024ca967b7dd None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:55.958616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 193/383] 10.222.0.32 () {56 vars in 1376 bytes} [Thu Jun 2 13:22:55 2022] GET /identity/v3/role_assignments?group.id=851ad5590e384c79a873c08a5d430339&scope.project.id=0c7119c3fda547cdad0db42ad18b471e&role.id=128feb04d1e042ac844f9ad70b89bb02 => generated 260 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:56.007390 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c7c55-d930-4aa8-abb0-683f21c665f9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:56.023068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1fc61-3391-4a9f-95ee-63623b21a577 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:56.023365 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1fc61-3391-4a9f-95ee-63623b21a577 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:56.023653 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1fc61-3391-4a9f-95ee-63623b21a577 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:56.027053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 194/384] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:22:56.033468 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db203b-b26d-4d3b-9117-3987438311b5 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:56.033783 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db203b-b26d-4d3b-9117-3987438311b5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:56.034042 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db203b-b26d-4d3b-9117-3987438311b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:56.047081 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe3973-99b8-470d-a56b-8c3bcefc1d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:56.047765 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe3973-99b8-470d-a56b-8c3bcefc1d67 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:56.048052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe3973-99b8-470d-a56b-8c3bcefc1d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:56.048350 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe3973-99b8-470d-a56b-8c3bcefc1d67 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:56.049117 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe3973-99b8-470d-a56b-8c3bcefc1d67 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:56.049427 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe3973-99b8-470d-a56b-8c3bcefc1d67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:56.050828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe3973-99b8-470d-a56b-8c3bcefc1d67 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:56.061673 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 191/385] 10.222.0.32 () {56 vars in 1101 bytes} [Thu Jun 2 13:22:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:22:56.067513 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe3973-99b8-470d-a56b-8c3bcefc1d67 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:56.073645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-76db203b-b26d-4d3b-9117-3987438311b5 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:56.074973 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-76db203b-b26d-4d3b-9117-3987438311b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:56.191449 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe3973-99b8-470d-a56b-8c3bcefc1d67 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:56.204114 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:56.234445 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c045dd8-860e-43eb-b1dc-ecf026f97455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:56.235343 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c045dd8-860e-43eb-b1dc-ecf026f97455 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:56.235632 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c045dd8-860e-43eb-b1dc-ecf026f97455 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:56.235917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c045dd8-860e-43eb-b1dc-ecf026f97455 None admin] PATH_INFO: `/v3/groups/5caea916cf5e4426a6f13b48a05092d0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:56.238058 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c045dd8-860e-43eb-b1dc-ecf026f97455 None admin] RBAC: Authorizing `identity:get_group(group_id=5caea916cf5e4426a6f13b48a05092d0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:56.239548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c045dd8-860e-43eb-b1dc-ecf026f97455 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:56.242015 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 192/386] 10.222.0.32 () {56 vars in 1180 bytes} [Thu Jun 2 13:22:56 2022] GET /identity/v3/groups/5caea916cf5e4426a6f13b48a05092d0 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:22:56.249225 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c045dd8-860e-43eb-b1dc-ecf026f97455 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:56.262700 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 195/387] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:56.297075 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db203b-b26d-4d3b-9117-3987438311b5 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:56.370887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c045dd8-860e-43eb-b1dc-ecf026f97455 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:56.415247 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0515e-2900-42f9-95eb-dd99c5f8ddea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:56.416500 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0515e-2900-42f9-95eb-dd99c5f8ddea None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:56.416865 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0515e-2900-42f9-95eb-dd99c5f8ddea None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:56.417684 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0515e-2900-42f9-95eb-dd99c5f8ddea None admin] PATH_INFO: `/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:56.419269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0515e-2900-42f9-95eb-dd99c5f8ddea None admin] RBAC: Authorizing `identity:get_project(project_id=f8b3b94854ab4f878d89ba44b09b07ea)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:56.420104 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:56.422245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0515e-2900-42f9-95eb-dd99c5f8ddea None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:56.424869 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 193/388] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:56 2022] GET /identity/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:22:56.430611 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0515e-2900-42f9-95eb-dd99c5f8ddea None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:56.445744 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db203b-b26d-4d3b-9117-3987438311b5 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:56.507630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc7d56-3809-4ab1-bfe8-927635597540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:56.508472 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc7d56-3809-4ab1-bfe8-927635597540 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:56.508833 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc7d56-3809-4ab1-bfe8-927635597540 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:56.509115 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc7d56-3809-4ab1-bfe8-927635597540 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:56.524660 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:56.529166 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc7d56-3809-4ab1-bfe8-927635597540 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:56.543500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-03fc7d56-3809-4ab1-bfe8-927635597540 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:22:56.543500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:56.543500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:56.543500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:56.543500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:56.543500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:56.543500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:56.543500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:56.543500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:56.543500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:56.543500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:56.543500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:56.543500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:56.543500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:56.543500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:56.543500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:56.544519 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:56.544519 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:56.544519 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:56.544519 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:56.544519 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:56.544519 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:56.544519 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:56.544519 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:56.544519 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:56.544519 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:56.544519 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:56.544519 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:56.544519 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:56.544519 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:56.544519 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:56.544519 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:56.545310 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:56.545310 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:56.545310 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:56.545310 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:56.545310 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:56.545310 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:56.545310 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:56.545310 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:56.545310 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:56.545310 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:56.545310 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:22:56.545310 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:22:56.545907 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 196/389] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Jun 2 13:22:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:22:56.552459 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc7d56-3809-4ab1-bfe8-927635597540 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:56.618851 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0515e-2900-42f9-95eb-dd99c5f8ddea None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:56.680973 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ab5d0-a1a2-4572-bd94-35c569a75705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:56.681821 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ab5d0-a1a2-4572-bd94-35c569a75705 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:56.682106 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ab5d0-a1a2-4572-bd94-35c569a75705 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:56.682379 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ab5d0-a1a2-4572-bd94-35c569a75705 None admin] PATH_INFO: `/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea/groups/5caea916cf5e4426a6f13b48a05092d0/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:56.685882 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ab5d0-a1a2-4572-bd94-35c569a75705 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8b3b94854ab4f878d89ba44b09b07ea, group_id=5caea916cf5e4426a6f13b48a05092d0, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:56.687363 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ab5d0-a1a2-4572-bd94-35c569a75705 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:56.710893 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 194/390] 10.222.0.32 () {58 vars in 1442 bytes} [Thu Jun 2 13:22:56 2022] PUT /identity/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea/groups/5caea916cf5e4426a6f13b48a05092d0/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:56.742428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc7d56-3809-4ab1-bfe8-927635597540 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:56.800040 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f66e4-aee2-47f8-926d-25003efad827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:56.801123 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f66e4-aee2-47f8-926d-25003efad827 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:56.801626 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f66e4-aee2-47f8-926d-25003efad827 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:56.802105 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f66e4-aee2-47f8-926d-25003efad827 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:56.803100 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f66e4-aee2-47f8-926d-25003efad827 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:56.803627 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f66e4-aee2-47f8-926d-25003efad827 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:56.805467 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f66e4-aee2-47f8-926d-25003efad827 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:56.815998 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 197/391] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:22:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:56.823135 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ab5d0-a1a2-4572-bd94-35c569a75705 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:56.984825 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ab5d0-a1a2-4572-bd94-35c569a75705 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:56.987409 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:57.028254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cb3e8-d103-4fc0-a3b1-3424cdbb7efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:57.029239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cb3e8-d103-4fc0-a3b1-3424cdbb7efb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:57.029529 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cb3e8-d103-4fc0-a3b1-3424cdbb7efb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:57.029809 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cb3e8-d103-4fc0-a3b1-3424cdbb7efb None admin] PATH_INFO: `/v3/groups/5caea916cf5e4426a6f13b48a05092d0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:57.031048 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8cb3e8-d103-4fc0-a3b1-3424cdbb7efb None admin] RBAC: Authorizing `identity:get_group(group_id=5caea916cf5e4426a6f13b48a05092d0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:57.032574 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8cb3e8-d103-4fc0-a3b1-3424cdbb7efb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:57.034661 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 195/392] 10.222.0.32 () {56 vars in 1180 bytes} [Thu Jun 2 13:22:56 2022] GET /identity/v3/groups/5caea916cf5e4426a6f13b48a05092d0 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:57.040163 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f66e4-aee2-47f8-926d-25003efad827 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:57.050870 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:57.151103 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f66e4-aee2-47f8-926d-25003efad827 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:57.189149 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b5e9f-50bf-4343-986a-2f2c33ab5735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:57.190013 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b5e9f-50bf-4343-986a-2f2c33ab5735 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:57.190297 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b5e9f-50bf-4343-986a-2f2c33ab5735 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:57.190575 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b5e9f-50bf-4343-986a-2f2c33ab5735 None admin] PATH_INFO: `/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:57.191769 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b5e9f-50bf-4343-986a-2f2c33ab5735 None admin] RBAC: Authorizing `identity:get_project(project_id=f8b3b94854ab4f878d89ba44b09b07ea)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:57.193357 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b5e9f-50bf-4343-986a-2f2c33ab5735 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:57.195372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 198/393] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:57 2022] GET /identity/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:22:57.201278 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cb3e8-d103-4fc0-a3b1-3424cdbb7efb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:57.321043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cb3e8-d103-4fc0-a3b1-3424cdbb7efb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:57.365578 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90965c5-274b-4d6e-87a0-fe21041b2307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:57.366519 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90965c5-274b-4d6e-87a0-fe21041b2307 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:57.366808 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90965c5-274b-4d6e-87a0-fe21041b2307 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:57.367088 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90965c5-274b-4d6e-87a0-fe21041b2307 None admin] PATH_INFO: `/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea/groups/5caea916cf5e4426a6f13b48a05092d0/roles/5fe1cb1c673a407bb1025d500f111390` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:57.369905 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90965c5-274b-4d6e-87a0-fe21041b2307 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8b3b94854ab4f878d89ba44b09b07ea, group_id=5caea916cf5e4426a6f13b48a05092d0, role_id=5fe1cb1c673a407bb1025d500f111390)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:57.371362 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90965c5-274b-4d6e-87a0-fe21041b2307 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:57.386248 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 196/394] 10.222.0.32 () {58 vars in 1442 bytes} [Thu Jun 2 13:22:57 2022] PUT /identity/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea/groups/5caea916cf5e4426a6f13b48a05092d0/roles/5fe1cb1c673a407bb1025d500f111390 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:22:57.642184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d0354-a83a-4277-9a46-b771ce65fc13 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:57.642682 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d0354-a83a-4277-9a46-b771ce65fc13 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:57.642682 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d0354-a83a-4277-9a46-b771ce65fc13 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:57.644199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 199/395] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:57.649790 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742bafb-be93-4f3c-ab21-faf1ccb5f20f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:57.650305 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742bafb-be93-4f3c-ab21-faf1ccb5f20f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:57.650380 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742bafb-be93-4f3c-ab21-faf1ccb5f20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:57.672578 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2742bafb-be93-4f3c-ab21-faf1ccb5f20f None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:57.673786 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2742bafb-be93-4f3c-ab21-faf1ccb5f20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:57.713754 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:57.766257 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 197/396] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:57.789537 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d0354-a83a-4277-9a46-b771ce65fc13 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:57.892864 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:57.924944 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d0354-a83a-4277-9a46-b771ce65fc13 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:57.977002 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca343c-a684-4c6b-b14d-d9a3b2759333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:57.977806 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca343c-a684-4c6b-b14d-d9a3b2759333 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:57.978597 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca343c-a684-4c6b-b14d-d9a3b2759333 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:57.978887 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca343c-a684-4c6b-b14d-d9a3b2759333 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:57.995753 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca343c-a684-4c6b-b14d-d9a3b2759333 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:58.003482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-6bca343c-a684-4c6b-b14d-d9a3b2759333 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:58.003482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:58.003482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:58.003482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:58.003482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:58.003482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:58.003482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:58.003482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:58.003482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:58.003482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:58.003482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:58.003482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:58.003482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:58.003482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:58.003482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:58.003482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:58.004396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:58.004396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:58.004396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:58.004396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:58.004396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:58.004396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:58.004396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:58.004396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:58.004396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:58.004396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:58.004396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:58.004396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:58.004396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:58.004396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:58.004396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:58.004396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:58.005312 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:58.005312 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:58.005312 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:58.005312 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:58.005312 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:58.005312 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:58.005312 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:58.005312 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:58.005312 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:58.005312 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:58.005312 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:22:58.005312 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:22:58.005312 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 200/397] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:58.013430 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742bafb-be93-4f3c-ab21-faf1ccb5f20f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:58.148646 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742bafb-be93-4f3c-ab21-faf1ccb5f20f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:58.197864 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad58ee3-b4d1-498c-ab0d-7388c591b9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:58.198952 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad58ee3-b4d1-498c-ab0d-7388c591b9b6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:58.199448 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad58ee3-b4d1-498c-ab0d-7388c591b9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:58.199964 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad58ee3-b4d1-498c-ab0d-7388c591b9b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:58.200952 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad58ee3-b4d1-498c-ab0d-7388c591b9b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:58.201466 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad58ee3-b4d1-498c-ab0d-7388c591b9b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:58.203038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad58ee3-b4d1-498c-ab0d-7388c591b9b6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:58.220861 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 198/398] 10.222.0.32 () {56 vars in 1101 bytes} [Thu Jun 2 13:22:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:58.226043 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca343c-a684-4c6b-b14d-d9a3b2759333 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:58.379278 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca343c-a684-4c6b-b14d-d9a3b2759333 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:58.410314 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fa357-b495-4af9-a788-82c426f9b46c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:58.410916 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fa357-b495-4af9-a788-82c426f9b46c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:58.411400 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fa357-b495-4af9-a788-82c426f9b46c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:58.418382 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 199/399] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:22:58.420163 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1669b-3ed2-4121-bf22-5ba87b73891a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:58.420680 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1669b-3ed2-4121-bf22-5ba87b73891a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:58.421154 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1669b-3ed2-4121-bf22-5ba87b73891a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:58.427428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b71c8-83f1-41af-8e07-8fea8d3f7f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:58.428284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b71c8-83f1-41af-8e07-8fea8d3f7f16 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:58.428595 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b71c8-83f1-41af-8e07-8fea8d3f7f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:58.428874 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b71c8-83f1-41af-8e07-8fea8d3f7f16 None admin] PATH_INFO: `/v3/groups/5caea916cf5e4426a6f13b48a05092d0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:58.430085 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b71c8-83f1-41af-8e07-8fea8d3f7f16 None admin] RBAC: Authorizing `identity:get_group(group_id=5caea916cf5e4426a6f13b48a05092d0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:58.431577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b71c8-83f1-41af-8e07-8fea8d3f7f16 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:58.433552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 201/400] 10.222.0.32 () {56 vars in 1180 bytes} [Thu Jun 2 13:22:58 2022] GET /identity/v3/groups/5caea916cf5e4426a6f13b48a05092d0 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:58.438876 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b71c8-83f1-41af-8e07-8fea8d3f7f16 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:58.440687 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-19e1669b-3ed2-4121-bf22-5ba87b73891a None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:58.442149 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-19e1669b-3ed2-4121-bf22-5ba87b73891a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:58.443738 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:58.466598 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:58.561084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 200/401] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:22:58.582140 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1669b-3ed2-4121-bf22-5ba87b73891a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:58.596109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b71c8-83f1-41af-8e07-8fea8d3f7f16 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:58.660689 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe770330-a73d-4969-af3f-2fd53ce1ec94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:58.662447 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe770330-a73d-4969-af3f-2fd53ce1ec94 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:58.664078 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe770330-a73d-4969-af3f-2fd53ce1ec94 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:58.664904 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe770330-a73d-4969-af3f-2fd53ce1ec94 None admin] PATH_INFO: `/v3/projects/b4bc26bb161145d88db0ede674ffce12` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:58.669716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe770330-a73d-4969-af3f-2fd53ce1ec94 None admin] RBAC: Authorizing `identity:get_project(project_id=b4bc26bb161145d88db0ede674ffce12)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:58.671381 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe770330-a73d-4969-af3f-2fd53ce1ec94 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:58.675576 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 202/402] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:58 2022] GET /identity/v3/projects/b4bc26bb161145d88db0ede674ffce12 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:22:58.679748 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe770330-a73d-4969-af3f-2fd53ce1ec94 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:58.764888 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1669b-3ed2-4121-bf22-5ba87b73891a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:58.815613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:58.845189 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe770330-a73d-4969-af3f-2fd53ce1ec94 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:58.849735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe45796-b9b3-4126-bb98-8b82cbd4e248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:58.850573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe45796-b9b3-4126-bb98-8b82cbd4e248 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:58.850861 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe45796-b9b3-4126-bb98-8b82cbd4e248 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:58.851139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe45796-b9b3-4126-bb98-8b82cbd4e248 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:58.886859 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0be40-0306-48cb-be75-3209bc7688d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:58.888102 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0be40-0306-48cb-be75-3209bc7688d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:58.888637 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0be40-0306-48cb-be75-3209bc7688d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:58.889132 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0be40-0306-48cb-be75-3209bc7688d0 None admin] PATH_INFO: `/v3/projects/b4bc26bb161145d88db0ede674ffce12/groups/5caea916cf5e4426a6f13b48a05092d0/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:58.889234 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe45796-b9b3-4126-bb98-8b82cbd4e248 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:58.891448 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0be40-0306-48cb-be75-3209bc7688d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4bc26bb161145d88db0ede674ffce12, group_id=5caea916cf5e4426a6f13b48a05092d0, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:58.893139 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0be40-0306-48cb-be75-3209bc7688d0 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:58.901412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-7fe45796-b9b3-4126-bb98-8b82cbd4e248 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:22:58.901412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:58.901412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:58.901412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:58.901412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:58.901412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:58.901412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:58.901412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:58.901412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:58.901412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:58.901412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:58.901412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:58.901412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:58.901412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:58.901412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:58.901412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:58.902314 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:58.902314 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:58.902314 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:58.902314 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:58.902314 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:58.902314 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:58.902314 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:58.902314 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:58.902314 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:58.902314 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:58.902314 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:58.902314 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:58.902314 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:58.902314 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:58.902314 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:58.902314 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:58.903168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:58.903168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:58.903168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:58.903168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:58.903168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:58.903168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:58.903168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:58.903168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:58.903168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:58.903168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:58.903168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:22:58.903168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:22:58.908862 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 201/403] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Jun 2 13:22:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:22:58.918419 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 203/404] 10.222.0.32 () {58 vars in 1442 bytes} [Thu Jun 2 13:22:58 2022] PUT /identity/v3/projects/b4bc26bb161145d88db0ede674ffce12/groups/5caea916cf5e4426a6f13b48a05092d0/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:22:58.921358 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe45796-b9b3-4126-bb98-8b82cbd4e248 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:58.944499 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:59.066572 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe45796-b9b3-4126-bb98-8b82cbd4e248 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:59.105662 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea635c1-e08b-427d-988d-eaec14b53ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:59.106712 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea635c1-e08b-427d-988d-eaec14b53ffd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:59.107192 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea635c1-e08b-427d-988d-eaec14b53ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:59.107681 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea635c1-e08b-427d-988d-eaec14b53ffd None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:59.108729 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea635c1-e08b-427d-988d-eaec14b53ffd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:59.109229 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea635c1-e08b-427d-988d-eaec14b53ffd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:59.110820 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea635c1-e08b-427d-988d-eaec14b53ffd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:59.123331 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 202/405] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:22:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:59.127348 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0be40-0306-48cb-be75-3209bc7688d0 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:59.235101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0be40-0306-48cb-be75-3209bc7688d0 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:59.236957 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a7c0c-8b68-4bc9-bf33-889229208728 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:59.237257 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a7c0c-8b68-4bc9-bf33-889229208728 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:59.237542 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a7c0c-8b68-4bc9-bf33-889229208728 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:59.239068 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 203/406] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:59.244435 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe75102-3ee3-401e-a1dd-73318e5d851b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:59.244734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe75102-3ee3-401e-a1dd-73318e5d851b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:59.245017 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe75102-3ee3-401e-a1dd-73318e5d851b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:59.277882 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3fe75102-3ee3-401e-a1dd-73318e5d851b None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:59.279106 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3fe75102-3ee3-401e-a1dd-73318e5d851b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:22:59.295919 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:59.305814 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679c012-54c2-4407-b98b-99d20c322c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:59.306738 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679c012-54c2-4407-b98b-99d20c322c38 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:59.307032 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679c012-54c2-4407-b98b-99d20c322c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:59.307320 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679c012-54c2-4407-b98b-99d20c322c38 None admin] PATH_INFO: `/v3/groups/5caea916cf5e4426a6f13b48a05092d0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:59.308677 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679c012-54c2-4407-b98b-99d20c322c38 None admin] RBAC: Authorizing `identity:get_group(group_id=5caea916cf5e4426a6f13b48a05092d0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:59.310989 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679c012-54c2-4407-b98b-99d20c322c38 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:59.311831 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 204/407] 10.222.0.32 () {56 vars in 1180 bytes} [Thu Jun 2 13:22:59 2022] GET /identity/v3/groups/5caea916cf5e4426a6f13b48a05092d0 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:59.318334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679c012-54c2-4407-b98b-99d20c322c38 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:59.385829 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 204/408] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:22:59.409847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe75102-3ee3-401e-a1dd-73318e5d851b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:59.428330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:59.506578 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679c012-54c2-4407-b98b-99d20c322c38 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:59.555138 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe75102-3ee3-401e-a1dd-73318e5d851b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:59.565907 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88111ba8-af6e-4b85-97b4-e0ed91284bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:59.566804 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88111ba8-af6e-4b85-97b4-e0ed91284bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:59.567088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88111ba8-af6e-4b85-97b4-e0ed91284bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:59.567370 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88111ba8-af6e-4b85-97b4-e0ed91284bc3 None admin] PATH_INFO: `/v3/projects/b4bc26bb161145d88db0ede674ffce12` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:59.568769 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88111ba8-af6e-4b85-97b4-e0ed91284bc3 None admin] RBAC: Authorizing `identity:get_project(project_id=b4bc26bb161145d88db0ede674ffce12)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:59.570265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88111ba8-af6e-4b85-97b4-e0ed91284bc3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:59.572636 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 205/409] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:22:59 2022] GET /identity/v3/projects/b4bc26bb161145d88db0ede674ffce12 => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:22:59.578499 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88111ba8-af6e-4b85-97b4-e0ed91284bc3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:59.625883 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41440b4-f575-4a64-b44c-7104a2cf7217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:59.626740 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41440b4-f575-4a64-b44c-7104a2cf7217 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:59.627028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41440b4-f575-4a64-b44c-7104a2cf7217 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:59.627354 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41440b4-f575-4a64-b44c-7104a2cf7217 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:59.647634 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41440b4-f575-4a64-b44c-7104a2cf7217 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:22:59.660013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e41440b4-f575-4a64-b44c-7104a2cf7217 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:22:59.660013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:22:59.660013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:22:59.660013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:22:59.660013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:22:59.660013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:22:59.660013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:22:59.660013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:22:59.660013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:22:59.660013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:22:59.660013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:22:59.660013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:22:59.660013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:22:59.660013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:22:59.660013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:22:59.660013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:22:59.661000 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:22:59.661000 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:22:59.661000 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:22:59.661000 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:22:59.661000 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:22:59.661000 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:22:59.661000 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:22:59.661000 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:22:59.661000 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:22:59.661000 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:22:59.661000 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:22:59.661000 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:22:59.661000 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:22:59.661000 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:22:59.661000 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:22:59.661000 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:22:59.661779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:22:59.661779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:22:59.661779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:22:59.661779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:22:59.661779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:22:59.661779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:22:59.661779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:22:59.661779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:22:59.661779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:22:59.661779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:22:59.661779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:22:59.661779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:22:59.663869 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 205/410] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:22:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:22:59.671823 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41440b4-f575-4a64-b44c-7104a2cf7217 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:59.704350 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:59.766517 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88111ba8-af6e-4b85-97b4-e0ed91284bc3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:59.792947 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:22:59.817248 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bc374-bdb1-446a-a48b-7a0bd3e99a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:59.818142 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bc374-bdb1-446a-a48b-7a0bd3e99a1f None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:59.818425 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bc374-bdb1-446a-a48b-7a0bd3e99a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:59.818701 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bc374-bdb1-446a-a48b-7a0bd3e99a1f None admin] PATH_INFO: `/v3/projects/b4bc26bb161145d88db0ede674ffce12/groups/5caea916cf5e4426a6f13b48a05092d0/roles/5fe1cb1c673a407bb1025d500f111390` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:59.823097 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9bc374-bdb1-446a-a48b-7a0bd3e99a1f None admin] RBAC: Authorizing `identity:create_grant(project_id=b4bc26bb161145d88db0ede674ffce12, group_id=5caea916cf5e4426a6f13b48a05092d0, role_id=5fe1cb1c673a407bb1025d500f111390)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:59.824582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9bc374-bdb1-446a-a48b-7a0bd3e99a1f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:59.850910 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 206/411] 10.222.0.32 () {58 vars in 1442 bytes} [Thu Jun 2 13:22:59 2022] PUT /identity/v3/projects/b4bc26bb161145d88db0ede674ffce12/groups/5caea916cf5e4426a6f13b48a05092d0/roles/5fe1cb1c673a407bb1025d500f111390 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:22:59.856960 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41440b4-f575-4a64-b44c-7104a2cf7217 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:22:59.894447 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495cb75c-c2f7-437a-9452-5c5e8cf28bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:22:59.895181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495cb75c-c2f7-437a-9452-5c5e8cf28bfc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:59.895472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495cb75c-c2f7-437a-9452-5c5e8cf28bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:59.895753 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495cb75c-c2f7-437a-9452-5c5e8cf28bfc None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:59.896590 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495cb75c-c2f7-437a-9452-5c5e8cf28bfc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:22:59.896908 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495cb75c-c2f7-437a-9452-5c5e8cf28bfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:22:59.898349 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495cb75c-c2f7-437a-9452-5c5e8cf28bfc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:22:59.914904 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 206/412] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:22:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:22:59.920490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc8369-dedc-4dfe-8215-3664c1de6176 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:59.920833 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc8369-dedc-4dfe-8215-3664c1de6176 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:59.921073 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc8369-dedc-4dfe-8215-3664c1de6176 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:59.922541 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 207/413] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:22:59.925028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495cb75c-c2f7-437a-9452-5c5e8cf28bfc None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:22:59.928380 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21b73c-1ba4-4265-a5dc-1641602ee286 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:22:59.928742 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21b73c-1ba4-4265-a5dc-1641602ee286 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:22:59.929029 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21b73c-1ba4-4265-a5dc-1641602ee286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:22:59.960214 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6d21b73c-1ba4-4265-a5dc-1641602ee286 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:22:59.962366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6d21b73c-1ba4-4265-a5dc-1641602ee286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:00.110938 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 208/414] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:22:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:23:00.135699 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21b73c-1ba4-4265-a5dc-1641602ee286 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:00.145051 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495cb75c-c2f7-437a-9452-5c5e8cf28bfc None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:00.173973 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:00.187165 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db12a90-9f50-4195-b4ef-ac5c35bac231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:00.188036 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db12a90-9f50-4195-b4ef-ac5c35bac231 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:00.188338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db12a90-9f50-4195-b4ef-ac5c35bac231 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:00.188620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db12a90-9f50-4195-b4ef-ac5c35bac231 None admin] PATH_INFO: `/v3/groups/851ad5590e384c79a873c08a5d430339` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:00.189809 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db12a90-9f50-4195-b4ef-ac5c35bac231 None admin] RBAC: Authorizing `identity:get_group(group_id=851ad5590e384c79a873c08a5d430339)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:00.191283 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db12a90-9f50-4195-b4ef-ac5c35bac231 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:00.192932 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 207/415] 10.222.0.32 () {56 vars in 1180 bytes} [Thu Jun 2 13:22:59 2022] GET /identity/v3/groups/851ad5590e384c79a873c08a5d430339 => generated 229 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:00.198951 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db12a90-9f50-4195-b4ef-ac5c35bac231 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:00.210439 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:00.263076 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21b73c-1ba4-4265-a5dc-1641602ee286 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:00.299202 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b8d4e-5947-45a4-b0b8-67565e8db957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:00.300388 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b8d4e-5947-45a4-b0b8-67565e8db957 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:00.300906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b8d4e-5947-45a4-b0b8-67565e8db957 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:00.301402 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b8d4e-5947-45a4-b0b8-67565e8db957 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:00.313117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b8d4e-5947-45a4-b0b8-67565e8db957 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:00.321253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-c86b8d4e-5947-45a4-b0b8-67565e8db957 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:23:00.321253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:00.321253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:00.321253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:00.321253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:00.321253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:00.321253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:00.321253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:00.321253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:00.321253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:00.321253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:00.321253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:00.321253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:00.321253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:00.321253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:00.321253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:00.322185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:00.322185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:00.322185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:00.322185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:00.322185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:00.322185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:00.322185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:00.322185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:00.322185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:00.322185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:00.322185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:00.322185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:00.322185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:00.322185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:00.322185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:00.322185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:00.322983 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:00.322983 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:00.322983 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:00.322983 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:00.322983 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:00.322983 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:00.322983 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:00.322983 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:00.322983 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:00.322983 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:00.322983 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:23:00.322983 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:00.325689 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 209/416] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:23:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:23:00.326211 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db12a90-9f50-4195-b4ef-ac5c35bac231 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:00.331957 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315f7b6-1dcb-4c07-bd50-8a97c129826b None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:00.332495 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315f7b6-1dcb-4c07-bd50-8a97c129826b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:00.332977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315f7b6-1dcb-4c07-bd50-8a97c129826b None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:00.335024 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 210/417] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:00.335928 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315f7b6-1dcb-4c07-bd50-8a97c129826b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:00.366834 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8836a8-053a-499a-85c6-3ae4298d8c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:00.367583 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8836a8-053a-499a-85c6-3ae4298d8c06 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:00.367868 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8836a8-053a-499a-85c6-3ae4298d8c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:00.368142 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8836a8-053a-499a-85c6-3ae4298d8c06 None admin] PATH_INFO: `/v3/projects/0c7119c3fda547cdad0db42ad18b471e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:00.369939 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8836a8-053a-499a-85c6-3ae4298d8c06 None admin] RBAC: Authorizing `identity:get_project(project_id=0c7119c3fda547cdad0db42ad18b471e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:00.371622 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8836a8-053a-499a-85c6-3ae4298d8c06 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:00.377796 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 208/418] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:23:00 2022] GET /identity/v3/projects/0c7119c3fda547cdad0db42ad18b471e => generated 344 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:00.377796 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f4f38-81c5-4543-a6b9-464608e8da35 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:00.377796 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f4f38-81c5-4543-a6b9-464608e8da35 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:00.377796 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f4f38-81c5-4543-a6b9-464608e8da35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:00.392789 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8a8f4f38-81c5-4543-a6b9-464608e8da35 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:00.394080 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8a8f4f38-81c5-4543-a6b9-464608e8da35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:00.452145 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315f7b6-1dcb-4c07-bd50-8a97c129826b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:00.456904 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:00.468279 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 209/419] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:23:00.477296 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:00.477755 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f4f38-81c5-4543-a6b9-464608e8da35 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:00.497851 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a758c-ab08-4282-97ac-6748995b02cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:00.498898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a758c-ab08-4282-97ac-6748995b02cb None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:00.499456 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a758c-ab08-4282-97ac-6748995b02cb None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:00.499934 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a758c-ab08-4282-97ac-6748995b02cb None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:00.500998 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a758c-ab08-4282-97ac-6748995b02cb None admin] RBAC: Adding query filter params (name=member) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:00.501547 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a758c-ab08-4282-97ac-6748995b02cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:00.503237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a758c-ab08-4282-97ac-6748995b02cb None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:00.512803 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 211/420] 10.222.0.32 () {56 vars in 1101 bytes} [Thu Jun 2 13:23:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:00.513936 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a758c-ab08-4282-97ac-6748995b02cb None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:00.617280 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a758c-ab08-4282-97ac-6748995b02cb None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:00.621317 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f4f38-81c5-4543-a6b9-464608e8da35 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:00.652699 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49882b5-431f-41e7-8fce-c784fa3aff42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:00.653867 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49882b5-431f-41e7-8fce-c784fa3aff42 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:00.654361 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49882b5-431f-41e7-8fce-c784fa3aff42 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:00.654832 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49882b5-431f-41e7-8fce-c784fa3aff42 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:00.665673 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49882b5-431f-41e7-8fce-c784fa3aff42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:00.667854 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6212c6-63eb-4bd8-b34f-b17f30c9490a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:00.668778 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6212c6-63eb-4bd8-b34f-b17f30c9490a None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:00.669060 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6212c6-63eb-4bd8-b34f-b17f30c9490a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:00.669334 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6212c6-63eb-4bd8-b34f-b17f30c9490a None admin] PATH_INFO: `/v3/projects/0c7119c3fda547cdad0db42ad18b471e/groups/851ad5590e384c79a873c08a5d430339/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:00.671282 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6212c6-63eb-4bd8-b34f-b17f30c9490a None admin] RBAC: Authorizing `identity:create_grant(project_id=0c7119c3fda547cdad0db42ad18b471e, group_id=851ad5590e384c79a873c08a5d430339, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:00.672760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6212c6-63eb-4bd8-b34f-b17f30c9490a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:00.675725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-d49882b5-431f-41e7-8fce-c784fa3aff42 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:23:00.675725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:00.675725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:00.675725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:00.675725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:00.675725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:00.675725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:00.675725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:00.675725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:00.675725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:00.675725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:00.675725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:00.675725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:00.675725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:00.675725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:00.675725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:00.676638 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:00.676638 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:00.676638 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:00.676638 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:00.676638 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:00.676638 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:00.676638 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:00.676638 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:00.676638 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:00.676638 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:00.676638 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:00.676638 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:00.676638 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:00.676638 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:00.676638 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:00.676638 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:00.677602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:00.677602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:00.677602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:00.677602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:00.677602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:00.677602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:00.677602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:00.677602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:00.677602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:00.677602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:00.677602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:23:00.677602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:00.680225 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 212/421] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Jun 2 13:23:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:00.681839 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49882b5-431f-41e7-8fce-c784fa3aff42 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:00.691494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 210/422] 10.222.0.32 () {58 vars in 1442 bytes} [Thu Jun 2 13:23:00 2022] PUT /identity/v3/projects/0c7119c3fda547cdad0db42ad18b471e/groups/851ad5590e384c79a873c08a5d430339/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:00.692665 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6212c6-63eb-4bd8-b34f-b17f30c9490a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:00.768683 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:00.810576 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:00.892638 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6212c6-63eb-4bd8-b34f-b17f30c9490a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:00.906605 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49882b5-431f-41e7-8fce-c784fa3aff42 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:00.933426 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d84804-7556-4f23-a49e-24908e9b48f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:00.934270 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d84804-7556-4f23-a49e-24908e9b48f4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:00.934709 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d84804-7556-4f23-a49e-24908e9b48f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:00.935104 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d84804-7556-4f23-a49e-24908e9b48f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:00.936028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d84804-7556-4f23-a49e-24908e9b48f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:00.936483 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d84804-7556-4f23-a49e-24908e9b48f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:00.938518 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d84804-7556-4f23-a49e-24908e9b48f4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:00.949562 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 211/423] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:00.955763 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d84804-7556-4f23-a49e-24908e9b48f4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:00.981329 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88927e-b6e0-4be4-825f-48e98412b6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:00.982210 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88927e-b6e0-4be4-825f-48e98412b6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:00.982849 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88927e-b6e0-4be4-825f-48e98412b6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:00.983312 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88927e-b6e0-4be4-825f-48e98412b6d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:01.070014 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88927e-b6e0-4be4-825f-48e98412b6d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:01.071641 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88927e-b6e0-4be4-825f-48e98412b6d1 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:01.119117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:01.183367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 213/424] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:23:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:01.188989 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88927e-b6e0-4be4-825f-48e98412b6d1 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:01.218351 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d84804-7556-4f23-a49e-24908e9b48f4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:01.250732 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:01.290451 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c079e1a-deb7-4605-ac37-4fc3dbf36b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:01.291645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c079e1a-deb7-4605-ac37-4fc3dbf36b38 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:01.291935 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c079e1a-deb7-4605-ac37-4fc3dbf36b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:01.292323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c079e1a-deb7-4605-ac37-4fc3dbf36b38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:01.303398 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88927e-b6e0-4be4-825f-48e98412b6d1 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:01.344189 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a165836-4858-4e55-b247-2481953d5007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:01.345447 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a165836-4858-4e55-b247-2481953d5007 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:01.345925 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a165836-4858-4e55-b247-2481953d5007 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:01.346413 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a165836-4858-4e55-b247-2481953d5007 None admin] PATH_INFO: `/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:01.347871 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a165836-4858-4e55-b247-2481953d5007 None admin] RBAC: Authorizing `identity:get_project(project_id=f8b3b94854ab4f878d89ba44b09b07ea)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:01.349647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a165836-4858-4e55-b247-2481953d5007 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:01.351645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 214/425] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:23:01 2022] GET /identity/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:01.361362 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a165836-4858-4e55-b247-2481953d5007 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:01.371173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:01.376970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c079e1a-deb7-4605-ac37-4fc3dbf36b38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:01.378511 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c079e1a-deb7-4605-ac37-4fc3dbf36b38 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:01.480478 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a165836-4858-4e55-b247-2481953d5007 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:01.521765 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b2071-357b-49dd-a6fc-03a032af6ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:01.526158 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b2071-357b-49dd-a6fc-03a032af6ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:01.526647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b2071-357b-49dd-a6fc-03a032af6ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:01.527114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b2071-357b-49dd-a6fc-03a032af6ee2 None admin] PATH_INFO: `/v3/groups/5caea916cf5e4426a6f13b48a05092d0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:01.528780 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b2071-357b-49dd-a6fc-03a032af6ee2 None admin] RBAC: Authorizing `identity:get_group(group_id=5caea916cf5e4426a6f13b48a05092d0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:01.531716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b2071-357b-49dd-a6fc-03a032af6ee2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:01.533763 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 215/426] 10.222.0.32 () {56 vars in 1180 bytes} [Thu Jun 2 13:23:01 2022] GET /identity/v3/groups/5caea916cf5e4426a6f13b48a05092d0 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:01.542349 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b2071-357b-49dd-a6fc-03a032af6ee2 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:01.555969 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 212/427] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:23:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:23:01.557220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c079e1a-deb7-4605-ac37-4fc3dbf36b38 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:01.594027 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:01.630724 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:01.662535 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b2071-357b-49dd-a6fc-03a032af6ee2 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:01.711233 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25a90e-ae4b-4d65-a4f2-b2604a17d936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:01.713567 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25a90e-ae4b-4d65-a4f2-b2604a17d936 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:01.714061 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25a90e-ae4b-4d65-a4f2-b2604a17d936 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:01.714812 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25a90e-ae4b-4d65-a4f2-b2604a17d936 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:01.716580 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25a90e-ae4b-4d65-a4f2-b2604a17d936 None admin] RBAC: Adding query filter params (group.id=5caea916cf5e4426a6f13b48a05092d0, role.id=e4d5af06c5a44d479d25ce8490ce71a0, scope.project.id=f8b3b94854ab4f878d89ba44b09b07ea) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:01.717102 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25a90e-ae4b-4d65-a4f2-b2604a17d936 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:01.719617 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25a90e-ae4b-4d65-a4f2-b2604a17d936 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:01.721139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c079e1a-deb7-4605-ac37-4fc3dbf36b38 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:01.727799 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 216/428] 10.222.0.32 () {56 vars in 1376 bytes} [Thu Jun 2 13:23:01 2022] GET /identity/v3/role_assignments?group.id=5caea916cf5e4426a6f13b48a05092d0&scope.project.id=f8b3b94854ab4f878d89ba44b09b07ea&role.id=e4d5af06c5a44d479d25ce8490ce71a0 => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:01.729872 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a93da6-2df8-4d5f-a375-d69812505848 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:01.730382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a93da6-2df8-4d5f-a375-d69812505848 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:01.731398 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a93da6-2df8-4d5f-a375-d69812505848 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:01.738040 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 217/429] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:01.741999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c298373-f103-40e2-b757-e5b090d36eee None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:01.742586 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c298373-f103-40e2-b757-e5b090d36eee None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:01.743068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c298373-f103-40e2-b757-e5b090d36eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:01.764558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-0c298373-f103-40e2-b757-e5b090d36eee None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:01.766180 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0c298373-f103-40e2-b757-e5b090d36eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:01.816662 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67443e35-c930-4d3b-9eb0-c36deeab7f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:01.817889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67443e35-c930-4d3b-9eb0-c36deeab7f04 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:01.818226 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67443e35-c930-4d3b-9eb0-c36deeab7f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:01.818505 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67443e35-c930-4d3b-9eb0-c36deeab7f04 None admin] PATH_INFO: `/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:01.819851 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67443e35-c930-4d3b-9eb0-c36deeab7f04 None admin] RBAC: Authorizing `identity:get_project(project_id=f8b3b94854ab4f878d89ba44b09b07ea)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:01.821397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67443e35-c930-4d3b-9eb0-c36deeab7f04 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:01.833237 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 213/430] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:23:01 2022] GET /identity/v3/projects/f8b3b94854ab4f878d89ba44b09b07ea => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:01.838986 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67443e35-c930-4d3b-9eb0-c36deeab7f04 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:01.853702 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 218/431] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:23:01.882612 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c298373-f103-40e2-b757-e5b090d36eee None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:01.965924 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:01.986357 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:02.007156 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67443e35-c930-4d3b-9eb0-c36deeab7f04 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:02.015319 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c298373-f103-40e2-b757-e5b090d36eee None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:02.055120 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19a10f-b509-40ee-84fd-b5560e282183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:02.056956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19a10f-b509-40ee-84fd-b5560e282183 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:02.057443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19a10f-b509-40ee-84fd-b5560e282183 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:02.057913 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19a10f-b509-40ee-84fd-b5560e282183 None admin] PATH_INFO: `/v3/groups/5caea916cf5e4426a6f13b48a05092d0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:02.058369 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d722008-2814-4cce-bc65-f319f97518d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:02.059217 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d722008-2814-4cce-bc65-f319f97518d2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:02.059509 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d722008-2814-4cce-bc65-f319f97518d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:02.059789 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d722008-2814-4cce-bc65-f319f97518d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:02.067124 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb19a10f-b509-40ee-84fd-b5560e282183 None admin] RBAC: Authorizing `identity:get_group(group_id=5caea916cf5e4426a6f13b48a05092d0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:02.067124 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb19a10f-b509-40ee-84fd-b5560e282183 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:02.068177 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 214/432] 10.222.0.32 () {56 vars in 1180 bytes} [Thu Jun 2 13:23:01 2022] GET /identity/v3/groups/5caea916cf5e4426a6f13b48a05092d0 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:02.075286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d722008-2814-4cce-bc65-f319f97518d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:02.077240 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19a10f-b509-40ee-84fd-b5560e282183 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:02.084666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-1d722008-2814-4cce-bc65-f319f97518d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:23:02.084666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:02.084666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:02.084666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:02.084666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:02.084666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:02.084666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:02.084666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:02.084666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:02.084666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:02.084666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:02.084666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:02.084666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:02.084666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:02.084666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:02.084666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:02.085623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:02.085623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:02.085623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:02.085623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:02.085623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:02.085623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:02.085623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:02.085623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:02.085623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:02.085623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:02.085623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:02.085623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:02.085623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:02.085623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:02.085623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:02.085623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:02.086425 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:02.086425 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:02.086425 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:02.086425 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:02.086425 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:02.086425 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:02.086425 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:02.086425 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:02.086425 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:02.086425 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:02.086425 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:23:02.086425 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:02.086425 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 219/433] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:23:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:02.094183 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d722008-2814-4cce-bc65-f319f97518d2 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:02.226418 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d722008-2814-4cce-bc65-f319f97518d2 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:02.227706 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19a10f-b509-40ee-84fd-b5560e282183 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:02.261105 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:02.276067 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa6be8-27cc-4bf1-90a0-ec2dc7ae7ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:02.276921 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa6be8-27cc-4bf1-90a0-ec2dc7ae7ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:02.277272 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa6be8-27cc-4bf1-90a0-ec2dc7ae7ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:02.277624 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa6be8-27cc-4bf1-90a0-ec2dc7ae7ce4 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:02.278458 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa6be8-27cc-4bf1-90a0-ec2dc7ae7ce4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:02.278836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa6be8-27cc-4bf1-90a0-ec2dc7ae7ce4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:02.280358 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa6be8-27cc-4bf1-90a0-ec2dc7ae7ce4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:02.281196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374f078-5e20-4eaf-bd55-2a52249b7eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:02.282260 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374f078-5e20-4eaf-bd55-2a52249b7eeb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:02.282720 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374f078-5e20-4eaf-bd55-2a52249b7eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:02.283158 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374f078-5e20-4eaf-bd55-2a52249b7eeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:02.284678 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374f078-5e20-4eaf-bd55-2a52249b7eeb None admin] RBAC: Adding query filter params (group.id=5caea916cf5e4426a6f13b48a05092d0, role.id=5fe1cb1c673a407bb1025d500f111390, scope.project.id=f8b3b94854ab4f878d89ba44b09b07ea) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:02.285178 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374f078-5e20-4eaf-bd55-2a52249b7eeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:02.286804 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374f078-5e20-4eaf-bd55-2a52249b7eeb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:02.291803 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 220/434] 10.222.0.32 () {56 vars in 1101 bytes} [Thu Jun 2 13:23:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:02.304707 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 215/435] 10.222.0.32 () {56 vars in 1376 bytes} [Thu Jun 2 13:23:02 2022] GET /identity/v3/role_assignments?group.id=5caea916cf5e4426a6f13b48a05092d0&scope.project.id=f8b3b94854ab4f878d89ba44b09b07ea&role.id=5fe1cb1c673a407bb1025d500f111390 => generated 611 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:02.305367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa6be8-27cc-4bf1-90a0-ec2dc7ae7ce4 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:02.433097 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa6be8-27cc-4bf1-90a0-ec2dc7ae7ce4 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:02.476950 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42633723-ec9f-4f52-a51f-e9a9a3d1cfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:02.477613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42633723-ec9f-4f52-a51f-e9a9a3d1cfe7 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:02.477896 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42633723-ec9f-4f52-a51f-e9a9a3d1cfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:02.478712 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42633723-ec9f-4f52-a51f-e9a9a3d1cfe7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:02.555874 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:02.567810 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42633723-ec9f-4f52-a51f-e9a9a3d1cfe7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:02.569341 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42633723-ec9f-4f52-a51f-e9a9a3d1cfe7 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:02.675912 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 221/436] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:23:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:02.681562 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374f078-5e20-4eaf-bd55-2a52249b7eeb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:02.701241 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:02.776349 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55febe-1497-4e10-a976-0644be84cfe6 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:02.776536 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55febe-1497-4e10-a976-0644be84cfe6 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:02.776743 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55febe-1497-4e10-a976-0644be84cfe6 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:02.778383 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 222/437] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:23:02.785095 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88d357-9bb8-45ee-a776-7ec3f0df6290 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:02.785386 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88d357-9bb8-45ee-a776-7ec3f0df6290 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:02.785668 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88d357-9bb8-45ee-a776-7ec3f0df6290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:02.800159 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374f078-5e20-4eaf-bd55-2a52249b7eeb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:02.804238 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-cc88d357-9bb8-45ee-a776-7ec3f0df6290 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:02.805754 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-cc88d357-9bb8-45ee-a776-7ec3f0df6290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:02.841548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6863db-1a9a-4f18-93e1-8b68da0b8025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:02.842632 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6863db-1a9a-4f18-93e1-8b68da0b8025 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:02.842920 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6863db-1a9a-4f18-93e1-8b68da0b8025 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:02.843195 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6863db-1a9a-4f18-93e1-8b68da0b8025 None admin] PATH_INFO: `/v3/projects/b4bc26bb161145d88db0ede674ffce12` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:02.844454 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6863db-1a9a-4f18-93e1-8b68da0b8025 None admin] RBAC: Authorizing `identity:get_project(project_id=b4bc26bb161145d88db0ede674ffce12)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:02.845978 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6863db-1a9a-4f18-93e1-8b68da0b8025 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:02.848348 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 216/438] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:23:02 2022] GET /identity/v3/projects/b4bc26bb161145d88db0ede674ffce12 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:02.854508 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6863db-1a9a-4f18-93e1-8b68da0b8025 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:02.897920 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 223/439] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:23:02.921622 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88d357-9bb8-45ee-a776-7ec3f0df6290 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:02.945048 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:02.951905 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:02.968085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6863db-1a9a-4f18-93e1-8b68da0b8025 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:03.006513 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74610213-e8c7-461d-aaae-254c68194991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:03.007388 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74610213-e8c7-461d-aaae-254c68194991 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:03.007676 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74610213-e8c7-461d-aaae-254c68194991 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:03.008083 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74610213-e8c7-461d-aaae-254c68194991 None admin] PATH_INFO: `/v3/groups/5caea916cf5e4426a6f13b48a05092d0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:03.009969 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74610213-e8c7-461d-aaae-254c68194991 None admin] RBAC: Authorizing `identity:get_group(group_id=5caea916cf5e4426a6f13b48a05092d0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:03.011633 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74610213-e8c7-461d-aaae-254c68194991 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:03.013815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 217/440] 10.222.0.32 () {56 vars in 1180 bytes} [Thu Jun 2 13:23:02 2022] GET /identity/v3/groups/5caea916cf5e4426a6f13b48a05092d0 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:03.019989 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74610213-e8c7-461d-aaae-254c68194991 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:03.044869 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88d357-9bb8-45ee-a776-7ec3f0df6290 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:03.080009 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ff8b7-e042-4d2f-be14-9c16462ef5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:03.080832 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ff8b7-e042-4d2f-be14-9c16462ef5de None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:03.081306 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ff8b7-e042-4d2f-be14-9c16462ef5de None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:03.081581 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ff8b7-e042-4d2f-be14-9c16462ef5de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:03.092536 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ff8b7-e042-4d2f-be14-9c16462ef5de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:03.100552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-ea3ff8b7-e042-4d2f-be14-9c16462ef5de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:23:03.100552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:03.100552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:03.100552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:03.100552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:03.100552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:03.100552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:03.100552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:03.100552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:03.100552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:03.100552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:03.100552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:03.100552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:03.100552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:03.100552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:03.100552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:03.101439 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:03.101439 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:03.101439 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:03.101439 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:03.101439 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:03.101439 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:03.101439 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:03.101439 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:03.101439 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:03.101439 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:03.101439 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:03.101439 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:03.101439 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:03.101439 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:03.101439 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:03.101439 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:03.102222 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:03.102222 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:03.102222 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:03.102222 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:03.102222 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:03.102222 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:03.102222 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:03.102222 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:03.102222 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:03.102222 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:03.102222 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:23:03.102222 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:03.102222 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 224/441] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Jun 2 13:23:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:23:03.108819 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ff8b7-e042-4d2f-be14-9c16462ef5de None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:03.130340 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74610213-e8c7-461d-aaae-254c68194991 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:03.165620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744c94e-4323-4a56-aa60-d67ce27e3651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:03.166269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744c94e-4323-4a56-aa60-d67ce27e3651 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:03.166550 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744c94e-4323-4a56-aa60-d67ce27e3651 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:03.166825 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744c94e-4323-4a56-aa60-d67ce27e3651 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:03.167655 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744c94e-4323-4a56-aa60-d67ce27e3651 None admin] RBAC: Adding query filter params (group.id=5caea916cf5e4426a6f13b48a05092d0, role.id=e4d5af06c5a44d479d25ce8490ce71a0, scope.project.id=b4bc26bb161145d88db0ede674ffce12) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:03.167966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744c94e-4323-4a56-aa60-d67ce27e3651 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:03.169448 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744c94e-4323-4a56-aa60-d67ce27e3651 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:03.175300 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 218/442] 10.222.0.32 () {56 vars in 1376 bytes} [Thu Jun 2 13:23:03 2022] GET /identity/v3/role_assignments?group.id=5caea916cf5e4426a6f13b48a05092d0&scope.project.id=b4bc26bb161145d88db0ede674ffce12&role.id=e4d5af06c5a44d479d25ce8490ce71a0 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:03.208894 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:03.231854 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ff8b7-e042-4d2f-be14-9c16462ef5de None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:03.268727 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc8851-2b3b-4a03-a80d-45a99d58e588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:03.269405 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc8851-2b3b-4a03-a80d-45a99d58e588 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:03.269688 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc8851-2b3b-4a03-a80d-45a99d58e588 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:03.269962 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc8851-2b3b-4a03-a80d-45a99d58e588 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:03.270731 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc8851-2b3b-4a03-a80d-45a99d58e588 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:03.271036 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc8851-2b3b-4a03-a80d-45a99d58e588 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:03.272454 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc8851-2b3b-4a03-a80d-45a99d58e588 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:03.282248 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 225/443] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:03.287869 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744c94e-4323-4a56-aa60-d67ce27e3651 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:03.306864 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:03.321539 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037c8d1-6d00-4718-8bb3-69c52e9c4ff8 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:03.322377 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037c8d1-6d00-4718-8bb3-69c52e9c4ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:03.322657 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037c8d1-6d00-4718-8bb3-69c52e9c4ff8 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:03.324229 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 226/444] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:23:03.329725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc34fcd-9ad3-4c16-81a2-617fcb3e6520 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:03.330010 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc34fcd-9ad3-4c16-81a2-617fcb3e6520 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:03.330288 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc34fcd-9ad3-4c16-81a2-617fcb3e6520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:03.348358 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-7cc34fcd-9ad3-4c16-81a2-617fcb3e6520 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:03.349485 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7cc34fcd-9ad3-4c16-81a2-617fcb3e6520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:03.399889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744c94e-4323-4a56-aa60-d67ce27e3651 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:03.427120 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 227/445] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:23:03.443837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8538c11-204f-457c-a68c-c513cbe27910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:03.444547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8538c11-204f-457c-a68c-c513cbe27910 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:03.444829 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8538c11-204f-457c-a68c-c513cbe27910 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:03.445103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8538c11-204f-457c-a68c-c513cbe27910 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:03.450812 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc34fcd-9ad3-4c16-81a2-617fcb3e6520 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:03.523558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8538c11-204f-457c-a68c-c513cbe27910 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:03.525281 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8538c11-204f-457c-a68c-c513cbe27910 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:03.535168 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:03.547292 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:03.572057 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc34fcd-9ad3-4c16-81a2-617fcb3e6520 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:03.610896 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc0769-a7fe-4d54-bac4-8332013dc5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:03.611607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc0769-a7fe-4d54-bac4-8332013dc5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:03.611958 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc0769-a7fe-4d54-bac4-8332013dc5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:03.612175 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc0769-a7fe-4d54-bac4-8332013dc5c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:03.622616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc0769-a7fe-4d54-bac4-8332013dc5c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:03.630246 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-73cc0769-a7fe-4d54-bac4-8332013dc5c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:23:03.630246 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:03.630246 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:03.630246 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:03.630246 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:03.630246 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:03.630246 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:03.630246 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:03.630246 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:03.630246 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:03.630246 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:03.630246 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:03.630246 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:03.630246 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:03.630246 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:03.630246 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:03.631173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:03.631173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:03.631173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:03.631173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:03.631173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:03.631173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:03.631173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:03.631173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:03.631173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:03.631173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:03.631173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:03.631173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:03.631173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:03.631173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:03.631173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:03.631173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:03.632114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:03.632114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:03.632114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:03.632114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:03.632114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:03.632114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:03.632114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:03.632114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:03.632114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:03.632114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:03.632114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:23:03.632114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:03.632114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 228/446] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:23:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:23:03.637020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc0769-a7fe-4d54-bac4-8332013dc5c4 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:03.643699 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 219/447] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:23:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:03.648979 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8538c11-204f-457c-a68c-c513cbe27910 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:03.734775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc0769-a7fe-4d54-bac4-8332013dc5c4 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:03.745999 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8538c11-204f-457c-a68c-c513cbe27910 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:03.762050 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:03.762807 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:03.768567 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8bc27-fdfa-465b-a635-63d3741b83b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:03.769221 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8bc27-fdfa-465b-a635-63d3741b83b8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:03.769502 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8bc27-fdfa-465b-a635-63d3741b83b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:03.769772 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8bc27-fdfa-465b-a635-63d3741b83b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:03.770510 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8bc27-fdfa-465b-a635-63d3741b83b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:03.770812 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8bc27-fdfa-465b-a635-63d3741b83b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:03.772191 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8bc27-fdfa-465b-a635-63d3741b83b8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:03.780169 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3a9e1-62d1-4d04-a4bb-49195b4ece61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:03.781060 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3a9e1-62d1-4d04-a4bb-49195b4ece61 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:03.781178 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 229/448] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:23:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:03.781346 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3a9e1-62d1-4d04-a4bb-49195b4ece61 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:03.781620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3a9e1-62d1-4d04-a4bb-49195b4ece61 None admin] PATH_INFO: `/v3/projects/b4bc26bb161145d88db0ede674ffce12` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:03.786242 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3a9e1-62d1-4d04-a4bb-49195b4ece61 None admin] RBAC: Authorizing `identity:get_project(project_id=b4bc26bb161145d88db0ede674ffce12)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:03.786621 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8bc27-fdfa-465b-a635-63d3741b83b8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:03.787678 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3a9e1-62d1-4d04-a4bb-49195b4ece61 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:03.794159 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 220/449] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:23:03 2022] GET /identity/v3/projects/b4bc26bb161145d88db0ede674ffce12 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:03.795115 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3a9e1-62d1-4d04-a4bb-49195b4ece61 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:03.883303 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8bc27-fdfa-465b-a635-63d3741b83b8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:03.892798 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3a9e1-62d1-4d04-a4bb-49195b4ece61 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:03.916372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6393bb-4e07-499b-8363-3ae9c4273d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:03.917007 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6393bb-4e07-499b-8363-3ae9c4273d90 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:03.917288 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6393bb-4e07-499b-8363-3ae9c4273d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:03.917554 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6393bb-4e07-499b-8363-3ae9c4273d90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:03.926400 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8765b-0897-4fed-bfa0-d6414723a9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:03.927252 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8765b-0897-4fed-bfa0-d6414723a9cf None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:03.927533 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8765b-0897-4fed-bfa0-d6414723a9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:03.927806 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8765b-0897-4fed-bfa0-d6414723a9cf None admin] PATH_INFO: `/v3/groups/5caea916cf5e4426a6f13b48a05092d0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:03.929013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8765b-0897-4fed-bfa0-d6414723a9cf None admin] RBAC: Authorizing `identity:get_group(group_id=5caea916cf5e4426a6f13b48a05092d0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:03.930450 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8765b-0897-4fed-bfa0-d6414723a9cf None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:03.932093 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 221/450] 10.222.0.32 () {56 vars in 1180 bytes} [Thu Jun 2 13:23:03 2022] GET /identity/v3/groups/5caea916cf5e4426a6f13b48a05092d0 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:03.937717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8765b-0897-4fed-bfa0-d6414723a9cf None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:03.979504 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:03.987711 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6393bb-4e07-499b-8363-3ae9c4273d90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:03.989242 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6393bb-4e07-499b-8363-3ae9c4273d90 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:03.989385 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:04.037507 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8765b-0897-4fed-bfa0-d6414723a9cf None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:04.070670 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c855e-8cd7-480d-a3a9-1115f30fdea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:04.071322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c855e-8cd7-480d-a3a9-1115f30fdea0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:04.071641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c855e-8cd7-480d-a3a9-1115f30fdea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:04.072467 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c855e-8cd7-480d-a3a9-1115f30fdea0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:04.073294 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c855e-8cd7-480d-a3a9-1115f30fdea0 None admin] RBAC: Adding query filter params (group.id=5caea916cf5e4426a6f13b48a05092d0, role.id=5fe1cb1c673a407bb1025d500f111390, scope.project.id=b4bc26bb161145d88db0ede674ffce12) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:04.073609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c855e-8cd7-480d-a3a9-1115f30fdea0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:04.075064 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c855e-8cd7-480d-a3a9-1115f30fdea0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:04.081163 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 222/451] 10.222.0.32 () {56 vars in 1376 bytes} [Thu Jun 2 13:23:03 2022] GET /identity/v3/role_assignments?group.id=5caea916cf5e4426a6f13b48a05092d0&scope.project.id=b4bc26bb161145d88db0ede674ffce12&role.id=5fe1cb1c673a407bb1025d500f111390 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:04.088921 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 230/452] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:23:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:23:04.094649 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c855e-8cd7-480d-a3a9-1115f30fdea0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:04.199450 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c855e-8cd7-480d-a3a9-1115f30fdea0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:04.218764 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:04.237329 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574026a-bef4-4d8c-980f-052f6a7b518a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:04.238203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574026a-bef4-4d8c-980f-052f6a7b518a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:04.238487 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574026a-bef4-4d8c-980f-052f6a7b518a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:04.238763 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574026a-bef4-4d8c-980f-052f6a7b518a None admin] PATH_INFO: `/v3/projects/0c7119c3fda547cdad0db42ad18b471e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:04.240023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574026a-bef4-4d8c-980f-052f6a7b518a None admin] RBAC: Authorizing `identity:get_project(project_id=0c7119c3fda547cdad0db42ad18b471e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:04.241530 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574026a-bef4-4d8c-980f-052f6a7b518a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:04.243266 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 223/453] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:23:04 2022] GET /identity/v3/projects/0c7119c3fda547cdad0db42ad18b471e => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:04.248880 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6393bb-4e07-499b-8363-3ae9c4273d90 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:04.343753 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:04.351007 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6393bb-4e07-499b-8363-3ae9c4273d90 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:04.385303 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319dec9-5679-4849-832d-9dbdbf24a9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:04.386153 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319dec9-5679-4849-832d-9dbdbf24a9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:04.386447 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319dec9-5679-4849-832d-9dbdbf24a9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:04.386726 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319dec9-5679-4849-832d-9dbdbf24a9b0 None admin] PATH_INFO: `/v3/groups/851ad5590e384c79a873c08a5d430339` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:04.387928 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0319dec9-5679-4849-832d-9dbdbf24a9b0 None admin] RBAC: Authorizing `identity:get_group(group_id=851ad5590e384c79a873c08a5d430339)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:04.389404 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0319dec9-5679-4849-832d-9dbdbf24a9b0 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:04.391042 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 231/454] 10.222.0.32 () {56 vars in 1180 bytes} [Thu Jun 2 13:23:04 2022] GET /identity/v3/groups/851ad5590e384c79a873c08a5d430339 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:04.396882 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574026a-bef4-4d8c-980f-052f6a7b518a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:04.500645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574026a-bef4-4d8c-980f-052f6a7b518a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:04.533308 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b60c3-4fda-46e8-8317-7777283a2a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:04.533953 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b60c3-4fda-46e8-8317-7777283a2a6f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:04.534235 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b60c3-4fda-46e8-8317-7777283a2a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:04.534510 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b60c3-4fda-46e8-8317-7777283a2a6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:04.535334 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b60c3-4fda-46e8-8317-7777283a2a6f None admin] RBAC: Adding query filter params (group.id=851ad5590e384c79a873c08a5d430339, role.id=128feb04d1e042ac844f9ad70b89bb02, scope.project.id=0c7119c3fda547cdad0db42ad18b471e) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:04.535646 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b60c3-4fda-46e8-8317-7777283a2a6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:04.537110 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b60c3-4fda-46e8-8317-7777283a2a6f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:04.543021 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 224/455] 10.222.0.32 () {56 vars in 1376 bytes} [Thu Jun 2 13:23:04 2022] GET /identity/v3/role_assignments?group.id=851ad5590e384c79a873c08a5d430339&scope.project.id=0c7119c3fda547cdad0db42ad18b471e&role.id=128feb04d1e042ac844f9ad70b89bb02 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:07.361330 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8c943-4574-41ae-89c4-4d817619fc2a None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:07.361330 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8c943-4574-41ae-89c4-4d817619fc2a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:07.361330 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8c943-4574-41ae-89c4-4d817619fc2a None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:07.361330 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 232/456] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:07.366891 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4523b-a01a-4732-8fd0-095342f8706d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:07.367703 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4523b-a01a-4732-8fd0-095342f8706d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:07.368180 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4523b-a01a-4732-8fd0-095342f8706d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:07.397313 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6ff4523b-a01a-4732-8fd0-095342f8706d None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:07.398863 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6ff4523b-a01a-4732-8fd0-095342f8706d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:07.459390 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:07.494194 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 225/457] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:23:07.534630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8c943-4574-41ae-89c4-4d817619fc2a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:07.670988 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8c943-4574-41ae-89c4-4d817619fc2a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:07.704934 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f1371-c2d7-42f2-89b1-ef2cbcc537e9 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:07.705589 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f1371-c2d7-42f2-89b1-ef2cbcc537e9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:07.706080 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f1371-c2d7-42f2-89b1-ef2cbcc537e9 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:07.708145 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 226/458] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:07.713592 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31774f2-cb12-46e3-aa61-da24b5dbb625 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:07.713883 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31774f2-cb12-46e3-aa61-da24b5dbb625 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:07.714161 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31774f2-cb12-46e3-aa61-da24b5dbb625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:07.738301 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7217c-6ce1-4cfe-8356-9fa4a963d959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:07.739100 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7217c-6ce1-4cfe-8356-9fa4a963d959 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:07.739381 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7217c-6ce1-4cfe-8356-9fa4a963d959 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:07.739653 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7217c-6ce1-4cfe-8356-9fa4a963d959 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:07.745321 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e31774f2-cb12-46e3-aa61-da24b5dbb625 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:07.746580 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e31774f2-cb12-46e3-aa61-da24b5dbb625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:07.756080 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7217c-6ce1-4cfe-8356-9fa4a963d959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:07.757636 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7217c-6ce1-4cfe-8356-9fa4a963d959 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:07.782671 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-0ea7217c-6ce1-4cfe-8356-9fa4a963d959 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:07.782671 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:07.782671 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:07.782671 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:07.782671 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:07.782671 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:07.782671 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:07.782671 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:07.782671 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:07.782671 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:07.782671 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:07.782671 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:07.782671 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:07.782671 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:07.782671 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:07.783666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:07.783666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:07.783666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:07.783666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:07.783666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:07.783666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:07.783666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:07.783666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:07.783666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:07.783666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:07.783666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:07.783666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:07.783666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:07.783666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:07.783666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:07.783666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:07.783666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:07.784550 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:07.784550 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:07.784550 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:07.784550 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:07.786514 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 233/459] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:07.792624 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7217c-6ce1-4cfe-8356-9fa4a963d959 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:07.820646 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:07.857830 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 227/460] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:23:07.858962 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ed120-6175-4bbb-9fb1-b0921e9c0aa3 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:07.859251 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ed120-6175-4bbb-9fb1-b0921e9c0aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:07.859529 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ed120-6175-4bbb-9fb1-b0921e9c0aa3 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:07.868977 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 228/461] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:07 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:07.877732 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3e261-0d91-4a77-95e4-b91575d90583 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:07.877970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3e261-0d91-4a77-95e4-b91575d90583 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:07.878236 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3e261-0d91-4a77-95e4-b91575d90583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:07.903353 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-03e3e261-0d91-4a77-95e4-b91575d90583 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:07.904572 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-03e3e261-0d91-4a77-95e4-b91575d90583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:07.927460 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7217c-6ce1-4cfe-8356-9fa4a963d959 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:07.973269 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4ff33-d348-4b8f-9583-86191e3f9dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:07.973655 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 229/462] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:23:07.974439 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3e261-0d91-4a77-95e4-b91575d90583 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:07.974836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4ff33-d348-4b8f-9583-86191e3f9dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:07.975332 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4ff33-d348-4b8f-9583-86191e3f9dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:07.975821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4ff33-d348-4b8f-9583-86191e3f9dc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:07.976948 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf4ff33-d348-4b8f-9583-86191e3f9dc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:07.978316 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf4ff33-d348-4b8f-9583-86191e3f9dc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:07.979958 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf4ff33-d348-4b8f-9583-86191e3f9dc6 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:08.005487 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 234/463] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:08.006211 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4ff33-d348-4b8f-9583-86191e3f9dc6 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:08.031436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:08.093857 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:08.099510 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3e261-0d91-4a77-95e4-b91575d90583 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:08.123962 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4ff33-d348-4b8f-9583-86191e3f9dc6 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:08.138008 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8934ce-eeae-44e8-8b24-2affc51b979c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:08.138904 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8934ce-eeae-44e8-8b24-2affc51b979c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:08.139192 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8934ce-eeae-44e8-8b24-2affc51b979c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:08.139468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8934ce-eeae-44e8-8b24-2affc51b979c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:08.150104 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8934ce-eeae-44e8-8b24-2affc51b979c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:08.151567 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8934ce-eeae-44e8-8b24-2affc51b979c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:08.162475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2383bea-f4f7-4729-aa9e-2b70e9548901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:08.163258 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2383bea-f4f7-4729-aa9e-2b70e9548901 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:08.163543 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2383bea-f4f7-4729-aa9e-2b70e9548901 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:08.163821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2383bea-f4f7-4729-aa9e-2b70e9548901 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:08.169621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-7b8934ce-eeae-44e8-8b24-2affc51b979c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:08.169621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:08.169621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:08.169621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:08.169621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:08.169621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:08.169621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:08.169621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:08.169621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:08.169621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:08.169621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:08.169621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:08.169621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:08.169621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:08.169621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:08.170443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:08.170443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:08.170443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:08.170443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:08.170443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:08.170443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:08.170443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:08.170443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:08.170443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:08.170443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:08.170443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:08.170443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:08.170443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:08.170443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:08.170443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:08.170443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:08.170443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:08.171333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:08.171333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:08.171333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:08.171333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:08.171333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 230/464] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:08.172441 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8934ce-eeae-44e8-8b24-2affc51b979c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:08.179883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2383bea-f4f7-4729-aa9e-2b70e9548901 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:08.181835 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2383bea-f4f7-4729-aa9e-2b70e9548901 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:08.200679 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-a2383bea-f4f7-4729-aa9e-2b70e9548901 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:08.200679 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:08.200679 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:08.200679 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:08.200679 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:08.200679 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:08.200679 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:08.200679 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:08.200679 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:08.200679 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:08.200679 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:08.200679 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:08.200679 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:08.200679 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:08.200679 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:08.201703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:08.201703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:08.201703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:08.201703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:08.201703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:08.201703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:08.201703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:08.201703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:08.201703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:08.201703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:08.201703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:08.201703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:08.201703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:08.201703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:08.201703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:08.201703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:08.201703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:08.202737 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:08.202737 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:08.202737 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:08.202737 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:08.202737 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 235/465] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:08.203437 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f556744-f85b-4be4-96fd-fc25e84200a5 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:08.203731 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f556744-f85b-4be4-96fd-fc25e84200a5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:08.204015 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f556744-f85b-4be4-96fd-fc25e84200a5 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:08.208342 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 236/466] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:08.208342 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f556744-f85b-4be4-96fd-fc25e84200a5 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:08.274031 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:08.286198 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8934ce-eeae-44e8-8b24-2affc51b979c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:08.317347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f556744-f85b-4be4-96fd-fc25e84200a5 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:08.320853 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec318fbf-757d-454a-b151-aa90b141f1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:08.321523 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec318fbf-757d-454a-b151-aa90b141f1a4 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:08.321866 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec318fbf-757d-454a-b151-aa90b141f1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:08.322642 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec318fbf-757d-454a-b151-aa90b141f1a4 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:08.323343 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec318fbf-757d-454a-b151-aa90b141f1a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:08.324817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec318fbf-757d-454a-b151-aa90b141f1a4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:08.353409 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 231/467] 10.222.0.32 () {60 vars in 1132 bytes} [Thu Jun 2 13:23:08 2022] POST /identity/v3/users => generated 246 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:23:08.353409 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec318fbf-757d-454a-b151-aa90b141f1a4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:08.353975 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:08.361850 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b851dd2-9ea8-4e65-a577-4be3be0774fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:08.362502 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b851dd2-9ea8-4e65-a577-4be3be0774fb None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:08.362793 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b851dd2-9ea8-4e65-a577-4be3be0774fb None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:08.363072 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b851dd2-9ea8-4e65-a577-4be3be0774fb None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:08.363810 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b851dd2-9ea8-4e65-a577-4be3be0774fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:08.364127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b851dd2-9ea8-4e65-a577-4be3be0774fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:08.365579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b851dd2-9ea8-4e65-a577-4be3be0774fb None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:08.384978 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 237/468] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:08.386538 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed802d05-e0de-4f31-a8c8-9cce39c9df50 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:08.386830 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed802d05-e0de-4f31-a8c8-9cce39c9df50 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:08.387106 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed802d05-e0de-4f31-a8c8-9cce39c9df50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:08.404505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ed802d05-e0de-4f31-a8c8-9cce39c9df50 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:08.405703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ed802d05-e0de-4f31-a8c8-9cce39c9df50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:08.478894 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec318fbf-757d-454a-b151-aa90b141f1a4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:08.487028 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 238/469] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:23:08.493375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed802d05-e0de-4f31-a8c8-9cce39c9df50 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:08.518189 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76567faf-945c-442f-b631-175fa0113567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:08.518976 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76567faf-945c-442f-b631-175fa0113567 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:08.519556 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76567faf-945c-442f-b631-175fa0113567 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:08.519691 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76567faf-945c-442f-b631-175fa0113567 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:08.520493 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76567faf-945c-442f-b631-175fa0113567 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:08.520872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76567faf-945c-442f-b631-175fa0113567 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:08.522693 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76567faf-945c-442f-b631-175fa0113567 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:08.535389 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 232/470] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:08.536788 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89421b4-8076-4496-8ba2-9cf73bdf1f73 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:08.537079 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89421b4-8076-4496-8ba2-9cf73bdf1f73 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:08.537357 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89421b4-8076-4496-8ba2-9cf73bdf1f73 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:08.538806 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 233/471] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:08.541710 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89421b4-8076-4496-8ba2-9cf73bdf1f73 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:08.552123 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:08.620017 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed802d05-e0de-4f31-a8c8-9cce39c9df50 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:08.642201 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:08.658874 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89421b4-8076-4496-8ba2-9cf73bdf1f73 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:08.664503 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3c238-430c-4fe7-9fb7-966ba8007857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:08.665182 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3c238-430c-4fe7-9fb7-966ba8007857 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:08.665968 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3c238-430c-4fe7-9fb7-966ba8007857 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:08.666234 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3c238-430c-4fe7-9fb7-966ba8007857 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:08.666945 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3c238-430c-4fe7-9fb7-966ba8007857 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:08.668423 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3c238-430c-4fe7-9fb7-966ba8007857 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:08.695343 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e94885-e795-469c-b187-e376a47196b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:08.696171 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e94885-e795-469c-b187-e376a47196b4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:08.696669 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e94885-e795-469c-b187-e376a47196b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:08.696817 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 239/472] 10.222.0.32 () {60 vars in 1132 bytes} [Thu Jun 2 13:23:08 2022] POST /identity/v3/users => generated 248 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:23:08.696898 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e94885-e795-469c-b187-e376a47196b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:08.697467 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3c238-430c-4fe7-9fb7-966ba8007857 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:08.710582 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e94885-e795-469c-b187-e376a47196b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:08.712471 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e94885-e795-469c-b187-e376a47196b4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:08.733756 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e9e94885-e795-469c-b187-e376a47196b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:08.733756 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:08.733756 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:08.733756 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:08.733756 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:08.733756 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:08.733756 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:08.733756 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:08.733756 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:08.733756 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:08.733756 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:08.733756 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:08.733756 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:08.733756 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:08.733756 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:08.734645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:08.734645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:08.734645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:08.734645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:08.734645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:08.734645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:08.734645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:08.734645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:08.734645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:08.734645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:08.734645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:08.734645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:08.734645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:08.734645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:08.734645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:08.734645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:08.734645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:08.735500 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:08.735500 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:08.735500 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:08.735500 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:08.735500 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 234/473] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:08.736725 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca63500-fcac-4d50-8490-ee1763955318 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:08.737039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca63500-fcac-4d50-8490-ee1763955318 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:08.737416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca63500-fcac-4d50-8490-ee1763955318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:08.756527 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8ca63500-fcac-4d50-8490-ee1763955318 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:08.757940 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8ca63500-fcac-4d50-8490-ee1763955318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:08.822849 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:08.840339 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 235/474] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:23:08.847226 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3c238-430c-4fe7-9fb7-966ba8007857 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:08.849402 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca63500-fcac-4d50-8490-ee1763955318 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:08.890350 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660c413-15a4-4dc8-82ad-7da22805f7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:08.891376 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660c413-15a4-4dc8-82ad-7da22805f7b8 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:08.891668 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660c413-15a4-4dc8-82ad-7da22805f7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:08.892696 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660c413-15a4-4dc8-82ad-7da22805f7b8 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:08.893648 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660c413-15a4-4dc8-82ad-7da22805f7b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:08.895354 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660c413-15a4-4dc8-82ad-7da22805f7b8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:08.922116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 240/475] 10.222.0.32 () {60 vars in 1132 bytes} [Thu Jun 2 13:23:08 2022] POST /identity/v3/users => generated 248 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:23:08.923070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660c413-15a4-4dc8-82ad-7da22805f7b8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:08.960677 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:09.017518 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca63500-fcac-4d50-8490-ee1763955318 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:09.064676 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660c413-15a4-4dc8-82ad-7da22805f7b8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:09.070445 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a104010-dfda-4210-afe2-da0598f94440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:09.071136 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a104010-dfda-4210-afe2-da0598f94440 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:09.071423 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a104010-dfda-4210-afe2-da0598f94440 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:09.071727 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a104010-dfda-4210-afe2-da0598f94440 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:09.072560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a104010-dfda-4210-afe2-da0598f94440 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:09.072816 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a104010-dfda-4210-afe2-da0598f94440 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:09.074270 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a104010-dfda-4210-afe2-da0598f94440 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:09.091864 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 236/476] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:09.099451 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a104010-dfda-4210-afe2-da0598f94440 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:09.114818 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecc573-5db0-4680-b182-95c09c903a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:09.115983 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecc573-5db0-4680-b182-95c09c903a97 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:09.116549 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecc573-5db0-4680-b182-95c09c903a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:09.117029 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecc573-5db0-4680-b182-95c09c903a97 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:09.118019 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecc573-5db0-4680-b182-95c09c903a97 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:09.119716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecc573-5db0-4680-b182-95c09c903a97 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:09.127608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.sql.core [None req-39ecc573-5db0-4680-b182-95c09c903a97 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 13:23:09.127608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 02 13:23:09.127608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [parameters: {'id': '21e048f48efc47a5aaca9dc203b8d2bc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 02 13:23:09.127608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80182) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 13:23:09.147178 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-39ecc573-5db0-4680-b182-95c09c903a97 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 02 13:23:09.147178 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:09.147178 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 13:23:09.147178 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 13:23:09.147178 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 13:23:09.147178 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 13:23:09.147178 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 13:23:09.147178 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 13:23:09.147178 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 13:23:09.147178 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application conn.query(q) Jun 02 13:23:09.147178 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 13:23:09.147178 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 13:23:09.147178 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 13:23:09.147178 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application result.read() Jun 02 13:23:09.147178 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 13:23:09.148131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 13:23:09.148131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 13:23:09.148131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 13:23:09.148131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 13:23:09.148131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 13:23:09.148131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 13:23:09.148131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 13:23:09.148131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 13:23:09.148131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:09.148131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 13:23:09.148131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:09.148131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:09.148131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 13:23:09.148131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 13:23:09.148131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 02 13:23:09.148131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return ref.to_dict() Jun 02 13:23:09.148131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 13:23:09.148131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application next(self.gen) Jun 02 13:23:09.149138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 13:23:09.149138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application yield resource Jun 02 13:23:09.149138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 13:23:09.149138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application next(self.gen) Jun 02 13:23:09.149138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 13:23:09.149138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 13:23:09.149138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 13:23:09.149138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 13:23:09.149138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 13:23:09.149138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise self.value Jun 02 13:23:09.149138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 13:23:09.149138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 13:23:09.149138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 13:23:09.149138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application session.commit() Jun 02 13:23:09.149138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 13:23:09.149138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 13:23:09.149138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 13:23:09.150577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 13:23:09.150577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 13:23:09.150577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self.session.flush() Jun 02 13:23:09.150577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 13:23:09.150577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 13:23:09.150577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 13:23:09.150577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 13:23:09.150577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 13:23:09.150577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application compat.raise_( Jun 02 13:23:09.150577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 13:23:09.150577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception Jun 02 13:23:09.150577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 13:23:09.150577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 13:23:09.150577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 13:23:09.150577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 13:23:09.150577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 13:23:09.150577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 13:23:09.151458 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 13:23:09.151458 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 13:23:09.151458 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 02 13:23:09.151458 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 02 13:23:09.151458 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 13:23:09.151458 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 13:23:09.151458 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 13:23:09.151458 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 13:23:09.151458 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 13:23:09.151458 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 13:23:09.151458 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 13:23:09.151458 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 13:23:09.151458 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 13:23:09.151458 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 13:23:09.151458 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 13:23:09.151458 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception Jun 02 13:23:09.152287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 13:23:09.152287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 13:23:09.152287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 13:23:09.152287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 13:23:09.152287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 13:23:09.152287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 13:23:09.152287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 13:23:09.152287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application conn.query(q) Jun 02 13:23:09.152287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 13:23:09.152287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 13:23:09.152287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 13:23:09.152287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application result.read() Jun 02 13:23:09.152287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 13:23:09.152287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 13:23:09.152287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 13:23:09.152287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 13:23:09.154243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 13:23:09.154243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 13:23:09.154243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 13:23:09.154243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 13:23:09.154243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 13:23:09.154243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 02 13:23:09.154243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [parameters: {'id': '21e048f48efc47a5aaca9dc203b8d2bc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 02 13:23:09.154243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 13:23:09.154243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:09.154243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:23:09.154243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:09.154243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:09.154243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:09.154243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:09.154243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:09.154243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:09.155305 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:09.155305 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:09.155305 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:09.155305 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:09.155305 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:09.155305 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:09.155305 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 02 13:23:09.155305 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 02 13:23:09.155305 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:09.155305 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:09.155305 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 02 13:23:09.155305 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 02 13:23:09.155305 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 13:23:09.155305 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 13:23:09.155305 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 02 13:23:09.155305 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:09.158026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 241/477] 10.222.0.32 () {60 vars in 1131 bytes} [Thu Jun 2 13:23:08 2022] POST /identity/v3/roles => generated 144 bytes in 235 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:09.164115 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecc573-5db0-4680-b182-95c09c903a97 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:09.175424 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:09.246158 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a104010-dfda-4210-afe2-da0598f94440 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:09.282760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241d8f4-953c-4dbd-905f-205124d7bdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:09.283573 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:09.283819 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241d8f4-953c-4dbd-905f-205124d7bdbd None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:09.284250 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241d8f4-953c-4dbd-905f-205124d7bdbd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:09.284711 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241d8f4-953c-4dbd-905f-205124d7bdbd None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:09.285876 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241d8f4-953c-4dbd-905f-205124d7bdbd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:09.287776 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241d8f4-953c-4dbd-905f-205124d7bdbd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:09.295755 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecc573-5db0-4680-b182-95c09c903a97 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:09.310058 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 237/478] 10.222.0.32 () {60 vars in 1132 bytes} [Thu Jun 2 13:23:09 2022] POST /identity/v3/users => generated 249 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:23:09.351415 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce447d3c-c473-4504-b3a1-fa153c3e2d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:09.352721 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce447d3c-c473-4504-b3a1-fa153c3e2d72 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:09.353244 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce447d3c-c473-4504-b3a1-fa153c3e2d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:09.353720 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce447d3c-c473-4504-b3a1-fa153c3e2d72 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:09.368287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce447d3c-c473-4504-b3a1-fa153c3e2d72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:09.378240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-ce447d3c-c473-4504-b3a1-fa153c3e2d72 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:23:09.378240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:09.378240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:09.378240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:09.378240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:09.378240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:09.378240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:09.378240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:09.378240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:09.378240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:09.378240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:09.378240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:09.378240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:09.378240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:09.378240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:09.378240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:09.379192 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:09.379192 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:09.379192 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:09.379192 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:09.379192 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:09.379192 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:09.379192 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:09.379192 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:09.379192 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:09.379192 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:09.379192 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:09.379192 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:09.379192 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:09.379192 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:09.379192 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:09.379192 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:09.380015 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:09.380015 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:09.380015 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:09.380015 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:09.380015 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:09.380015 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:09.380015 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:09.380015 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:09.380015 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:09.380015 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:09.380015 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:23:09.380015 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:09.383994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 242/479] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Jun 2 13:23:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:23:09.390177 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241d8f4-953c-4dbd-905f-205124d7bdbd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:09.510101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241d8f4-953c-4dbd-905f-205124d7bdbd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:09.513829 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:09.550022 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d03aba-ed3a-4fee-8112-1f33997090bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:09.551039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d03aba-ed3a-4fee-8112-1f33997090bc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:09.551518 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d03aba-ed3a-4fee-8112-1f33997090bc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:09.551982 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d03aba-ed3a-4fee-8112-1f33997090bc None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:09.552969 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d03aba-ed3a-4fee-8112-1f33997090bc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:09.553489 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d03aba-ed3a-4fee-8112-1f33997090bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:09.555129 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d03aba-ed3a-4fee-8112-1f33997090bc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:09.564855 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 238/480] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:10.902187 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af20fd7-3a3e-4a3e-b9a6-d46d3c3d0318 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:10.902743 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af20fd7-3a3e-4a3e-b9a6-d46d3c3d0318 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:10.902743 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af20fd7-3a3e-4a3e-b9a6-d46d3c3d0318 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:10.904344 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 243/481] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:10.909960 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab3087-7ff7-4675-80c9-8104ec396dd4 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:10.910393 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab3087-7ff7-4675-80c9-8104ec396dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:10.910570 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab3087-7ff7-4675-80c9-8104ec396dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:10.934107 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3fab3087-7ff7-4675-80c9-8104ec396dd4 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:10.935313 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3fab3087-7ff7-4675-80c9-8104ec396dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:11.020327 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 239/482] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:23:11.050566 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af20fd7-3a3e-4a3e-b9a6-d46d3c3d0318 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:11.203344 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af20fd7-3a3e-4a3e-b9a6-d46d3c3d0318 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:11.250074 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b8063-1a37-44a6-8d09-4f0f7ee5f2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:11.251231 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b8063-1a37-44a6-8d09-4f0f7ee5f2de None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:11.251735 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b8063-1a37-44a6-8d09-4f0f7ee5f2de None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:11.252206 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b8063-1a37-44a6-8d09-4f0f7ee5f2de None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:11.269135 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b8063-1a37-44a6-8d09-4f0f7ee5f2de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:11.277728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-275b8063-1a37-44a6-8d09-4f0f7ee5f2de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:11.277728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:11.277728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:11.277728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:11.277728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:11.277728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:11.277728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:11.277728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:11.277728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:11.277728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:11.277728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:11.277728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:11.277728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:11.277728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:11.277728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:11.277728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:11.278625 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:11.278625 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:11.278625 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:11.278625 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:11.278625 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:11.278625 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:11.278625 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:11.278625 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:11.278625 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:11.278625 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:11.278625 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:11.278625 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:11.278625 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:11.278625 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:11.278625 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:11.278625 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:11.279412 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:11.279412 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:11.279412 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:11.279412 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:11.279412 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:11.279412 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:11.279412 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:11.279412 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:11.279412 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:11.279412 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:11.279412 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:11.279412 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:11.281758 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 244/483] 10.222.0.32 () {56 vars in 1102 bytes} [Thu Jun 2 13:23:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:11.287887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab3087-7ff7-4675-80c9-8104ec396dd4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:11.407287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35019089-0f3e-4e12-8893-b89f5a2a1909 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:11.407634 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35019089-0f3e-4e12-8893-b89f5a2a1909 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:11.407860 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35019089-0f3e-4e12-8893-b89f5a2a1909 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:11.409581 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 245/484] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:11.410942 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:11.419537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab3087-7ff7-4675-80c9-8104ec396dd4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:11.437830 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99cbe0-9ffa-432d-b30d-499fdec271fe None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:11.438126 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99cbe0-9ffa-432d-b30d-499fdec271fe None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:11.438475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99cbe0-9ffa-432d-b30d-499fdec271fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:11.460216 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-2a99cbe0-9ffa-432d-b30d-499fdec271fe None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:11.461381 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2a99cbe0-9ffa-432d-b30d-499fdec271fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:11.464355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc19f23-a8d8-431a-b417-08e3a1211134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:11.465041 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc19f23-a8d8-431a-b417-08e3a1211134 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:11.465326 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc19f23-a8d8-431a-b417-08e3a1211134 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:11.465609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc19f23-a8d8-431a-b417-08e3a1211134 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:11.466359 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc19f23-a8d8-431a-b417-08e3a1211134 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:11.466666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc19f23-a8d8-431a-b417-08e3a1211134 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:11.468056 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc19f23-a8d8-431a-b417-08e3a1211134 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:11.471159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:11.478237 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 240/485] 10.222.0.32 () {56 vars in 1103 bytes} [Thu Jun 2 13:23:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:11.483893 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc19f23-a8d8-431a-b417-08e3a1211134 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:11.595131 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc19f23-a8d8-431a-b417-08e3a1211134 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:11.632601 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 246/486] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:23:11.641544 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a3a71-fb0d-4d71-93cc-ac8dadde1032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:11.642354 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a3a71-fb0d-4d71-93cc-ac8dadde1032 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:11.642638 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a3a71-fb0d-4d71-93cc-ac8dadde1032 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:11.642914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a3a71-fb0d-4d71-93cc-ac8dadde1032 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:11.655863 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a3a71-fb0d-4d71-93cc-ac8dadde1032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:11.656614 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99cbe0-9ffa-432d-b30d-499fdec271fe None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:11.657395 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a3a71-fb0d-4d71-93cc-ac8dadde1032 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:11.682991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-491a3a71-fb0d-4d71-93cc-ac8dadde1032 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:11.682991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:11.682991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:11.682991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:11.682991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:11.682991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:11.682991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:11.682991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:11.682991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:11.682991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:11.682991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:11.682991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:11.682991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:11.682991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:11.682991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:11.683881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:11.683881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:11.683881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:11.683881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:11.683881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:11.683881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:11.683881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:11.683881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:11.683881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:11.683881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:11.683881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:11.683881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:11.683881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:11.683881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:11.683881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:11.683881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:11.683881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:11.684782 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:11.684782 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:11.684782 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:11.684782 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:11.688812 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 241/487] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:11.690713 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a3a71-fb0d-4d71-93cc-ac8dadde1032 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:11.849112 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99cbe0-9ffa-432d-b30d-499fdec271fe None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:11.920875 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:11.938709 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56085f-79a3-42f5-af28-0d48a19db597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:11.939512 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56085f-79a3-42f5-af28-0d48a19db597 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:11.939793 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56085f-79a3-42f5-af28-0d48a19db597 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:11.940066 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56085f-79a3-42f5-af28-0d48a19db597 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:11.964950 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56085f-79a3-42f5-af28-0d48a19db597 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:11.973943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-8d56085f-79a3-42f5-af28-0d48a19db597 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:11.973943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:11.973943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:11.973943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:11.973943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:11.973943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:11.973943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:11.973943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:11.973943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:11.973943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:11.973943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:11.973943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:11.973943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:11.973943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:11.973943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:11.973943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:11.974894 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:11.974894 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:11.974894 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:11.974894 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:11.974894 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:11.974894 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:11.974894 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:11.974894 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:11.974894 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:11.974894 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:11.974894 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:11.974894 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:11.974894 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:11.974894 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:11.974894 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:11.974894 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:11.975722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:11.975722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:11.975722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:11.975722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:11.975722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:11.975722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:11.975722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:11.975722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:11.975722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:11.975722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:11.975722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:11.975722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:11.975722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 247/488] 10.222.0.32 () {56 vars in 1102 bytes} [Thu Jun 2 13:23:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:23:11.976924 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9f202-cb01-4f11-a636-1b7901f71aea None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:11.977079 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9f202-cb01-4f11-a636-1b7901f71aea None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:11.977221 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9f202-cb01-4f11-a636-1b7901f71aea None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:11.979072 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 248/489] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:11.984735 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b24311-61cb-4454-bcb4-ac4df3c6b5d2 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:11.985139 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b24311-61cb-4454-bcb4-ac4df3c6b5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:11.985418 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b24311-61cb-4454-bcb4-ac4df3c6b5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:11.990860 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:12.005168 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-02b24311-61cb-4454-bcb4-ac4df3c6b5d2 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:12.006401 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-02b24311-61cb-4454-bcb4-ac4df3c6b5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:12.048079 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a3a71-fb0d-4d71-93cc-ac8dadde1032 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:12.083085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f3263-6731-4e98-9dfb-3d335a8048d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:12.083740 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f3263-6731-4e98-9dfb-3d335a8048d4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:12.084021 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f3263-6731-4e98-9dfb-3d335a8048d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:12.084291 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f3263-6731-4e98-9dfb-3d335a8048d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:12.084834 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 249/490] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:23:12.085756 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b24311-61cb-4454-bcb4-ac4df3c6b5d2 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:12.093310 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f3263-6731-4e98-9dfb-3d335a8048d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:12.093670 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f3263-6731-4e98-9dfb-3d335a8048d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:12.095070 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f3263-6731-4e98-9dfb-3d335a8048d4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:12.115979 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 242/491] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:12.121005 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f3263-6731-4e98-9dfb-3d335a8048d4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:12.193719 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b24311-61cb-4454-bcb4-ac4df3c6b5d2 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:12.198393 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:12.228893 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:12.234085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f3263-6731-4e98-9dfb-3d335a8048d4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:12.237101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e18bc-e6c4-4c4c-8c34-aa8274dfd919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:12.237945 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e18bc-e6c4-4c4c-8c34-aa8274dfd919 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:12.238388 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e18bc-e6c4-4c4c-8c34-aa8274dfd919 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:12.238804 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e18bc-e6c4-4c4c-8c34-aa8274dfd919 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:12.239706 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e18bc-e6c4-4c4c-8c34-aa8274dfd919 None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:12.240170 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e18bc-e6c4-4c4c-8c34-aa8274dfd919 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:12.241733 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e18bc-e6c4-4c4c-8c34-aa8274dfd919 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:12.251593 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 250/492] 10.222.0.32 () {56 vars in 1103 bytes} [Thu Jun 2 13:23:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:12.252753 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e18bc-e6c4-4c4c-8c34-aa8274dfd919 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:12.276283 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c47a3d-d00f-4e81-8f36-9a9b98001508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:12.277122 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c47a3d-d00f-4e81-8f36-9a9b98001508 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:12.277408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c47a3d-d00f-4e81-8f36-9a9b98001508 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:12.277681 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c47a3d-d00f-4e81-8f36-9a9b98001508 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:12.287465 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c47a3d-d00f-4e81-8f36-9a9b98001508 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:12.289148 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c47a3d-d00f-4e81-8f36-9a9b98001508 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:12.307434 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-80c47a3d-d00f-4e81-8f36-9a9b98001508 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:23:12.307434 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:12.307434 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:12.307434 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:12.307434 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:12.307434 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:12.307434 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:12.307434 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:12.307434 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:12.307434 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:12.307434 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:12.307434 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:12.307434 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:23:12.307434 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:23:12.307434 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:23:12.307434 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:23:12.308696 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:12.308696 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:12.308696 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:23:12.308696 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:12.308696 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:23:12.308696 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:12.308696 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:12.308696 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:12.308696 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:12.308696 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:12.308696 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:12.308696 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:12.308696 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:12.308696 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:12.308696 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:12.308696 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:12.308696 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:12.308696 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:12.309669 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:12.309669 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:12.309669 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:23:12.309669 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:23:12.309669 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:23:12.309669 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:23:12.309669 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:23:12.309669 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:23:12.309669 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:23:12.309669 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:12.314439 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 243/493] 10.222.0.32 () {56 vars in 1093 bytes} [Thu Jun 2 13:23:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:12.315532 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c47a3d-d00f-4e81-8f36-9a9b98001508 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:12.369847 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e18bc-e6c4-4c4c-8c34-aa8274dfd919 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:12.407543 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de8e81-bf36-4090-b57c-cb1d8ebd5da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:12.408398 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de8e81-bf36-4090-b57c-cb1d8ebd5da6 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:12.408682 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de8e81-bf36-4090-b57c-cb1d8ebd5da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:12.409468 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de8e81-bf36-4090-b57c-cb1d8ebd5da6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:12.421181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c47a3d-d00f-4e81-8f36-9a9b98001508 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:12.423005 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de8e81-bf36-4090-b57c-cb1d8ebd5da6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:12.433529 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-a1de8e81-bf36-4090-b57c-cb1d8ebd5da6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:12.433529 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:12.433529 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:12.433529 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:12.433529 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:12.433529 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:12.433529 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:12.433529 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:12.433529 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:12.433529 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:12.433529 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:12.433529 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:12.433529 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:12.433529 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:12.433529 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:12.433529 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:12.434397 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:12.434397 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:12.434397 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:12.434397 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:12.434397 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:12.434397 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:12.434397 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:12.434397 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:12.434397 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:12.434397 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:12.434397 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:12.434397 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:12.434397 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:12.434397 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:12.434397 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:12.434397 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:12.435186 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:12.435186 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:12.435186 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:12.435186 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:12.435186 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:12.435186 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:12.435186 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:12.435186 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:12.435186 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:12.435186 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:12.435186 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:12.435186 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:12.441139 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 251/494] 10.222.0.32 () {56 vars in 1102 bytes} [Thu Jun 2 13:23:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:12.441139 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de8e81-bf36-4090-b57c-cb1d8ebd5da6 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:12.451957 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:12.462137 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2556a3-d7b6-43f9-bcb7-4ad32c431004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:12.463490 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2556a3-d7b6-43f9-bcb7-4ad32c431004 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:12.463773 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2556a3-d7b6-43f9-bcb7-4ad32c431004 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:12.464043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2556a3-d7b6-43f9-bcb7-4ad32c431004 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:12.475120 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2556a3-d7b6-43f9-bcb7-4ad32c431004 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:12.476605 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2556a3-d7b6-43f9-bcb7-4ad32c431004 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:12.493560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-6e2556a3-d7b6-43f9-bcb7-4ad32c431004 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:12.493560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:12.493560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:12.493560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:12.493560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:12.493560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:12.493560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:12.493560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:12.493560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:12.493560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:12.493560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:12.493560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:12.493560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:12.493560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:12.493560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:12.494475 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:12.494475 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:12.494475 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:12.494475 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:12.494475 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:12.494475 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:12.494475 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:12.494475 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:12.494475 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:12.494475 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:12.494475 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:12.494475 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:12.494475 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:12.494475 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:12.494475 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:12.494475 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:12.494475 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:12.495931 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:12.495931 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:12.495931 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:12.495931 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:12.495931 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 244/495] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:12.496362 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b53775-93df-4725-b64d-d244e55023ec None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:12.496662 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b53775-93df-4725-b64d-d244e55023ec None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:12.496867 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b53775-93df-4725-b64d-d244e55023ec None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:12.498262 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 245/496] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:12.501066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b53775-93df-4725-b64d-d244e55023ec None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:12.508211 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:12.562649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de8e81-bf36-4090-b57c-cb1d8ebd5da6 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:12.603059 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc0e51-0991-4568-9039-845eeddf2083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:12.603970 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc0e51-0991-4568-9039-845eeddf2083 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:12.604644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc0e51-0991-4568-9039-845eeddf2083 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:12.604946 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc0e51-0991-4568-9039-845eeddf2083 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:12.606059 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc0e51-0991-4568-9039-845eeddf2083 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:12.606372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc0e51-0991-4568-9039-845eeddf2083 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:12.608458 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc0e51-0991-4568-9039-845eeddf2083 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:12.611009 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b53775-93df-4725-b64d-d244e55023ec None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:12.645915 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14cb05-bd0a-41ed-b658-93f3d394a1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:12.646505 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14cb05-bd0a-41ed-b658-93f3d394a1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:12.646790 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14cb05-bd0a-41ed-b658-93f3d394a1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:12.647071 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14cb05-bd0a-41ed-b658-93f3d394a1c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:12.647822 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14cb05-bd0a-41ed-b658-93f3d394a1c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:12.648134 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14cb05-bd0a-41ed-b658-93f3d394a1c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:12.648353 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 252/497] 10.222.0.32 () {56 vars in 1133 bytes} [Thu Jun 2 13:23:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:12.649189 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc0e51-0991-4568-9039-845eeddf2083 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:12.649586 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14cb05-bd0a-41ed-b658-93f3d394a1c7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:12.658327 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 246/498] 10.222.0.32 () {56 vars in 1103 bytes} [Thu Jun 2 13:23:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:12.659773 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95a3f1-388e-43c6-8e33-018b62f69297 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:12.660061 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95a3f1-388e-43c6-8e33-018b62f69297 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:12.660374 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95a3f1-388e-43c6-8e33-018b62f69297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:12.676887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3f95a3f1-388e-43c6-8e33-018b62f69297 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:12.678117 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3f95a3f1-388e-43c6-8e33-018b62f69297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:12.718888 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:12.746164 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 247/499] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:23:12.747482 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d516bc-616a-4666-b1c2-fd9f26081e5d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:12.747862 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d516bc-616a-4666-b1c2-fd9f26081e5d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:12.748051 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d516bc-616a-4666-b1c2-fd9f26081e5d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:12.749604 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 248/500] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:12.750322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d516bc-616a-4666-b1c2-fd9f26081e5d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:12.759861 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc0e51-0991-4568-9039-845eeddf2083 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:12.776078 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:12.797327 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38379c6-7a6d-4db3-845e-db475180a8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:12.797986 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38379c6-7a6d-4db3-845e-db475180a8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:12.798265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38379c6-7a6d-4db3-845e-db475180a8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:12.798541 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38379c6-7a6d-4db3-845e-db475180a8a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:12.799260 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38379c6-7a6d-4db3-845e-db475180a8a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:12.799562 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38379c6-7a6d-4db3-845e-db475180a8a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:12.800993 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38379c6-7a6d-4db3-845e-db475180a8a5 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:12.812424 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 253/501] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:12.813197 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38379c6-7a6d-4db3-845e-db475180a8a5 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:12.852355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d516bc-616a-4666-b1c2-fd9f26081e5d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:12.886966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e274883-0038-4c26-a7a1-ec92ee13bb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:12.887608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e274883-0038-4c26-a7a1-ec92ee13bb87 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:12.887890 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e274883-0038-4c26-a7a1-ec92ee13bb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:12.888167 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e274883-0038-4c26-a7a1-ec92ee13bb87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:12.908859 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38379c6-7a6d-4db3-845e-db475180a8a5 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:12.929779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:12.941814 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fa9be-d9ce-4820-9370-a3f0ea29294e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:12.942600 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fa9be-d9ce-4820-9370-a3f0ea29294e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:12.942885 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fa9be-d9ce-4820-9370-a3f0ea29294e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:12.943162 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fa9be-d9ce-4820-9370-a3f0ea29294e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:12.954771 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77fa9be-d9ce-4820-9370-a3f0ea29294e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:12.955722 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e274883-0038-4c26-a7a1-ec92ee13bb87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:12.956208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77fa9be-d9ce-4820-9370-a3f0ea29294e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:12.957206 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e274883-0038-4c26-a7a1-ec92ee13bb87 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:12.973176 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-b77fa9be-d9ce-4820-9370-a3f0ea29294e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:12.973176 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:12.973176 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:12.973176 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:12.973176 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:12.973176 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:12.973176 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:12.973176 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:12.973176 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:12.973176 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:12.973176 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:12.973176 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:12.973176 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:12.973176 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:12.973176 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:12.974047 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:12.974047 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:12.974047 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:12.974047 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:12.974047 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:12.974047 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:12.974047 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:12.974047 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:12.974047 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:12.974047 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:12.974047 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:12.974047 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:12.974047 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:12.974047 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:12.974047 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:12.974047 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:12.974047 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:12.974881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:12.974881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:12.974881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:12.974881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:12.974881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 254/502] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:12.975729 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485965f5-3698-4091-b623-e07d7ccb6678 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:12.975985 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485965f5-3698-4091-b623-e07d7ccb6678 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:12.976268 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485965f5-3698-4091-b623-e07d7ccb6678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:12.993635 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-485965f5-3698-4091-b623-e07d7ccb6678 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:12.995305 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-485965f5-3698-4091-b623-e07d7ccb6678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:13.012968 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:13.057154 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 249/503] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:23:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:13.061972 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 255/504] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:23:13.062164 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e274883-0038-4c26-a7a1-ec92ee13bb87 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:13.062795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485965f5-3698-4091-b623-e07d7ccb6678 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:13.149368 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:13.164990 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485965f5-3698-4091-b623-e07d7ccb6678 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:13.175049 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e274883-0038-4c26-a7a1-ec92ee13bb87 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:13.198601 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3a29d-c81c-4b48-9ce4-3b15d751e836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:13.199375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3a29d-c81c-4b48-9ce4-3b15d751e836 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:13.199658 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3a29d-c81c-4b48-9ce4-3b15d751e836 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:13.199930 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3a29d-c81c-4b48-9ce4-3b15d751e836 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:13.206903 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3a29d-c81c-4b48-9ce4-3b15d751e836 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:13.208152 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3426f18-ead4-4fb2-87fb-0b3e505ba4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:13.208414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3a29d-c81c-4b48-9ce4-3b15d751e836 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:13.208966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3426f18-ead4-4fb2-87fb-0b3e505ba4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:13.209250 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3426f18-ead4-4fb2-87fb-0b3e505ba4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:13.209526 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3426f18-ead4-4fb2-87fb-0b3e505ba4c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:13.219729 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3426f18-ead4-4fb2-87fb-0b3e505ba4c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:13.224324 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-a7c3a29d-c81c-4b48-9ce4-3b15d751e836 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:23:13.224324 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:13.224324 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:13.224324 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:13.224324 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:13.224324 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:13.224324 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:13.224324 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:13.224324 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:13.224324 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:13.224324 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:13.224324 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:13.224324 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:23:13.224324 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:23:13.224324 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:23:13.224324 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:23:13.225291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:13.225291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:13.225291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:23:13.225291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:13.225291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:23:13.225291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:13.225291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:13.225291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:13.225291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:13.225291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:13.225291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:13.225291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:13.225291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:13.225291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:13.225291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:13.225291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:13.225291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:13.225291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:13.232029 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:13.232029 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:13.232029 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:23:13.232029 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:23:13.232029 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:23:13.232029 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:23:13.232029 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:23:13.232029 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:23:13.232029 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:23:13.232029 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:13.232029 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 256/505] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:23:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:13.232029 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3a29d-c81c-4b48-9ce4-3b15d751e836 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:13.232705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e3426f18-ead4-4fb2-87fb-0b3e505ba4c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:13.232705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:13.232705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:13.232705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:13.232705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:13.232705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:13.232705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:13.232705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:13.232705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:13.232705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:13.232705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:13.232705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:13.232705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:13.232705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:13.232705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:13.232705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:13.233845 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:13.233845 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:13.233845 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:13.233845 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:13.233845 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:13.233845 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:13.233845 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:13.233845 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:13.233845 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:13.233845 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:13.233845 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:13.233845 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:13.233845 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:13.233845 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:13.233845 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:13.233845 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:13.234658 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:13.234658 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:13.234658 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:13.234658 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:13.234658 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:13.234658 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:13.234658 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:13.234658 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:13.234658 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:13.234658 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:13.234658 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:13.234658 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:13.234658 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 250/506] 10.222.0.32 () {56 vars in 1102 bytes} [Thu Jun 2 13:23:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:13.234658 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3426f18-ead4-4fb2-87fb-0b3e505ba4c6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:13.243232 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:13.326000 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3a29d-c81c-4b48-9ce4-3b15d751e836 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:13.333576 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3426f18-ead4-4fb2-87fb-0b3e505ba4c6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:13.359890 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d174f6-078d-48e9-b632-b8947d91cddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:13.360568 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d174f6-078d-48e9-b632-b8947d91cddb None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:13.360853 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d174f6-078d-48e9-b632-b8947d91cddb None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:13.361138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d174f6-078d-48e9-b632-b8947d91cddb None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:13.361860 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d174f6-078d-48e9-b632-b8947d91cddb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:13.362172 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d174f6-078d-48e9-b632-b8947d91cddb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:13.363558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d174f6-078d-48e9-b632-b8947d91cddb None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:13.367452 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f6260-2e48-4aae-88ca-d8636d3d6a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:13.368235 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f6260-2e48-4aae-88ca-d8636d3d6a00 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:13.368548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f6260-2e48-4aae-88ca-d8636d3d6a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:13.368828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f6260-2e48-4aae-88ca-d8636d3d6a00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:13.370720 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:13.374652 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 257/507] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:13.375435 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d174f6-078d-48e9-b632-b8947d91cddb None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:13.380416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f6260-2e48-4aae-88ca-d8636d3d6a00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:13.381874 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f6260-2e48-4aae-88ca-d8636d3d6a00 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:13.398741 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-0b3f6260-2e48-4aae-88ca-d8636d3d6a00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:13.398741 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:13.398741 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:13.398741 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:13.398741 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:13.398741 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:13.398741 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:13.398741 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:13.398741 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:13.398741 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:13.398741 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:13.398741 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:13.398741 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:13.398741 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:13.398741 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:13.399608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:13.399608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:13.399608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:13.399608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:13.399608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:13.399608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:13.399608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:13.399608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:13.399608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:13.399608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:13.399608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:13.399608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:13.399608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:13.399608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:13.399608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:13.399608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:13.399608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:13.401031 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:13.401031 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:13.401031 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:13.401031 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:13.401031 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 251/508] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:13.401303 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f6260-2e48-4aae-88ca-d8636d3d6a00 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:13.454300 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:13.479733 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d174f6-078d-48e9-b632-b8947d91cddb None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:13.498776 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f6260-2e48-4aae-88ca-d8636d3d6a00 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:13.515212 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bf25c-3643-4ce3-ab40-4e6df846321c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:13.515991 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bf25c-3643-4ce3-ab40-4e6df846321c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:13.516271 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bf25c-3643-4ce3-ab40-4e6df846321c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:13.516573 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bf25c-3643-4ce3-ab40-4e6df846321c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:13.528650 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bf25c-3643-4ce3-ab40-4e6df846321c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:13.530311 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bf25c-3643-4ce3-ab40-4e6df846321c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:13.531933 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543f533-f3f3-497f-b4c0-7e65c11c82a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:13.532624 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543f533-f3f3-497f-b4c0-7e65c11c82a0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:13.532909 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543f533-f3f3-497f-b4c0-7e65c11c82a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:13.533194 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543f533-f3f3-497f-b4c0-7e65c11c82a0 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:13.534027 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543f533-f3f3-497f-b4c0-7e65c11c82a0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:13.534336 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543f533-f3f3-497f-b4c0-7e65c11c82a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:13.535751 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543f533-f3f3-497f-b4c0-7e65c11c82a0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:13.551599 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-8c8bf25c-3643-4ce3-ab40-4e6df846321c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:13.551599 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:13.551599 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:13.551599 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:13.551599 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:13.551599 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:13.551599 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:13.551599 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:13.551599 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:13.551599 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:13.551599 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:13.551599 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:13.551599 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:13.551599 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:13.551599 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:13.552649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:13.552649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:13.552649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:13.552649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:13.552649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:13.552649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:13.552649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:13.552649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:13.552649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:13.552649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:13.552649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:13.552649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:13.552649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:13.552649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:13.552649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:13.552649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:13.552649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:13.553678 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:13.553678 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:13.553678 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:13.553678 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:13.553678 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 258/509] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:13.554170 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bf25c-3643-4ce3-ab40-4e6df846321c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:13.578366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 252/510] 10.222.0.32 () {56 vars in 1137 bytes} [Thu Jun 2 13:23:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:13.579560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543f533-f3f3-497f-b4c0-7e65c11c82a0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:13.625284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:13.667370 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bf25c-3643-4ce3-ab40-4e6df846321c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:13.681699 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543f533-f3f3-497f-b4c0-7e65c11c82a0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:13.691730 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:13.701084 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3f489-52f2-4f1c-bbe3-62b8ea046d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:13.701746 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3f489-52f2-4f1c-bbe3-62b8ea046d1b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:13.702035 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3f489-52f2-4f1c-bbe3-62b8ea046d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:13.702315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3f489-52f2-4f1c-bbe3-62b8ea046d1b None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:13.703067 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3f489-52f2-4f1c-bbe3-62b8ea046d1b None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:13.703377 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3f489-52f2-4f1c-bbe3-62b8ea046d1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:13.704862 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3f489-52f2-4f1c-bbe3-62b8ea046d1b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:13.713857 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 259/511] 10.222.0.32 () {56 vars in 1103 bytes} [Thu Jun 2 13:23:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:13.714644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3f489-52f2-4f1c-bbe3-62b8ea046d1b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:13.716828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92863e9d-646a-4f2b-b6ca-39786c635b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:13.717619 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92863e9d-646a-4f2b-b6ca-39786c635b21 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:13.718621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92863e9d-646a-4f2b-b6ca-39786c635b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:13.718621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92863e9d-646a-4f2b-b6ca-39786c635b21 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:13.725769 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92863e9d-646a-4f2b-b6ca-39786c635b21 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:13.727200 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92863e9d-646a-4f2b-b6ca-39786c635b21 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:13.741499 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-92863e9d-646a-4f2b-b6ca-39786c635b21 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 13:23:13.741499 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:13.741499 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:13.741499 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:13.741499 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:13.741499 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:13.741499 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:13.741499 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:13.741499 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:13.741499 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:13.741499 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:13.741499 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:13.741499 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:23:13.741499 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:23:13.741499 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:23:13.741499 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:23:13.742547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:13.742547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:13.742547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:23:13.742547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:13.742547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:23:13.742547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:13.742547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:13.742547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:13.742547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:13.742547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:13.742547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:13.742547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:13.742547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:13.742547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:13.742547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:13.742547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:13.742547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:13.742547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:13.743627 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:13.743627 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:13.743627 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:23:13.743627 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:23:13.743627 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:23:13.743627 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:23:13.743627 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:23:13.743627 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:23:13.743627 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 13:23:13.743627 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:13.743627 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 253/512] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:23:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:13.743627 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92863e9d-646a-4f2b-b6ca-39786c635b21 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:13.813635 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3f489-52f2-4f1c-bbe3-62b8ea046d1b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:13.842206 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92863e9d-646a-4f2b-b6ca-39786c635b21 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:13.844519 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:13.847238 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f0c2d-db9e-446a-bd49-859d898d2ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:13.847887 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f0c2d-db9e-446a-bd49-859d898d2ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:13.848171 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f0c2d-db9e-446a-bd49-859d898d2ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:13.848498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f0c2d-db9e-446a-bd49-859d898d2ad4 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:13.849224 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f0c2d-db9e-446a-bd49-859d898d2ad4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:13.849529 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f0c2d-db9e-446a-bd49-859d898d2ad4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:13.850892 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f0c2d-db9e-446a-bd49-859d898d2ad4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:13.862216 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 260/513] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:13.862993 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f0c2d-db9e-446a-bd49-859d898d2ad4 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:13.875207 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4c810-9165-4e2c-8098-273a4b33ccc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:13.875865 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4c810-9165-4e2c-8098-273a4b33ccc4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:13.876147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4c810-9165-4e2c-8098-273a4b33ccc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:13.876527 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4c810-9165-4e2c-8098-273a4b33ccc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:13.877267 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4c810-9165-4e2c-8098-273a4b33ccc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:13.877571 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4c810-9165-4e2c-8098-273a4b33ccc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:13.878940 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4c810-9165-4e2c-8098-273a4b33ccc4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:13.890985 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 254/514] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:13.891793 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4c810-9165-4e2c-8098-273a4b33ccc4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:13.913464 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:13.964381 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f0c2d-db9e-446a-bd49-859d898d2ad4 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:13.991405 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4c810-9165-4e2c-8098-273a4b33ccc4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:13.997867 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17fb62-f4ef-488e-a378-27abc662fd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:13.998514 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17fb62-f4ef-488e-a378-27abc662fd85 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:13.998826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17fb62-f4ef-488e-a378-27abc662fd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:13.999110 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17fb62-f4ef-488e-a378-27abc662fd85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:14.032346 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a88324-1147-4abe-a83b-dbab410e71e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:14.033224 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a88324-1147-4abe-a83b-dbab410e71e5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:14.033510 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a88324-1147-4abe-a83b-dbab410e71e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:14.033777 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a88324-1147-4abe-a83b-dbab410e71e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:14.043537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a88324-1147-4abe-a83b-dbab410e71e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:14.045017 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a88324-1147-4abe-a83b-dbab410e71e5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:14.062988 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b2a88324-1147-4abe-a83b-dbab410e71e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:14.062988 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:14.062988 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:14.062988 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:14.062988 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:14.062988 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:14.062988 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:14.062988 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:14.062988 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:14.062988 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:14.062988 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:14.062988 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:14.062988 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:14.062988 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:14.062988 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:14.063966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:14.063966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:14.063966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:14.063966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:14.063966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:14.063966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:14.063966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:14.063966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:14.063966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:14.063966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:14.063966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:14.063966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:14.063966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:14.063966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:14.063966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:14.063966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:14.063966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:14.065134 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:14.065134 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:14.065134 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:14.065134 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:14.065134 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 255/515] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:14.065134 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a88324-1147-4abe-a83b-dbab410e71e5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:14.069159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17fb62-f4ef-488e-a378-27abc662fd85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:14.070635 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17fb62-f4ef-488e-a378-27abc662fd85 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:14.083276 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:14.122185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:14.164352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a88324-1147-4abe-a83b-dbab410e71e5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:14.173473 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 261/516] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:23:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:14.174210 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17fb62-f4ef-488e-a378-27abc662fd85 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:14.202329 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca6b1b-b3a2-46dd-82fc-1a0f2aaa1e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:14.202995 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca6b1b-b3a2-46dd-82fc-1a0f2aaa1e9c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:14.203281 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca6b1b-b3a2-46dd-82fc-1a0f2aaa1e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:14.203565 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca6b1b-b3a2-46dd-82fc-1a0f2aaa1e9c None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:14.204429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca6b1b-b3a2-46dd-82fc-1a0f2aaa1e9c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:14.204741 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca6b1b-b3a2-46dd-82fc-1a0f2aaa1e9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:14.206170 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca6b1b-b3a2-46dd-82fc-1a0f2aaa1e9c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:14.223075 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 256/517] 10.222.0.32 () {56 vars in 1137 bytes} [Thu Jun 2 13:23:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:14.223781 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca6b1b-b3a2-46dd-82fc-1a0f2aaa1e9c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:14.275880 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17fb62-f4ef-488e-a378-27abc662fd85 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:14.297152 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:14.309170 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebe4c9-e8fc-46ba-89d2-f536116e2257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:14.309955 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebe4c9-e8fc-46ba-89d2-f536116e2257 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:14.310243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebe4c9-e8fc-46ba-89d2-f536116e2257 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:14.310530 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebe4c9-e8fc-46ba-89d2-f536116e2257 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:14.317117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaebe4c9-e8fc-46ba-89d2-f536116e2257 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:14.318580 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaebe4c9-e8fc-46ba-89d2-f536116e2257 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:14.322651 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca6b1b-b3a2-46dd-82fc-1a0f2aaa1e9c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:14.333173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-aaebe4c9-e8fc-46ba-89d2-f536116e2257 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:14.333173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:14.333173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:14.333173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:14.333173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:14.333173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:14.333173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:14.333173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:14.333173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:14.333173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:14.333173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:14.333173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:14.333173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:23:14.333173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:23:14.333173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:23:14.334179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:23:14.334179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:14.334179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:14.334179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:14.334179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:14.334179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:14.334179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:14.334179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:14.334179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:14.334179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:14.334179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:14.334179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:14.334179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:14.334179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:14.334179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:14.334179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:14.334179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:14.335486 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:23:14.335486 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:23:14.335486 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:23:14.335486 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:23:14.335486 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:23:14.335486 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:23:14.335486 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:14.335486 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:14.335486 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 262/518] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:14.335486 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebe4c9-e8fc-46ba-89d2-f536116e2257 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:14.345939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:14.358520 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8489bc7-240d-4791-a911-4ec1bad5f846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:14.359188 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8489bc7-240d-4791-a911-4ec1bad5f846 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:14.359474 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8489bc7-240d-4791-a911-4ec1bad5f846 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:14.359754 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8489bc7-240d-4791-a911-4ec1bad5f846 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:14.360517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8489bc7-240d-4791-a911-4ec1bad5f846 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:14.361952 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8489bc7-240d-4791-a911-4ec1bad5f846 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:14.382286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 257/519] 10.222.0.32 () {60 vars in 1132 bytes} [Thu Jun 2 13:23:14 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:23:14.383290 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8489bc7-240d-4791-a911-4ec1bad5f846 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:14.443276 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebe4c9-e8fc-46ba-89d2-f536116e2257 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:14.482879 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856aff82-5b24-4d55-ac4c-0a40cb22023c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:14.483459 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856aff82-5b24-4d55-ac4c-0a40cb22023c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:14.483761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856aff82-5b24-4d55-ac4c-0a40cb22023c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:14.484018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856aff82-5b24-4d55-ac4c-0a40cb22023c None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:14.484789 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856aff82-5b24-4d55-ac4c-0a40cb22023c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:14.485097 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856aff82-5b24-4d55-ac4c-0a40cb22023c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:14.486532 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856aff82-5b24-4d55-ac4c-0a40cb22023c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:14.499219 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8489bc7-240d-4791-a911-4ec1bad5f846 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:14.500207 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 263/520] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:14.500900 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856aff82-5b24-4d55-ac4c-0a40cb22023c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:14.529808 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:14.539081 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f833f-3d76-46c3-bfa1-4f3479ad3841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:14.540068 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f833f-3d76-46c3-bfa1-4f3479ad3841 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:14.540928 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f833f-3d76-46c3-bfa1-4f3479ad3841 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:14.541229 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f833f-3d76-46c3-bfa1-4f3479ad3841 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:14.553247 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f833f-3d76-46c3-bfa1-4f3479ad3841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:14.554786 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f833f-3d76-46c3-bfa1-4f3479ad3841 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:14.575373 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:14.577844 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-722f833f-3d76-46c3-bfa1-4f3479ad3841 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:14.577844 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:14.577844 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:14.577844 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:14.577844 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:14.577844 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:14.577844 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:14.577844 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:14.577844 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:14.577844 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:14.577844 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:14.577844 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:14.577844 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:14.577844 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:14.577844 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:14.579609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:14.579609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:14.579609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:14.579609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:14.579609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:14.579609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:14.579609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:14.579609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:14.579609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:14.579609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:14.579609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:14.579609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:14.579609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:14.579609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:14.579609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:14.579609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:14.579609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:14.580800 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:14.580800 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:14.580800 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:14.580800 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:14.580800 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 258/521] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:14.580800 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f833f-3d76-46c3-bfa1-4f3479ad3841 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:14.618251 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856aff82-5b24-4d55-ac4c-0a40cb22023c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:14.656962 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970260e-ead9-4dd3-b5d1-be0b982043f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:14.657616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970260e-ead9-4dd3-b5d1-be0b982043f8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:14.657905 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970260e-ead9-4dd3-b5d1-be0b982043f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:14.658174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970260e-ead9-4dd3-b5d1-be0b982043f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:14.699265 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f833f-3d76-46c3-bfa1-4f3479ad3841 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:14.733332 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970260e-ead9-4dd3-b5d1-be0b982043f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:14.734710 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970260e-ead9-4dd3-b5d1-be0b982043f8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:14.736055 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4209a-b741-4285-b675-50816688b5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:14.737020 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4209a-b741-4285-b675-50816688b5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:14.738191 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4209a-b741-4285-b675-50816688b5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:14.738482 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4209a-b741-4285-b675-50816688b5e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:14.739287 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4209a-b741-4285-b675-50816688b5e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:14.739603 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4209a-b741-4285-b675-50816688b5e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:14.741062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4209a-b741-4285-b675-50816688b5e4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:14.770838 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 259/522] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:23:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:14.771604 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4209a-b741-4285-b675-50816688b5e4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:14.803151 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:14.819752 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:14.843912 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 264/523] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:23:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:14.845125 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970260e-ead9-4dd3-b5d1-be0b982043f8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:14.884453 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4209a-b741-4285-b675-50816688b5e4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:14.923362 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6b898-26f9-4025-9739-f4b0c621395b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:14.924596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6b898-26f9-4025-9739-f4b0c621395b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:14.924596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6b898-26f9-4025-9739-f4b0c621395b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:14.924805 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6b898-26f9-4025-9739-f4b0c621395b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:14.934823 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e6b898-26f9-4025-9739-f4b0c621395b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:14.937695 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e6b898-26f9-4025-9739-f4b0c621395b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:14.953071 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970260e-ead9-4dd3-b5d1-be0b982043f8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:14.955857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-97e6b898-26f9-4025-9739-f4b0c621395b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 13:23:14.955857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:14.955857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:14.955857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:14.955857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:14.955857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:14.955857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:14.955857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:14.955857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:14.955857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:14.955857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:14.955857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:14.955857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:23:14.955857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:23:14.955857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:23:14.955857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:23:14.956957 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:14.956957 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:14.956957 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:23:14.956957 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:14.956957 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:23:14.956957 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:14.956957 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:14.956957 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:14.956957 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:14.956957 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:14.956957 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:14.956957 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:14.956957 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:14.956957 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:14.956957 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:14.956957 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:14.956957 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:14.956957 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:14.957925 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:14.957925 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:14.957925 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:23:14.957925 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:23:14.957925 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:23:14.957925 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:23:14.957925 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:23:14.957925 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:23:14.957925 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 13:23:14.957925 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:14.957925 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 260/524] 10.222.0.32 () {56 vars in 1102 bytes} [Thu Jun 2 13:23:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:14.958468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6b898-26f9-4025-9739-f4b0c621395b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:14.991959 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18f073-0e64-4dea-ab87-014b66168432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:14.992638 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18f073-0e64-4dea-ab87-014b66168432 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:14.992843 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18f073-0e64-4dea-ab87-014b66168432 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:14.993119 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18f073-0e64-4dea-ab87-014b66168432 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:14.993877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18f073-0e64-4dea-ab87-014b66168432 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:14.994176 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18f073-0e64-4dea-ab87-014b66168432 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:14.995561 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18f073-0e64-4dea-ab87-014b66168432 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:15.013839 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 265/525] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:15.013839 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18f073-0e64-4dea-ab87-014b66168432 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:15.045873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:15.076827 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6b898-26f9-4025-9739-f4b0c621395b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:15.078482 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:15.117306 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721dd879-dce2-4e88-b7e7-8bd94a432f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:15.117987 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dd879-dce2-4e88-b7e7-8bd94a432f66 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:15.118271 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dd879-dce2-4e88-b7e7-8bd94a432f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:15.119085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dd879-dce2-4e88-b7e7-8bd94a432f66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:15.119948 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721dd879-dce2-4e88-b7e7-8bd94a432f66 None admin] RBAC: Adding query filter params (role.id=a12865c9fb9e4fa0b61e4adfd53188fb, scope.project.id=a9007447059e4862972078c032a5d67b, user.id=b2e5d9f3c4e04ca3bf52b28b67d2a4d6) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:15.120264 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721dd879-dce2-4e88-b7e7-8bd94a432f66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:15.121795 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721dd879-dce2-4e88-b7e7-8bd94a432f66 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:15.136857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 261/526] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:23:14 2022] GET /identity/v3/role_assignments?user.id=b2e5d9f3c4e04ca3bf52b28b67d2a4d6&scope.project.id=a9007447059e4862972078c032a5d67b&role.id=a12865c9fb9e4fa0b61e4adfd53188fb => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:15.136857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721dd879-dce2-4e88-b7e7-8bd94a432f66 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:15.249601 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18f073-0e64-4dea-ab87-014b66168432 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:15.260002 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721dd879-dce2-4e88-b7e7-8bd94a432f66 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:15.292883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb3f84-1dd8-4df7-8534-0b08a3de5b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:15.294498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb3f84-1dd8-4df7-8534-0b08a3de5b85 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:15.294782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb3f84-1dd8-4df7-8534-0b08a3de5b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:15.295059 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb3f84-1dd8-4df7-8534-0b08a3de5b85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:15.309985 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb3f84-1dd8-4df7-8534-0b08a3de5b85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:15.311471 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb3f84-1dd8-4df7-8534-0b08a3de5b85 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:15.314491 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15029f63-6aca-486e-991e-314d35bc2272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:15.315470 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15029f63-6aca-486e-991e-314d35bc2272 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:15.316068 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15029f63-6aca-486e-991e-314d35bc2272 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:15.316598 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15029f63-6aca-486e-991e-314d35bc2272 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:15.317712 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15029f63-6aca-486e-991e-314d35bc2272 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:15.318253 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15029f63-6aca-486e-991e-314d35bc2272 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:15.320083 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15029f63-6aca-486e-991e-314d35bc2272 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:15.331532 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-dffb3f84-1dd8-4df7-8534-0b08a3de5b85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:15.331532 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:15.331532 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:15.331532 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:15.331532 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:15.331532 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:15.331532 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:15.331532 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:15.331532 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:15.331532 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:15.331532 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:15.331532 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:15.331532 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:15.331532 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:15.331532 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:15.332524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:15.332524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:15.332524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:15.332524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:15.332524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:15.332524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:15.332524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:15.332524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:15.332524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:15.332524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:15.332524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:15.332524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:15.332524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:15.332524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:15.332524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:15.332524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:15.332524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:15.333377 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:15.333377 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:15.333377 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:15.333377 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:15.337403 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 266/527] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:15.338429 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb3f84-1dd8-4df7-8534-0b08a3de5b85 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:15.345227 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 262/528] 10.222.0.32 () {56 vars in 1139 bytes} [Thu Jun 2 13:23:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:15.346500 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15029f63-6aca-486e-991e-314d35bc2272 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:15.378469 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:15.458367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:15.465850 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15029f63-6aca-486e-991e-314d35bc2272 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:15.491834 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb3f84-1dd8-4df7-8534-0b08a3de5b85 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:15.512343 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7b8d1-d159-4148-a131-7c2fd869ed5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:15.513128 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7b8d1-d159-4148-a131-7c2fd869ed5c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:15.513347 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7b8d1-d159-4148-a131-7c2fd869ed5c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:15.513635 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7b8d1-d159-4148-a131-7c2fd869ed5c None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:15.514365 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7b8d1-d159-4148-a131-7c2fd869ed5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:15.514710 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7b8d1-d159-4148-a131-7c2fd869ed5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:15.516225 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7b8d1-d159-4148-a131-7c2fd869ed5c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:15.534144 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 263/529] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:15.535211 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7b8d1-d159-4148-a131-7c2fd869ed5c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:15.538339 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef656d82-fb6e-44e3-b823-469c3a0323ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:15.541149 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef656d82-fb6e-44e3-b823-469c3a0323ee None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:15.541679 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef656d82-fb6e-44e3-b823-469c3a0323ee None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:15.542156 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef656d82-fb6e-44e3-b823-469c3a0323ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:15.552850 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef656d82-fb6e-44e3-b823-469c3a0323ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:15.555627 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef656d82-fb6e-44e3-b823-469c3a0323ee None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:15.576372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-ef656d82-fb6e-44e3-b823-469c3a0323ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:15.576372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:15.576372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:15.576372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:15.576372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:15.576372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:15.576372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:15.576372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:15.576372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:15.576372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:15.576372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:15.576372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:15.576372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:23:15.576372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:23:15.576372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:23:15.577515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:23:15.577515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:15.577515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:15.577515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:15.577515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:15.577515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:15.577515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:15.577515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:15.577515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:15.577515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:15.577515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:15.577515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:15.577515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:15.577515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:15.577515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:15.577515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:15.577515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:15.578357 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:23:15.578357 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:23:15.578357 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:23:15.578357 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:23:15.578357 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:23:15.578357 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:23:15.578357 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:15.578357 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:15.581186 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 267/530] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:15.582182 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef656d82-fb6e-44e3-b823-469c3a0323ee None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:15.652682 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:15.672047 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7b8d1-d159-4148-a131-7c2fd869ed5c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:15.707977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef656d82-fb6e-44e3-b823-469c3a0323ee None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:15.722147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80e85c-f6bb-40c4-a700-e2af55af4ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:15.723616 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80e85c-f6bb-40c4-a700-e2af55af4ced None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:15.724399 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80e85c-f6bb-40c4-a700-e2af55af4ced None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:15.724877 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80e85c-f6bb-40c4-a700-e2af55af4ced None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:15.744399 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15959a-9125-40f1-9db3-cd14760498f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:15.745416 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15959a-9125-40f1-9db3-cd14760498f7 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:15.745771 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15959a-9125-40f1-9db3-cd14760498f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:15.746115 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15959a-9125-40f1-9db3-cd14760498f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:15.754591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15959a-9125-40f1-9db3-cd14760498f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:15.756481 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15959a-9125-40f1-9db3-cd14760498f7 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:15.760116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:15.775971 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-eb15959a-9125-40f1-9db3-cd14760498f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:15.775971 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:15.775971 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:15.775971 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:15.775971 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:15.775971 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:15.775971 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:15.775971 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:15.775971 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:15.775971 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:15.775971 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:15.775971 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:15.775971 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:23:15.775971 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:23:15.775971 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:23:15.776877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:23:15.776877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:15.776877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:15.776877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:15.776877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:15.776877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:15.776877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:15.776877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:15.776877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:15.776877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:15.776877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:15.776877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:15.776877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:15.776877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:15.776877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:15.776877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:15.776877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:15.777708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:23:15.777708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:23:15.777708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:23:15.777708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:23:15.777708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:23:15.777708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:23:15.777708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:15.777708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:15.777708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 268/531] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:15.778165 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15959a-9125-40f1-9db3-cd14760498f7 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:15.822463 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80e85c-f6bb-40c4-a700-e2af55af4ced None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:15.824007 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80e85c-f6bb-40c4-a700-e2af55af4ced None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:15.910744 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:15.913997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15959a-9125-40f1-9db3-cd14760498f7 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:15.930126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 264/532] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:23:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:15.931059 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80e85c-f6bb-40c4-a700-e2af55af4ced None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:15.954034 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44abb0-d4fc-44fd-84ce-30652b323426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:15.954988 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44abb0-d4fc-44fd-84ce-30652b323426 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:15.955454 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44abb0-d4fc-44fd-84ce-30652b323426 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:15.955934 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44abb0-d4fc-44fd-84ce-30652b323426 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:15.956948 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44abb0-d4fc-44fd-84ce-30652b323426 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:15.957572 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44abb0-d4fc-44fd-84ce-30652b323426 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:15.959230 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44abb0-d4fc-44fd-84ce-30652b323426 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:15.978649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 269/533] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:23:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:15.979803 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44abb0-d4fc-44fd-84ce-30652b323426 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:16.036492 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80e85c-f6bb-40c4-a700-e2af55af4ced None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:16.043250 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:16.072444 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997a834-b5c6-4bdf-9a1e-75421a300d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:16.073110 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997a834-b5c6-4bdf-9a1e-75421a300d73 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:16.073393 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997a834-b5c6-4bdf-9a1e-75421a300d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:16.073708 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997a834-b5c6-4bdf-9a1e-75421a300d73 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:16.074540 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6997a834-b5c6-4bdf-9a1e-75421a300d73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:16.074963 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6997a834-b5c6-4bdf-9a1e-75421a300d73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:16.076432 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6997a834-b5c6-4bdf-9a1e-75421a300d73 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:16.087044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44abb0-d4fc-44fd-84ce-30652b323426 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:16.090057 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 265/534] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:23:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:16.090889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997a834-b5c6-4bdf-9a1e-75421a300d73 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:16.122898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02ae5e-0721-4135-adc3-a201fed33838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:16.123692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02ae5e-0721-4135-adc3-a201fed33838 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:16.123982 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02ae5e-0721-4135-adc3-a201fed33838 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:16.124258 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02ae5e-0721-4135-adc3-a201fed33838 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:16.135751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02ae5e-0721-4135-adc3-a201fed33838 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:16.137262 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02ae5e-0721-4135-adc3-a201fed33838 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:16.140576 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:16.155457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-cd02ae5e-0721-4135-adc3-a201fed33838 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:16.155457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:16.155457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:16.155457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:16.155457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:16.155457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:16.155457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:16.155457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:16.155457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:16.155457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:16.155457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:16.155457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:16.155457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:16.155457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:16.155457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:16.156362 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:16.156362 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:16.156362 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:16.156362 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:16.156362 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:16.156362 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:16.156362 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:16.156362 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:16.156362 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:16.156362 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:16.156362 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:16.156362 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:16.156362 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:16.156362 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:16.156362 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:16.156362 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:16.156362 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:16.158074 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:16.158074 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:16.158074 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:16.158074 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:16.158074 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 270/535] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:16.158074 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02ae5e-0721-4135-adc3-a201fed33838 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:16.201757 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997a834-b5c6-4bdf-9a1e-75421a300d73 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:16.239728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2af9f4-4d39-4dba-8938-7393b73a5ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:16.240413 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2af9f4-4d39-4dba-8938-7393b73a5ceb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:16.240741 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2af9f4-4d39-4dba-8938-7393b73a5ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:16.241023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2af9f4-4d39-4dba-8938-7393b73a5ceb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:16.241960 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2af9f4-4d39-4dba-8938-7393b73a5ceb None admin] RBAC: Adding query filter params (role.id=a12865c9fb9e4fa0b61e4adfd53188fb, scope.project.id=a9007447059e4862972078c032a5d67b, user.id=09a1e517aa87428ebdb1e54671a8d93d) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:16.242277 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2af9f4-4d39-4dba-8938-7393b73a5ceb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:16.243869 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2af9f4-4d39-4dba-8938-7393b73a5ceb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:16.250209 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 266/536] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:23:16 2022] GET /identity/v3/role_assignments?user.id=09a1e517aa87428ebdb1e54671a8d93d&scope.project.id=a9007447059e4862972078c032a5d67b&role.id=a12865c9fb9e4fa0b61e4adfd53188fb => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:16.251060 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2af9f4-4d39-4dba-8938-7393b73a5ceb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:16.262429 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02ae5e-0721-4135-adc3-a201fed33838 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:16.277273 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:16.301244 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0f011-9fb1-491a-801a-d89a17821a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:16.301902 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0f011-9fb1-491a-801a-d89a17821a08 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:16.302190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0f011-9fb1-491a-801a-d89a17821a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:16.302465 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0f011-9fb1-491a-801a-d89a17821a08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:16.303315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0f011-9fb1-491a-801a-d89a17821a08 None admin] RBAC: Adding query filter params (role.id=a12865c9fb9e4fa0b61e4adfd53188fb, scope.project.id=a9007447059e4862972078c032a5d67b, user.id=9e239e4e9b99433ca9d1a8db45e24b56) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:16.303628 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0f011-9fb1-491a-801a-d89a17821a08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:16.305309 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0f011-9fb1-491a-801a-d89a17821a08 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:16.312787 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 271/537] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:23:16 2022] GET /identity/v3/role_assignments?user.id=9e239e4e9b99433ca9d1a8db45e24b56&scope.project.id=a9007447059e4862972078c032a5d67b&role.id=a12865c9fb9e4fa0b61e4adfd53188fb => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:16.373538 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2af9f4-4d39-4dba-8938-7393b73a5ceb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:16.384958 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:16.413211 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5f102-36c4-4be5-8e38-59dcf1069629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:16.413903 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5f102-36c4-4be5-8e38-59dcf1069629 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:16.414188 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5f102-36c4-4be5-8e38-59dcf1069629 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:16.414465 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5f102-36c4-4be5-8e38-59dcf1069629 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:16.415210 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5f102-36c4-4be5-8e38-59dcf1069629 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:16.415561 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5f102-36c4-4be5-8e38-59dcf1069629 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:16.417033 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5f102-36c4-4be5-8e38-59dcf1069629 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:16.431870 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 267/538] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:16.437454 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0f011-9fb1-491a-801a-d89a17821a08 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:16.582386 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0f011-9fb1-491a-801a-d89a17821a08 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:16.620543 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79315d29-1c7c-4013-8cd5-589bd203ff55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:16.621579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79315d29-1c7c-4013-8cd5-589bd203ff55 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:16.622016 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79315d29-1c7c-4013-8cd5-589bd203ff55 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:16.622444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79315d29-1c7c-4013-8cd5-589bd203ff55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:16.629826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79315d29-1c7c-4013-8cd5-589bd203ff55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:16.631449 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79315d29-1c7c-4013-8cd5-589bd203ff55 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:16.646607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-79315d29-1c7c-4013-8cd5-589bd203ff55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:16.646607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:16.646607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:16.646607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:16.646607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:16.646607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:16.646607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:16.646607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:16.646607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:16.646607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:16.646607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:16.646607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:16.646607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:23:16.646607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:23:16.646607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:23:16.647692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:23:16.647692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:16.647692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:16.647692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:16.647692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:16.647692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:16.647692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:16.647692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:16.647692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:16.647692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:16.647692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:16.647692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:16.647692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:16.647692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:16.647692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:16.647692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:16.647692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:16.648787 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:23:16.648787 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:23:16.648787 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:23:16.648787 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:23:16.648787 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:23:16.648787 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:23:16.648787 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:16.648787 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:16.650933 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 272/539] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:16.656387 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5f102-36c4-4be5-8e38-59dcf1069629 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:16.776194 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5f102-36c4-4be5-8e38-59dcf1069629 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:16.825078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1275238-512a-4c39-be62-7662acadaa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:16.825757 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1275238-512a-4c39-be62-7662acadaa3a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:16.826042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1275238-512a-4c39-be62-7662acadaa3a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:16.826321 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1275238-512a-4c39-be62-7662acadaa3a None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:16.827109 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1275238-512a-4c39-be62-7662acadaa3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:16.827422 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1275238-512a-4c39-be62-7662acadaa3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:16.828901 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1275238-512a-4c39-be62-7662acadaa3a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:16.847452 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 268/540] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:23:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:16.853773 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79315d29-1c7c-4013-8cd5-589bd203ff55 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:16.863421 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df2f38-e659-4658-9657-f0fd7bbd3251 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:16.863728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df2f38-e659-4658-9657-f0fd7bbd3251 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:16.863993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df2f38-e659-4658-9657-f0fd7bbd3251 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:16.865658 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 269/541] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:23:16.871732 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961ee63-1889-4c76-9784-557c66c0d579 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:16.872024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961ee63-1889-4c76-9784-557c66c0d579 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:16.872336 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961ee63-1889-4c76-9784-557c66c0d579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:16.901401 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a961ee63-1889-4c76-9784-557c66c0d579 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:16.902852 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a961ee63-1889-4c76-9784-557c66c0d579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:16.934053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:16.952770 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:17.050066 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79315d29-1c7c-4013-8cd5-589bd203ff55 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:17.050770 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 270/542] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:23:17.074081 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961ee63-1889-4c76-9784-557c66c0d579 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:17.107262 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec5998-d955-43b3-b960-979059b3756e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:17.108275 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec5998-d955-43b3-b960-979059b3756e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:17.108787 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec5998-d955-43b3-b960-979059b3756e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:17.109280 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec5998-d955-43b3-b960-979059b3756e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:17.110313 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec5998-d955-43b3-b960-979059b3756e None admin] RBAC: Adding query filter params (role.id=a12865c9fb9e4fa0b61e4adfd53188fb, scope.project.id=a9007447059e4862972078c032a5d67b, user.id=9eb2722c122f4aeba23ec16b5a3c485f) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:17.110824 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec5998-d955-43b3-b960-979059b3756e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:17.112486 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec5998-d955-43b3-b960-979059b3756e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:17.124433 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 273/543] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:23:16 2022] GET /identity/v3/role_assignments?user.id=9eb2722c122f4aeba23ec16b5a3c485f&scope.project.id=a9007447059e4862972078c032a5d67b&role.id=a12865c9fb9e4fa0b61e4adfd53188fb => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:17.261193 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961ee63-1889-4c76-9784-557c66c0d579 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:17.318862 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce23cad-3e4f-43e2-bc49-33ac552e5bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:17.319678 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce23cad-3e4f-43e2-bc49-33ac552e5bcb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:17.319963 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce23cad-3e4f-43e2-bc49-33ac552e5bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:17.320242 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce23cad-3e4f-43e2-bc49-33ac552e5bcb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:17.343344 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce23cad-3e4f-43e2-bc49-33ac552e5bcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:17.351106 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2ce23cad-3e4f-43e2-bc49-33ac552e5bcb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:17.351106 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:17.351106 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:17.351106 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:17.351106 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:17.351106 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:17.351106 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:17.351106 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:17.351106 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:17.351106 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:17.351106 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:17.351106 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:17.351106 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:17.351106 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:17.351106 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:17.351106 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:17.351976 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:17.351976 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:17.351976 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:17.351976 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:17.351976 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:17.351976 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:17.351976 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:17.351976 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:17.351976 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:17.351976 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:17.351976 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:17.351976 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:17.351976 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:17.351976 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:17.351976 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:17.351976 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:17.353755 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:17.353755 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:17.353755 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:17.353755 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:17.353755 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:17.353755 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:17.353755 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:17.353755 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:17.353755 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:17.353755 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:17.353755 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:17.353755 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:17.353755 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 271/544] 10.222.0.32 () {56 vars in 1102 bytes} [Thu Jun 2 13:23:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:23:17.360449 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec5998-d955-43b3-b960-979059b3756e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:17.497656 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:17.501147 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec5998-d955-43b3-b960-979059b3756e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:17.543422 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf54858-6e8d-44d5-8f8f-d43a556d57a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:17.544154 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf54858-6e8d-44d5-8f8f-d43a556d57a2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:17.544508 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf54858-6e8d-44d5-8f8f-d43a556d57a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:17.544788 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf54858-6e8d-44d5-8f8f-d43a556d57a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:17.545547 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf54858-6e8d-44d5-8f8f-d43a556d57a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:17.545858 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf54858-6e8d-44d5-8f8f-d43a556d57a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:17.547224 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf54858-6e8d-44d5-8f8f-d43a556d57a2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:17.559311 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 274/545] 10.222.0.32 () {56 vars in 1103 bytes} [Thu Jun 2 13:23:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:17.564857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce23cad-3e4f-43e2-bc49-33ac552e5bcb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:17.591638 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:17.703227 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce23cad-3e4f-43e2-bc49-33ac552e5bcb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:17.731678 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60504913-ab0c-4df9-9745-ecadf7df8405 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:17.731678 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60504913-ab0c-4df9-9745-ecadf7df8405 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:17.731678 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60504913-ab0c-4df9-9745-ecadf7df8405 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:17.733503 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 275/546] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:17.737862 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b74c17-c767-486f-bf56-7363872d4e6b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:17.738528 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b74c17-c767-486f-bf56-7363872d4e6b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:17.739007 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b74c17-c767-486f-bf56-7363872d4e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:17.757879 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60b554-cbdd-42e2-aada-3ce1ea801ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:17.758799 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60b554-cbdd-42e2-aada-3ce1ea801ece None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:17.759738 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60b554-cbdd-42e2-aada-3ce1ea801ece None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:17.760030 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60b554-cbdd-42e2-aada-3ce1ea801ece None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:17.761259 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b8b74c17-c767-486f-bf56-7363872d4e6b None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:17.762777 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b8b74c17-c767-486f-bf56-7363872d4e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:17.780394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60b554-cbdd-42e2-aada-3ce1ea801ece None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:17.782147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60b554-cbdd-42e2-aada-3ce1ea801ece None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:17.813917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-8a60b554-cbdd-42e2-aada-3ce1ea801ece None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:17.813917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:17.813917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:17.813917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:17.813917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:17.813917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:17.813917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:17.813917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:17.813917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:17.813917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:17.813917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:17.813917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:17.813917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:17.813917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:17.813917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:17.814869 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:17.814869 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:17.814869 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:17.814869 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:17.814869 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:17.814869 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:17.814869 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:17.814869 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:17.814869 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:17.814869 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:17.814869 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:17.814869 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:17.814869 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:17.814869 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:17.814869 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:17.814869 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:17.814869 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:17.815791 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:17.815791 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:17.815791 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:17.815791 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:17.820805 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 272/547] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:17.826551 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60b554-cbdd-42e2-aada-3ce1ea801ece None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:17.852400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 276/548] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:23:17.874240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b74c17-c767-486f-bf56-7363872d4e6b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:17.987367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:17.992664 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:18.005396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b74c17-c767-486f-bf56-7363872d4e6b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:18.052575 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60b554-cbdd-42e2-aada-3ce1ea801ece None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:18.075015 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef70057-f049-4744-b566-8d5e4ce9c208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:18.075816 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef70057-f049-4744-b566-8d5e4ce9c208 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:18.076106 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef70057-f049-4744-b566-8d5e4ce9c208 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:18.076415 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef70057-f049-4744-b566-8d5e4ce9c208 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:18.097823 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef70057-f049-4744-b566-8d5e4ce9c208 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:18.106497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-9ef70057-f049-4744-b566-8d5e4ce9c208 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:18.106497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:18.106497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:18.106497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:18.106497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:18.106497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:18.106497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:18.106497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:18.106497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:18.106497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:18.106497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:18.106497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:18.106497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:18.106497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:18.106497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:18.106497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:18.107881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:18.107881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:18.107881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:18.107881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:18.107881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:18.107881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:18.107881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:18.107881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:18.107881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:18.107881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:18.107881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:18.107881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:18.107881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:18.107881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:18.107881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:18.107881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:18.109095 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:18.109095 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:18.109095 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:18.109095 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:18.109095 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:18.109095 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:18.109095 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:18.109095 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:18.109095 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:18.109095 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:18.109095 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:18.109095 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:18.109095 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 277/549] 10.222.0.32 () {56 vars in 1102 bytes} [Thu Jun 2 13:23:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:23:18.116022 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef70057-f049-4744-b566-8d5e4ce9c208 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:18.130317 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253c821-6a04-4cb3-a728-1d45d940affe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:18.131048 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253c821-6a04-4cb3-a728-1d45d940affe None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:18.131336 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253c821-6a04-4cb3-a728-1d45d940affe None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:18.131612 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253c821-6a04-4cb3-a728-1d45d940affe None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:18.132426 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253c821-6a04-4cb3-a728-1d45d940affe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:18.132739 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253c821-6a04-4cb3-a728-1d45d940affe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:18.134192 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253c821-6a04-4cb3-a728-1d45d940affe None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:18.159262 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 273/550] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:18.165519 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253c821-6a04-4cb3-a728-1d45d940affe None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:18.274446 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef70057-f049-4744-b566-8d5e4ce9c208 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:18.313456 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf79be-ac7d-42d5-a016-9bc7d39833ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:18.314131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf79be-ac7d-42d5-a016-9bc7d39833ff None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:18.314418 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf79be-ac7d-42d5-a016-9bc7d39833ff None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:18.314705 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf79be-ac7d-42d5-a016-9bc7d39833ff None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:18.315721 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf79be-ac7d-42d5-a016-9bc7d39833ff None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:18.316039 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf79be-ac7d-42d5-a016-9bc7d39833ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:18.317453 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf79be-ac7d-42d5-a016-9bc7d39833ff None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:18.327463 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 278/551] 10.222.0.32 () {56 vars in 1103 bytes} [Thu Jun 2 13:23:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:18.332930 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf79be-ac7d-42d5-a016-9bc7d39833ff None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:18.361075 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:18.374954 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253c821-6a04-4cb3-a728-1d45d940affe None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:18.429849 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:18.442497 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420c034-475e-41d7-92a3-452bf938e8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:18.443635 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420c034-475e-41d7-92a3-452bf938e8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:18.444328 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420c034-475e-41d7-92a3-452bf938e8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:18.445890 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420c034-475e-41d7-92a3-452bf938e8d6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:18.457883 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420c034-475e-41d7-92a3-452bf938e8d6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:18.460539 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420c034-475e-41d7-92a3-452bf938e8d6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:18.494245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4420c034-475e-41d7-92a3-452bf938e8d6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:23:18.494245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:18.494245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:18.494245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:18.494245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:18.494245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:18.494245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:18.494245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:18.494245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:18.494245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:18.494245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:18.494245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:18.494245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:23:18.494245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:23:18.494245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:23:18.494245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:23:18.495305 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:18.495305 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:18.495305 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:23:18.495305 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:18.495305 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:23:18.495305 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:18.495305 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:18.495305 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:18.495305 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:18.495305 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:18.495305 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:18.495305 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:18.495305 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:18.495305 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:18.495305 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:18.495305 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:18.495305 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:18.495305 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:18.496366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:18.496366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:18.496366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:23:18.496366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:23:18.496366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:23:18.496366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:23:18.496366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:23:18.496366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:23:18.496366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:23:18.496366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:18.500077 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 274/552] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:23:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:18.506463 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420c034-475e-41d7-92a3-452bf938e8d6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:18.539165 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf79be-ac7d-42d5-a016-9bc7d39833ff None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:18.594283 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31329b0-7e95-48ea-a8e2-ab909cc6025b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:18.595430 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31329b0-7e95-48ea-a8e2-ab909cc6025b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:18.595914 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31329b0-7e95-48ea-a8e2-ab909cc6025b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:18.596434 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31329b0-7e95-48ea-a8e2-ab909cc6025b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:18.613121 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31329b0-7e95-48ea-a8e2-ab909cc6025b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:18.614908 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31329b0-7e95-48ea-a8e2-ab909cc6025b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:18.646382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-a31329b0-7e95-48ea-a8e2-ab909cc6025b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:18.646382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:18.646382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:18.646382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:18.646382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:18.646382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:18.646382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:18.646382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:18.646382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:18.646382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:18.646382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:18.646382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:18.646382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:18.646382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:18.646382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:18.647334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:18.647334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:18.647334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:18.647334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:18.647334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:18.647334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:18.647334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:18.647334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:18.647334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:18.647334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:18.647334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:18.647334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:18.647334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:18.647334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:18.647334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:18.647334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:18.647334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:18.648208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:18.648208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:18.648208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:18.648208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:18.656417 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 279/553] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:18.658232 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31329b0-7e95-48ea-a8e2-ab909cc6025b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:18.711203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420c034-475e-41d7-92a3-452bf938e8d6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:18.748566 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf9038-4fde-419e-895d-20560ca07f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:18.749630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf9038-4fde-419e-895d-20560ca07f6c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:18.750138 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf9038-4fde-419e-895d-20560ca07f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:18.750668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf9038-4fde-419e-895d-20560ca07f6c None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:18.751717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf9038-4fde-419e-895d-20560ca07f6c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:18.752228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf9038-4fde-419e-895d-20560ca07f6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:18.753906 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf9038-4fde-419e-895d-20560ca07f6c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:18.773001 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 275/554] 10.222.0.32 () {56 vars in 1135 bytes} [Thu Jun 2 13:23:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:18.781095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf9038-4fde-419e-895d-20560ca07f6c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:18.817816 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:18.892668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:18.946326 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31329b0-7e95-48ea-a8e2-ab909cc6025b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:19.011383 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf9038-4fde-419e-895d-20560ca07f6c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:19.015231 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af013456-2da9-4e80-9827-7e6b94246242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:19.016129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af013456-2da9-4e80-9827-7e6b94246242 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:19.016658 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af013456-2da9-4e80-9827-7e6b94246242 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:19.017987 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af013456-2da9-4e80-9827-7e6b94246242 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:19.018958 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af013456-2da9-4e80-9827-7e6b94246242 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:19.019464 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af013456-2da9-4e80-9827-7e6b94246242 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:19.021062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af013456-2da9-4e80-9827-7e6b94246242 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:19.058176 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10c5e3-5561-4578-bc9c-906bd268963d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:19.058835 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10c5e3-5561-4578-bc9c-906bd268963d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:19.059121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10c5e3-5561-4578-bc9c-906bd268963d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:19.059398 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10c5e3-5561-4578-bc9c-906bd268963d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:19.061098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 280/555] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:19.069349 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af013456-2da9-4e80-9827-7e6b94246242 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:19.135006 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10c5e3-5561-4578-bc9c-906bd268963d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:19.136988 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10c5e3-5561-4578-bc9c-906bd268963d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:19.213975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:19.251231 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 276/556] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:23:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:19.251231 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e3983-a729-439e-a313-431ba6945e22 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:19.251231 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e3983-a729-439e-a313-431ba6945e22 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:19.251231 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e3983-a729-439e-a313-431ba6945e22 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:19.251231 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 277/557] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:19.251231 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e3983-a729-439e-a313-431ba6945e22 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:19.284762 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af013456-2da9-4e80-9827-7e6b94246242 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:19.310787 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:19.320643 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ef300-13ea-4c12-9946-540c41d8270c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:19.321395 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ef300-13ea-4c12-9946-540c41d8270c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:19.322237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ef300-13ea-4c12-9946-540c41d8270c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:19.322515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ef300-13ea-4c12-9946-540c41d8270c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:19.330521 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ef300-13ea-4c12-9946-540c41d8270c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:19.333231 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ef300-13ea-4c12-9946-540c41d8270c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:19.348951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-483ef300-13ea-4c12-9946-540c41d8270c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:23:19.348951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:19.348951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:19.348951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:19.348951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:19.348951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:19.348951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:19.348951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:19.348951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:19.348951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:19.348951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:19.348951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:19.348951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:23:19.348951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:23:19.348951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:23:19.348951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:23:19.350400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:19.350400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:19.350400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:23:19.350400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:19.350400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:23:19.350400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:19.350400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:19.350400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:19.350400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:19.350400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:19.350400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:19.350400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:19.350400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:19.350400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:19.350400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:19.350400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:19.350400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:19.350400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:19.351325 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:19.351325 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:19.351325 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:23:19.351325 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:23:19.351325 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:23:19.351325 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:23:19.351325 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:23:19.351325 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:23:19.351325 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:23:19.351325 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:19.351325 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 281/558] 10.222.0.32 () {56 vars in 1093 bytes} [Thu Jun 2 13:23:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:19.351325 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef4ba4-d2da-4be7-8591-d081222f7761 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:19.351985 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef4ba4-d2da-4be7-8591-d081222f7761 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:19.351985 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef4ba4-d2da-4be7-8591-d081222f7761 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:19.357233 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 282/559] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:19.358343 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e5307-54ee-4a3f-8575-8b1b020827d7 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:19.358637 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e5307-54ee-4a3f-8575-8b1b020827d7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:19.358920 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e5307-54ee-4a3f-8575-8b1b020827d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:19.371644 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e3983-a729-439e-a313-431ba6945e22 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:19.375889 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-2e7e5307-54ee-4a3f-8575-8b1b020827d7 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:19.377089 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2e7e5307-54ee-4a3f-8575-8b1b020827d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:19.414223 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd4049-8ec7-44a8-9a4b-059203e29843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:19.415026 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd4049-8ec7-44a8-9a4b-059203e29843 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:19.415359 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd4049-8ec7-44a8-9a4b-059203e29843 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:19.415644 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd4049-8ec7-44a8-9a4b-059203e29843 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:19.427239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd4049-8ec7-44a8-9a4b-059203e29843 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:19.428810 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd4049-8ec7-44a8-9a4b-059203e29843 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:19.439321 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:19.450837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-99cd4049-8ec7-44a8-9a4b-059203e29843 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:19.450837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:19.450837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:19.450837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:19.450837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:19.450837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:19.450837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:19.450837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:19.450837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:19.450837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:19.450837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:19.450837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:19.450837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:19.450837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:19.450837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:19.451815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:19.451815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:19.451815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:19.451815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:19.451815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:19.451815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:19.451815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:19.451815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:19.451815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:19.451815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:19.451815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:19.451815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:19.451815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:19.451815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:19.451815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:19.451815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:19.451815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:19.452732 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:19.452732 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:19.452732 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:19.452732 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:19.452732 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 278/560] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:19.453015 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd4049-8ec7-44a8-9a4b-059203e29843 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:19.464399 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 283/561] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:23:19.466532 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749bb2c-524a-4787-96c6-9528be164147 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:19.467291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749bb2c-524a-4787-96c6-9528be164147 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:19.467784 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749bb2c-524a-4787-96c6-9528be164147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:19.490366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-5749bb2c-524a-4787-96c6-9528be164147 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:19.491565 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5749bb2c-524a-4787-96c6-9528be164147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:19.564501 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 284/562] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:23:19.564501 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749bb2c-524a-4787-96c6-9528be164147 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:19.566791 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd4049-8ec7-44a8-9a4b-059203e29843 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:19.603033 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741193f-17db-466d-ae8a-2b3d590b8152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:19.603944 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741193f-17db-466d-ae8a-2b3d590b8152 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:19.604231 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741193f-17db-466d-ae8a-2b3d590b8152 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:19.604547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741193f-17db-466d-ae8a-2b3d590b8152 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:19.605389 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741193f-17db-466d-ae8a-2b3d590b8152 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:19.605702 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741193f-17db-466d-ae8a-2b3d590b8152 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:19.607149 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741193f-17db-466d-ae8a-2b3d590b8152 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:19.625801 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:19.626113 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 279/563] 10.222.0.32 () {56 vars in 1133 bytes} [Thu Jun 2 13:23:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:19.626950 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741193f-17db-466d-ae8a-2b3d590b8152 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:19.686706 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749bb2c-524a-4787-96c6-9528be164147 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:19.687106 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:19.723219 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5de797-4b56-416a-ac3c-d212d44257bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:19.723885 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5de797-4b56-416a-ac3c-d212d44257bd None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:19.724196 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5de797-4b56-416a-ac3c-d212d44257bd None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:19.724496 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5de797-4b56-416a-ac3c-d212d44257bd None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:19.725194 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5de797-4b56-416a-ac3c-d212d44257bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:19.725505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5de797-4b56-416a-ac3c-d212d44257bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:19.726885 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5de797-4b56-416a-ac3c-d212d44257bd None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:19.732887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741193f-17db-466d-ae8a-2b3d590b8152 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:19.739518 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 285/564] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:19.740369 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5de797-4b56-416a-ac3c-d212d44257bd None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:19.768080 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5a9d7-7e43-4801-a51c-047e2b3c4d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:19.768882 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5a9d7-7e43-4801-a51c-047e2b3c4d38 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:19.769164 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5a9d7-7e43-4801-a51c-047e2b3c4d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:19.769433 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5a9d7-7e43-4801-a51c-047e2b3c4d38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:19.779619 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5a9d7-7e43-4801-a51c-047e2b3c4d38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:19.787697 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-d7b5a9d7-7e43-4801-a51c-047e2b3c4d38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:19.787697 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:19.787697 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:19.787697 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:19.787697 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:19.787697 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:19.787697 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:19.787697 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:19.787697 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:19.787697 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:19.787697 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:19.787697 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:19.787697 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:19.787697 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:19.787697 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:19.787697 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:19.788704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:19.788704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:19.788704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:19.788704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:19.788704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:19.788704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:19.788704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:19.788704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:19.788704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:19.788704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:19.788704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:19.788704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:19.788704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:19.788704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:19.788704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:19.788704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:19.789549 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:19.789549 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:19.789549 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:19.789549 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:19.789549 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:19.789549 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:19.789549 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:19.789549 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:19.789549 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:19.789549 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:19.789549 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:19.789549 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:19.789549 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 280/565] 10.222.0.32 () {56 vars in 1102 bytes} [Thu Jun 2 13:23:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:19.790762 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5a9d7-7e43-4801-a51c-047e2b3c4d38 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:19.841421 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5de797-4b56-416a-ac3c-d212d44257bd None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:19.848231 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:19.876650 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8f448-1c28-4563-9c01-385887678569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:19.877370 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8f448-1c28-4563-9c01-385887678569 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:19.877657 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8f448-1c28-4563-9c01-385887678569 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:19.877932 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8f448-1c28-4563-9c01-385887678569 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:19.887868 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5a9d7-7e43-4801-a51c-047e2b3c4d38 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:19.888252 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8f448-1c28-4563-9c01-385887678569 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:19.895956 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-4ac8f448-1c28-4563-9c01-385887678569 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:19.895956 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:19.895956 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:19.895956 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:19.895956 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:19.895956 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:19.895956 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:19.895956 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:19.895956 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:19.895956 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:19.895956 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:19.895956 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:19.895956 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:19.895956 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:19.895956 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:19.895956 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:19.896912 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:19.896912 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:19.896912 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:19.896912 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:19.896912 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:19.896912 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:19.896912 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:19.896912 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:19.896912 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:19.896912 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:19.896912 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:19.896912 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:19.896912 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:19.896912 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:19.896912 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:19.896912 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:19.897728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:19.897728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:19.897728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:19.897728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:19.897728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:19.897728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:19.897728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:19.897728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:19.897728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:19.897728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:19.897728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:19.897728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:19.897728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 286/566] 10.222.0.32 () {56 vars in 1102 bytes} [Thu Jun 2 13:23:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:19.898450 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bea99-981d-4c12-890d-7c689ef68dde None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:19.898749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bea99-981d-4c12-890d-7c689ef68dde None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:19.899001 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bea99-981d-4c12-890d-7c689ef68dde None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:19.900250 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 287/567] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:19.900959 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bea99-981d-4c12-890d-7c689ef68dde None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:19.909149 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:19.926495 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4bd9b9-d588-4735-9b5b-66f91155de80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:19.927280 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bd9b9-d588-4735-9b5b-66f91155de80 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:19.927565 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bd9b9-d588-4735-9b5b-66f91155de80 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:19.927840 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bd9b9-d588-4735-9b5b-66f91155de80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:19.938190 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4bd9b9-d588-4735-9b5b-66f91155de80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:19.939639 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4bd9b9-d588-4735-9b5b-66f91155de80 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:19.957140 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-0c4bd9b9-d588-4735-9b5b-66f91155de80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:19.957140 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:19.957140 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:19.957140 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:19.957140 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:19.957140 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:19.957140 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:19.957140 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:19.957140 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:19.957140 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:19.957140 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:19.957140 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:19.957140 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:19.957140 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:19.957140 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:19.958042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:19.958042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:19.958042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:19.958042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:19.958042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:19.958042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:19.958042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:19.958042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:19.958042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:19.958042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:19.958042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:19.958042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:19.958042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:19.958042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:19.958042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:19.958042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:19.958042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:19.958929 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:19.958929 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:19.958929 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:19.958929 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:19.958929 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 281/568] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:19.959238 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4bd9b9-d588-4735-9b5b-66f91155de80 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:20.005199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bea99-981d-4c12-890d-7c689ef68dde None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:20.040110 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca2921-4001-442d-89b4-819c37f7865b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:20.040954 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca2921-4001-442d-89b4-819c37f7865b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:20.041239 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca2921-4001-442d-89b4-819c37f7865b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:20.041515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca2921-4001-442d-89b4-819c37f7865b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:20.048483 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca2921-4001-442d-89b4-819c37f7865b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:20.050017 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca2921-4001-442d-89b4-819c37f7865b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:20.063328 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4bd9b9-d588-4735-9b5b-66f91155de80 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:20.064516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-2cca2921-4001-442d-89b4-819c37f7865b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:20.064516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:20.064516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:20.064516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:20.064516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:20.064516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:20.064516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:20.064516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:20.064516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:20.064516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:20.064516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:20.064516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:20.064516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:23:20.064516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:23:20.064516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:23:20.065365 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:23:20.065365 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:20.065365 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:20.065365 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:20.065365 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:20.065365 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:20.065365 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:20.065365 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:20.065365 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:20.065365 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:20.065365 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:20.065365 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:20.065365 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:20.065365 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:20.065365 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:20.065365 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:20.065365 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:20.066251 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:23:20.066251 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:23:20.066251 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:23:20.066251 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:23:20.066251 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:23:20.066251 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:23:20.066251 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:20.066251 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:20.066251 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 288/569] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:20.067147 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca2921-4001-442d-89b4-819c37f7865b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:20.094384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:20.099031 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690e9c3-fa53-41ba-ba30-a4ad8fb41d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:20.099689 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690e9c3-fa53-41ba-ba30-a4ad8fb41d5a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:20.099972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690e9c3-fa53-41ba-ba30-a4ad8fb41d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:20.100246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690e9c3-fa53-41ba-ba30-a4ad8fb41d5a None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:20.101011 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690e9c3-fa53-41ba-ba30-a4ad8fb41d5a None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:20.101315 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690e9c3-fa53-41ba-ba30-a4ad8fb41d5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:20.102679 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690e9c3-fa53-41ba-ba30-a4ad8fb41d5a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:20.110661 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 282/570] 10.222.0.32 () {56 vars in 1103 bytes} [Thu Jun 2 13:23:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:20.111659 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209e7d1-7e26-4b9c-856b-1bc7319f9788 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:20.111943 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209e7d1-7e26-4b9c-856b-1bc7319f9788 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:20.112215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209e7d1-7e26-4b9c-856b-1bc7319f9788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:20.128319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e209e7d1-7e26-4b9c-856b-1bc7319f9788 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:20.129440 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e209e7d1-7e26-4b9c-856b-1bc7319f9788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:20.154798 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:20.166157 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca2921-4001-442d-89b4-819c37f7865b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:20.197491 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 283/571] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:23:20.198329 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209e7d1-7e26-4b9c-856b-1bc7319f9788 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:20.205599 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45f9be-ccae-417d-a681-5f154d60e801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:20.206263 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45f9be-ccae-417d-a681-5f154d60e801 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:20.206554 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45f9be-ccae-417d-a681-5f154d60e801 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:20.206835 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45f9be-ccae-417d-a681-5f154d60e801 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:20.207580 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45f9be-ccae-417d-a681-5f154d60e801 None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:20.207890 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45f9be-ccae-417d-a681-5f154d60e801 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:20.209427 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45f9be-ccae-417d-a681-5f154d60e801 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:20.218190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 289/572] 10.222.0.32 () {56 vars in 1103 bytes} [Thu Jun 2 13:23:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:20.219155 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45f9be-ccae-417d-a681-5f154d60e801 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:20.297856 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209e7d1-7e26-4b9c-856b-1bc7319f9788 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:20.305514 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:20.318106 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45f9be-ccae-417d-a681-5f154d60e801 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:20.333752 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7a04f-8c1c-44eb-a496-26c2f64efd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:20.334415 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7a04f-8c1c-44eb-a496-26c2f64efd99 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:20.334697 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7a04f-8c1c-44eb-a496-26c2f64efd99 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:20.335238 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7a04f-8c1c-44eb-a496-26c2f64efd99 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:20.335960 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7a04f-8c1c-44eb-a496-26c2f64efd99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:20.336271 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7a04f-8c1c-44eb-a496-26c2f64efd99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:20.337679 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7a04f-8c1c-44eb-a496-26c2f64efd99 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:20.348686 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 284/573] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:20.349547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7a04f-8c1c-44eb-a496-26c2f64efd99 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:20.351179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9d88b-0aff-4667-bc1c-46a99532ee26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:20.351826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9d88b-0aff-4667-bc1c-46a99532ee26 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:20.352113 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9d88b-0aff-4667-bc1c-46a99532ee26 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:20.352447 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9d88b-0aff-4667-bc1c-46a99532ee26 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:20.353236 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9d88b-0aff-4667-bc1c-46a99532ee26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:20.353546 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9d88b-0aff-4667-bc1c-46a99532ee26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:20.354963 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9d88b-0aff-4667-bc1c-46a99532ee26 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:20.371916 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 290/574] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:23:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:20.371916 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9d88b-0aff-4667-bc1c-46a99532ee26 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:20.373934 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:20.448519 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7a04f-8c1c-44eb-a496-26c2f64efd99 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:20.466122 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9d88b-0aff-4667-bc1c-46a99532ee26 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:20.480939 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38ca10-f596-4d13-a14c-b42828e8f76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:20.481719 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38ca10-f596-4d13-a14c-b42828e8f76e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:20.482000 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38ca10-f596-4d13-a14c-b42828e8f76e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:20.482279 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38ca10-f596-4d13-a14c-b42828e8f76e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:20.492420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38ca10-f596-4d13-a14c-b42828e8f76e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:20.494440 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38ca10-f596-4d13-a14c-b42828e8f76e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:20.499683 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab47f7-2028-48ef-b730-9392be6d1b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:20.500492 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab47f7-2028-48ef-b730-9392be6d1b7a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:20.500777 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab47f7-2028-48ef-b730-9392be6d1b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:20.501050 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab47f7-2028-48ef-b730-9392be6d1b7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:20.510924 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab47f7-2028-48ef-b730-9392be6d1b7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:20.511038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ed38ca10-f596-4d13-a14c-b42828e8f76e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:20.511038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:20.511038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:20.511038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:20.511038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:20.511038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:20.511038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:20.511038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:20.511038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:20.511038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:20.511038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:20.511038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:20.511038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:20.511038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:20.511038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:20.511872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:20.511872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:20.511872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:20.511872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:20.511872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:20.511872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:20.511872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:20.511872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:20.511872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:20.511872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:20.511872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:20.511872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:20.511872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:20.511872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:20.511872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:20.511872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:20.511872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:20.512796 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:20.512796 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:20.512796 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:20.512796 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:20.512796 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 285/575] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:20.513075 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38ca10-f596-4d13-a14c-b42828e8f76e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:20.519138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-2bab47f7-2028-48ef-b730-9392be6d1b7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:20.519138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:20.519138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:20.519138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:20.519138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:20.519138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:20.519138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:20.519138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:20.519138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:20.519138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:20.519138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:20.519138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:20.519138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:20.519138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:20.519138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:20.519138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:20.520088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:20.520088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:20.520088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:20.520088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:20.520088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:20.520088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:20.520088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:20.520088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:20.520088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:20.520088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:20.520088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:20.520088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:20.520088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:20.520088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:20.520088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:20.520088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:20.520945 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:20.520945 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:20.520945 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:20.520945 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:20.520945 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:20.520945 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:20.520945 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:20.520945 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:20.520945 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:20.520945 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:20.520945 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:20.520945 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:20.520945 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 291/576] 10.222.0.32 () {56 vars in 1102 bytes} [Thu Jun 2 13:23:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:20.521636 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab47f7-2028-48ef-b730-9392be6d1b7a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:20.532498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:20.589772 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:20.615413 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38ca10-f596-4d13-a14c-b42828e8f76e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:20.620476 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab47f7-2028-48ef-b730-9392be6d1b7a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:20.648158 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be146f44-d225-4371-b379-64ecc4d041d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:20.648969 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be146f44-d225-4371-b379-64ecc4d041d9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:20.649253 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be146f44-d225-4371-b379-64ecc4d041d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:20.649528 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be146f44-d225-4371-b379-64ecc4d041d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:20.652195 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d9495-b8b9-4bbf-83b1-b731524b54e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:20.652994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d9495-b8b9-4bbf-83b1-b731524b54e5 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:20.653278 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d9495-b8b9-4bbf-83b1-b731524b54e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:20.653552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d9495-b8b9-4bbf-83b1-b731524b54e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:20.659793 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be146f44-d225-4371-b379-64ecc4d041d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:20.660202 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d9495-b8b9-4bbf-83b1-b731524b54e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:20.661268 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be146f44-d225-4371-b379-64ecc4d041d9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:20.661645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d9495-b8b9-4bbf-83b1-b731524b54e5 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:20.676277 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-a26d9495-b8b9-4bbf-83b1-b731524b54e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:20.676277 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:20.676277 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:20.676277 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:20.676277 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:20.676277 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:20.676277 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:20.676277 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:20.676277 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:20.676277 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:20.676277 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:20.676277 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:20.676277 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:23:20.676277 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:23:20.676277 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:23:20.677195 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:23:20.677195 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:20.677195 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:20.677195 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:20.677195 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:20.677195 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:20.677195 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:20.677195 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:20.677195 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:20.677195 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:20.677195 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:20.677195 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:20.677195 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:20.677195 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:20.677195 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:20.677195 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:20.677195 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:20.678094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:23:20.678094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:23:20.678094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:23:20.678094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:23:20.678094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:23:20.678094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:23:20.678094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:20.678094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:20.678094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 292/577] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:20.678598 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d9495-b8b9-4bbf-83b1-b731524b54e5 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:20.678994 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-be146f44-d225-4371-b379-64ecc4d041d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:20.678994 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:20.678994 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:20.678994 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:20.678994 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:20.678994 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:20.678994 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:20.678994 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:20.678994 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:20.678994 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:20.678994 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:20.678994 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:20.678994 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:20.678994 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:20.678994 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:20.679993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:20.679993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:20.679993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:20.679993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:20.679993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:20.679993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:20.679993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:20.679993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:20.679993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:20.679993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:20.679993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:20.679993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:20.679993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:20.679993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:20.679993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:20.679993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:20.679993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:20.681589 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:20.681589 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:20.681589 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:20.681589 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:20.681589 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 286/578] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:20.681589 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be146f44-d225-4371-b379-64ecc4d041d9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:20.749469 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:20.779234 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be146f44-d225-4371-b379-64ecc4d041d9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:20.782509 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d9495-b8b9-4bbf-83b1-b731524b54e5 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:20.805210 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:20.814841 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0a137-a5f1-499e-85bf-a5a4e345b89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:20.815489 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0a137-a5f1-499e-85bf-a5a4e345b89d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:20.815772 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0a137-a5f1-499e-85bf-a5a4e345b89d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:20.816045 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0a137-a5f1-499e-85bf-a5a4e345b89d None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:20.816287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6cf67-7e3c-4db5-b4a9-f8d653c87437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:20.816782 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0a137-a5f1-499e-85bf-a5a4e345b89d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:20.816954 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6cf67-7e3c-4db5-b4a9-f8d653c87437 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:20.817087 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0a137-a5f1-499e-85bf-a5a4e345b89d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:20.817238 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6cf67-7e3c-4db5-b4a9-f8d653c87437 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:20.817513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6cf67-7e3c-4db5-b4a9-f8d653c87437 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:20.818340 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6cf67-7e3c-4db5-b4a9-f8d653c87437 None admin] RBAC: Adding query filter params (role.id=a12865c9fb9e4fa0b61e4adfd53188fb, scope.project.id=a9007447059e4862972078c032a5d67b, user.id=3aea97e7b39448a283032f662142b6e0) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:20.818449 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0a137-a5f1-499e-85bf-a5a4e345b89d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:20.818650 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6cf67-7e3c-4db5-b4a9-f8d653c87437 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:20.820061 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6cf67-7e3c-4db5-b4a9-f8d653c87437 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:20.825453 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 293/579] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:23:20 2022] GET /identity/v3/role_assignments?user.id=3aea97e7b39448a283032f662142b6e0&scope.project.id=a9007447059e4862972078c032a5d67b&role.id=a12865c9fb9e4fa0b61e4adfd53188fb => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:20.826298 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6cf67-7e3c-4db5-b4a9-f8d653c87437 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:20.840962 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 287/580] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:20.840962 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0a137-a5f1-499e-85bf-a5a4e345b89d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:20.946395 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6cf67-7e3c-4db5-b4a9-f8d653c87437 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:20.953545 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0a137-a5f1-499e-85bf-a5a4e345b89d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:20.982791 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:20.989131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b307d4-4f12-427f-825c-765f42dc3437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:20.989811 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b307d4-4f12-427f-825c-765f42dc3437 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:20.990098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b307d4-4f12-427f-825c-765f42dc3437 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:20.990379 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b307d4-4f12-427f-825c-765f42dc3437 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:20.991144 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b307d4-4f12-427f-825c-765f42dc3437 None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:20.991451 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b307d4-4f12-427f-825c-765f42dc3437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:20.992871 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b307d4-4f12-427f-825c-765f42dc3437 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:20.994654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a4699-51ee-47ad-87d5-b252991aa18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:20.995541 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a4699-51ee-47ad-87d5-b252991aa18d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:20.995985 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a4699-51ee-47ad-87d5-b252991aa18d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:20.996263 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a4699-51ee-47ad-87d5-b252991aa18d None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:20.997102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a4699-51ee-47ad-87d5-b252991aa18d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:20.997415 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a4699-51ee-47ad-87d5-b252991aa18d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:20.998895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a4699-51ee-47ad-87d5-b252991aa18d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:21.007552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 294/581] 10.222.0.32 () {56 vars in 1103 bytes} [Thu Jun 2 13:23:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:21.007552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b307d4-4f12-427f-825c-765f42dc3437 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:21.017885 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 288/582] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:23:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:21.018742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a4699-51ee-47ad-87d5-b252991aa18d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:21.070167 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:21.124435 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b307d4-4f12-427f-825c-765f42dc3437 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:21.126799 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a4699-51ee-47ad-87d5-b252991aa18d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:21.160169 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4005c-9d17-4e1f-80fc-c3a007168846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:21.160857 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4005c-9d17-4e1f-80fc-c3a007168846 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:21.161142 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4005c-9d17-4e1f-80fc-c3a007168846 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:21.161422 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4005c-9d17-4e1f-80fc-c3a007168846 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:21.162140 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4005c-9d17-4e1f-80fc-c3a007168846 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:21.162238 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ccc99-3043-41d9-9516-4d471720c3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:21.162450 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4005c-9d17-4e1f-80fc-c3a007168846 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:21.163012 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ccc99-3043-41d9-9516-4d471720c3cb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:21.163301 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ccc99-3043-41d9-9516-4d471720c3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:21.163575 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ccc99-3043-41d9-9516-4d471720c3cb None admin] PATH_INFO: `/v3/users/glance` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:21.163815 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4005c-9d17-4e1f-80fc-c3a007168846 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:21.171761 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ccc99-3043-41d9-9516-4d471720c3cb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:21.176634 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ccc99-3043-41d9-9516-4d471720c3cb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:21.186467 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 295/583] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:21.187202 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4005c-9d17-4e1f-80fc-c3a007168846 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:21.191472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-244ccc99-3043-41d9-9516-4d471720c3cb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 13:23:21.191472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:21.191472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:21.191472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:21.191472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:21.191472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:21.191472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:21.191472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:21.191472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:21.191472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:21.191472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:21.191472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:21.191472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:23:21.191472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:23:21.191472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:23:21.191472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:23:21.192458 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:21.192458 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:21.192458 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:23:21.192458 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:21.192458 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:23:21.192458 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:21.192458 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:21.192458 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:21.192458 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:21.192458 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:21.192458 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:21.192458 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:21.192458 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:21.192458 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:21.192458 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:21.192458 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:21.192458 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:21.192458 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:21.193405 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:21.193405 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:21.193405 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:23:21.193405 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:23:21.193405 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:23:21.193405 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:23:21.193405 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:23:21.193405 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:23:21.193405 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 13:23:21.193405 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:21.193405 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 289/584] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:23:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:21.194003 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ccc99-3043-41d9-9516-4d471720c3cb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:21.248893 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:21.300182 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4005c-9d17-4e1f-80fc-c3a007168846 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:21.303167 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ccc99-3043-41d9-9516-4d471720c3cb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:21.310759 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:21.340264 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6adce6b-26e9-4cb5-8d38-c19515a8d5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:21.341192 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adce6b-26e9-4cb5-8d38-c19515a8d5a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:21.341475 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adce6b-26e9-4cb5-8d38-c19515a8d5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:21.341749 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adce6b-26e9-4cb5-8d38-c19515a8d5a4 None admin] PATH_INFO: `/v3/projects/a9007447059e4862972078c032a5d67b/users/b2e5d9f3c4e04ca3bf52b28b67d2a4d6/roles/a12865c9fb9e4fa0b61e4adfd53188fb` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:21.342375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a195ac-f469-415d-965a-f8a06c10d69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:21.343336 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a195ac-f469-415d-965a-f8a06c10d69a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:21.343618 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a195ac-f469-415d-965a-f8a06c10d69a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:21.343891 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a195ac-f469-415d-965a-f8a06c10d69a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:21.357441 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6adce6b-26e9-4cb5-8d38-c19515a8d5a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a9007447059e4862972078c032a5d67b, user_id=b2e5d9f3c4e04ca3bf52b28b67d2a4d6, role_id=a12865c9fb9e4fa0b61e4adfd53188fb)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:21.357941 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a195ac-f469-415d-965a-f8a06c10d69a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:21.358894 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6adce6b-26e9-4cb5-8d38-c19515a8d5a4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:21.359390 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a195ac-f469-415d-965a-f8a06c10d69a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:21.373703 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 290/585] 10.222.0.32 () {58 vars in 1439 bytes} [Thu Jun 2 13:23:21 2022] PUT /identity/v3/projects/a9007447059e4862972078c032a5d67b/users/b2e5d9f3c4e04ca3bf52b28b67d2a4d6/roles/a12865c9fb9e4fa0b61e4adfd53188fb => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:21.374875 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6adce6b-26e9-4cb5-8d38-c19515a8d5a4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:21.379000 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-d7a195ac-f469-415d-965a-f8a06c10d69a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:21.379000 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:21.379000 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:21.379000 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:21.379000 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:21.379000 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:21.379000 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:21.379000 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:21.379000 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:21.379000 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:21.379000 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:21.379000 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:21.379000 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:21.379000 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:21.379000 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:21.379929 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:21.379929 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:21.379929 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:21.379929 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:21.379929 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:21.379929 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:21.379929 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:21.379929 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:21.379929 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:21.379929 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:21.379929 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:21.379929 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:21.379929 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:21.379929 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:21.379929 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:21.379929 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:21.379929 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:21.380838 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:21.380838 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:21.380838 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:21.380838 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:21.380838 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 296/586] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:21.381566 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a195ac-f469-415d-965a-f8a06c10d69a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:21.508440 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6adce6b-26e9-4cb5-8d38-c19515a8d5a4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:21.525720 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a195ac-f469-415d-965a-f8a06c10d69a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:21.534552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:21.563342 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed946d1-2042-49d1-b162-d0d834e9204e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:21.564079 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed946d1-2042-49d1-b162-d0d834e9204e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:21.564397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed946d1-2042-49d1-b162-d0d834e9204e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:21.564679 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed946d1-2042-49d1-b162-d0d834e9204e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:21.566062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ac910-b1e4-4b8e-8783-1f1cc3146e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:21.566862 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ac910-b1e4-4b8e-8783-1f1cc3146e4b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:21.567232 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ac910-b1e4-4b8e-8783-1f1cc3146e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:21.567576 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ac910-b1e4-4b8e-8783-1f1cc3146e4b None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:21.568559 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ac910-b1e4-4b8e-8783-1f1cc3146e4b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:21.568934 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ac910-b1e4-4b8e-8783-1f1cc3146e4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:21.570447 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ac910-b1e4-4b8e-8783-1f1cc3146e4b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:21.572937 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed946d1-2042-49d1-b162-d0d834e9204e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:21.575599 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed946d1-2042-49d1-b162-d0d834e9204e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:21.594195 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-5ed946d1-2042-49d1-b162-d0d834e9204e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:23:21.594195 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:21.594195 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:21.594195 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:21.594195 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:21.594195 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:21.594195 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:21.594195 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:21.594195 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:21.594195 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:21.594195 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:21.594195 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:21.594195 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:23:21.594195 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:23:21.594195 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:23:21.594195 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:23:21.595300 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:21.595300 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:21.595300 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:23:21.595300 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:21.595300 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:23:21.595300 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:21.595300 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:21.595300 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:21.595300 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:21.595300 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:21.595300 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:21.595300 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:21.595300 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:21.595300 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:21.595300 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:21.595300 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:21.595300 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:21.595300 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:21.596343 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:21.596343 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:21.596343 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:23:21.596343 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:23:21.596343 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:23:21.596343 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:23:21.596343 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:23:21.596343 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:23:21.596343 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:23:21.596343 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:21.596343 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 291/587] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:23:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:21.596931 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed946d1-2042-49d1-b162-d0d834e9204e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:21.600329 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 297/588] 10.222.0.32 () {56 vars in 1137 bytes} [Thu Jun 2 13:23:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:21.604452 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ac910-b1e4-4b8e-8783-1f1cc3146e4b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:21.621558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:21.709735 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ac910-b1e4-4b8e-8783-1f1cc3146e4b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:21.730846 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed946d1-2042-49d1-b162-d0d834e9204e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:21.747301 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004fbba-8707-4bbf-9fea-f4ac1ca0f778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:21.748069 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004fbba-8707-4bbf-9fea-f4ac1ca0f778 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:21.748463 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004fbba-8707-4bbf-9fea-f4ac1ca0f778 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:21.748804 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004fbba-8707-4bbf-9fea-f4ac1ca0f778 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:21.749722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004fbba-8707-4bbf-9fea-f4ac1ca0f778 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:21.750120 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004fbba-8707-4bbf-9fea-f4ac1ca0f778 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:21.751623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004fbba-8707-4bbf-9fea-f4ac1ca0f778 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:21.775126 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 298/589] 10.222.0.32 () {56 vars in 1137 bytes} [Thu Jun 2 13:23:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:21.776222 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004fbba-8707-4bbf-9fea-f4ac1ca0f778 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:21.776950 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625004a8-aeef-41b8-bb13-989d89f9b8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:21.777618 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625004a8-aeef-41b8-bb13-989d89f9b8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:21.777899 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625004a8-aeef-41b8-bb13-989d89f9b8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:21.778171 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625004a8-aeef-41b8-bb13-989d89f9b8c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:21.778890 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625004a8-aeef-41b8-bb13-989d89f9b8c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:21.779189 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625004a8-aeef-41b8-bb13-989d89f9b8c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:21.781956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625004a8-aeef-41b8-bb13-989d89f9b8c4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:21.797476 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 292/590] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:21.800884 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625004a8-aeef-41b8-bb13-989d89f9b8c4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:21.809611 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:21.889262 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004fbba-8707-4bbf-9fea-f4ac1ca0f778 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:21.899275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:21.929797 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b491998-081f-4600-93b8-75a57b03ecc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:21.930592 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b491998-081f-4600-93b8-75a57b03ecc5 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:21.930900 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b491998-081f-4600-93b8-75a57b03ecc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:21.931181 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b491998-081f-4600-93b8-75a57b03ecc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:21.932030 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625004a8-aeef-41b8-bb13-989d89f9b8c4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:21.944410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b491998-081f-4600-93b8-75a57b03ecc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:21.946143 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b491998-081f-4600-93b8-75a57b03ecc5 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:21.969859 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb41b09-14f2-4d33-bb0d-0bf8bf750fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:21.970821 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb41b09-14f2-4d33-bb0d-0bf8bf750fcd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:21.971204 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb41b09-14f2-4d33-bb0d-0bf8bf750fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:21.971308 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-7b491998-081f-4600-93b8-75a57b03ecc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:21.971308 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:21.971308 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:21.971308 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:21.971308 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:21.971308 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:21.971308 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:21.971308 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:21.971308 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:21.971308 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:21.971308 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:21.971308 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:21.971308 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:21.971308 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:21.971308 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:21.972927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:21.972927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:21.972927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:21.972927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:21.972927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:21.972927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:21.972927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:21.972927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:21.972927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:21.972927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:21.972927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:21.972927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:21.972927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:21.972927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:21.972927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:21.972927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:21.972927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:21.973977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:21.973977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:21.973977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:21.973977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:21.974254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb41b09-14f2-4d33-bb0d-0bf8bf750fcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:21.976475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 299/591] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:21.977398 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b491998-081f-4600-93b8-75a57b03ecc5 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:21.989801 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb41b09-14f2-4d33-bb0d-0bf8bf750fcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:21.991324 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb41b09-14f2-4d33-bb0d-0bf8bf750fcd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:22.012078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-3cb41b09-14f2-4d33-bb0d-0bf8bf750fcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:22.012078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:22.012078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:22.012078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:22.012078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:22.012078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:22.012078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:22.012078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:22.012078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:22.012078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:22.012078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:22.012078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:22.012078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:22.012078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:22.012078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:22.013100 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:22.013100 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:22.013100 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:22.013100 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:22.013100 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:22.013100 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:22.013100 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:22.013100 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:22.013100 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:22.013100 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:22.013100 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:22.013100 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:22.013100 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:22.013100 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:22.013100 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:22.013100 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:22.013100 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:22.013988 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:22.013988 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:22.013988 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:22.013988 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:22.019067 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 293/592] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:22.019970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb41b09-14f2-4d33-bb0d-0bf8bf750fcd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:22.081830 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:22.110663 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b491998-081f-4600-93b8-75a57b03ecc5 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:22.140372 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb41b09-14f2-4d33-bb0d-0bf8bf750fcd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:22.146150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ed538-30a8-4126-ac3b-4ecaeaa451b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:22.146964 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ed538-30a8-4126-ac3b-4ecaeaa451b2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:22.147250 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ed538-30a8-4126-ac3b-4ecaeaa451b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:22.147531 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ed538-30a8-4126-ac3b-4ecaeaa451b2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:22.155853 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ed538-30a8-4126-ac3b-4ecaeaa451b2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:22.157328 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ed538-30a8-4126-ac3b-4ecaeaa451b2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:22.170745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:22.172226 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-958ed538-30a8-4126-ac3b-4ecaeaa451b2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 13:23:22.172226 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:22.172226 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:22.172226 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:22.172226 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:22.172226 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:22.172226 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:22.172226 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:22.172226 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:22.172226 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:22.172226 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:22.172226 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:22.172226 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:23:22.172226 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:23:22.172226 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:23:22.172226 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:23:22.173164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:22.173164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:22.173164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:23:22.173164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:22.173164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:23:22.173164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:22.173164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:22.173164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:22.173164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:22.173164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:22.173164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:22.173164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:22.173164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:22.173164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:22.173164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:22.173164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:22.173164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:22.173164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:22.174253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:22.174253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:22.174253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:23:22.174253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:23:22.174253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:23:22.174253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:23:22.174253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:23:22.174253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:23:22.174253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 13:23:22.174253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:22.178029 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 300/593] 10.222.0.32 () {56 vars in 1102 bytes} [Thu Jun 2 13:23:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:22.178889 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ed538-30a8-4126-ac3b-4ecaeaa451b2 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:22.183152 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44a970-8cac-438c-a6e8-eb335985e7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:22.184077 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44a970-8cac-438c-a6e8-eb335985e7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:22.184589 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44a970-8cac-438c-a6e8-eb335985e7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:22.185061 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44a970-8cac-438c-a6e8-eb335985e7a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:22.185972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44a970-8cac-438c-a6e8-eb335985e7a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:22.186487 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44a970-8cac-438c-a6e8-eb335985e7a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:22.188179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44a970-8cac-438c-a6e8-eb335985e7a9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:22.206102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 294/594] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:22.207316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44a970-8cac-438c-a6e8-eb335985e7a9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:22.283100 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ed538-30a8-4126-ac3b-4ecaeaa451b2 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:22.311855 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44a970-8cac-438c-a6e8-eb335985e7a9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:22.318426 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df8b3e-758d-4f0d-a164-f2c74ca5101d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:22.319091 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df8b3e-758d-4f0d-a164-f2c74ca5101d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:22.319376 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df8b3e-758d-4f0d-a164-f2c74ca5101d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:22.319650 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df8b3e-758d-4f0d-a164-f2c74ca5101d None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:22.320401 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df8b3e-758d-4f0d-a164-f2c74ca5101d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:22.320712 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df8b3e-758d-4f0d-a164-f2c74ca5101d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:22.322702 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df8b3e-758d-4f0d-a164-f2c74ca5101d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:22.324366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:22.340148 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 301/595] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:22.340973 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df8b3e-758d-4f0d-a164-f2c74ca5101d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:22.351177 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce22232-21fc-43db-86c8-d3fb1e63ac91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:22.352096 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce22232-21fc-43db-86c8-d3fb1e63ac91 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:22.352624 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce22232-21fc-43db-86c8-d3fb1e63ac91 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:22.353194 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce22232-21fc-43db-86c8-d3fb1e63ac91 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:22.354234 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce22232-21fc-43db-86c8-d3fb1e63ac91 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:22.354797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce22232-21fc-43db-86c8-d3fb1e63ac91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:22.356449 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce22232-21fc-43db-86c8-d3fb1e63ac91 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:22.375203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 295/596] 10.222.0.32 () {56 vars in 1139 bytes} [Thu Jun 2 13:23:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:22.376291 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce22232-21fc-43db-86c8-d3fb1e63ac91 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:22.441249 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:22.462801 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df8b3e-758d-4f0d-a164-f2c74ca5101d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:22.504739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5bbf2-0a96-44ac-99d5-557e431c7a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:22.506023 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5bbf2-0a96-44ac-99d5-557e431c7a17 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:22.506454 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5bbf2-0a96-44ac-99d5-557e431c7a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:22.507020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5bbf2-0a96-44ac-99d5-557e431c7a17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:22.514883 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce22232-21fc-43db-86c8-d3fb1e63ac91 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:22.516897 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5bbf2-0a96-44ac-99d5-557e431c7a17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:22.519295 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5bbf2-0a96-44ac-99d5-557e431c7a17 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:22.537901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-02a5bbf2-0a96-44ac-99d5-557e431c7a17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:22.537901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:22.537901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:22.537901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:22.537901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:22.537901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:22.537901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:22.537901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:22.537901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:22.537901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:22.537901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:22.537901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:22.537901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:23:22.537901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:23:22.537901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:23:22.538939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:23:22.538939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:22.538939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:22.538939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:22.538939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:22.538939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:22.538939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:22.538939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:22.538939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:22.538939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:22.538939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:22.538939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:22.538939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:22.538939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:22.538939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:22.538939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:22.538939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:22.539816 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:23:22.539816 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:23:22.539816 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:23:22.539816 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:23:22.539816 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:23:22.539816 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:23:22.539816 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:22.539816 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:22.546444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 302/597] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:22.546444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5bbf2-0a96-44ac-99d5-557e431c7a17 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:22.561779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d928a-9c4c-4098-8726-832625f2a136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:22.562983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d928a-9c4c-4098-8726-832625f2a136 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:22.563463 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d928a-9c4c-4098-8726-832625f2a136 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:22.563975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d928a-9c4c-4098-8726-832625f2a136 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:22.571541 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d928a-9c4c-4098-8726-832625f2a136 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:22.573827 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d928a-9c4c-4098-8726-832625f2a136 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:22.589299 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-358d928a-9c4c-4098-8726-832625f2a136 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:22.589299 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:22.589299 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:22.589299 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:22.589299 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:22.589299 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:22.589299 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:22.589299 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:22.589299 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:22.589299 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:22.589299 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:22.589299 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:22.589299 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:23:22.589299 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:23:22.589299 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:23:22.590228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:23:22.590228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:22.590228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:22.590228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:22.590228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:22.590228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:22.590228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:22.590228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:22.590228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:22.590228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:22.590228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:22.590228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:22.590228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:22.590228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:22.590228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:22.590228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:22.590228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:22.591197 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:23:22.591197 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:23:22.591197 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:23:22.591197 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:23:22.591197 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:23:22.591197 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:23:22.591197 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:22.591197 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:22.593656 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 296/598] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:22.594651 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d928a-9c4c-4098-8726-832625f2a136 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:22.615210 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:22.664852 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5bbf2-0a96-44ac-99d5-557e431c7a17 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:22.708694 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa81b4-9c40-49af-b481-96a8cfb807c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:22.709513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa81b4-9c40-49af-b481-96a8cfb807c2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:22.710061 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa81b4-9c40-49af-b481-96a8cfb807c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:22.710352 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa81b4-9c40-49af-b481-96a8cfb807c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:22.710608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d928a-9c4c-4098-8726-832625f2a136 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:22.718729 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:22.724077 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa81b4-9c40-49af-b481-96a8cfb807c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:22.725825 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa81b4-9c40-49af-b481-96a8cfb807c2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:22.745044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-e3fa81b4-9c40-49af-b481-96a8cfb807c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:22.745044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:22.745044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:22.745044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:22.745044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:22.745044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:22.745044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:22.745044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:22.745044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:22.745044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:22.745044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:22.745044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:22.745044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:22.745044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:22.745044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:22.746020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:22.746020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:22.746020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:22.746020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:22.746020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:22.746020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:22.746020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:22.746020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:22.746020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:22.746020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:22.746020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:22.746020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:22.746020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:22.746020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:22.746020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:22.746020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:22.746020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:22.746952 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:22.746952 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:22.746952 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:22.746952 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:22.746952 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 303/599] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:22.747725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa81b4-9c40-49af-b481-96a8cfb807c2 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:22.749528 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b27a4-9afd-4142-b8d0-c23ee885bcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:22.750427 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b27a4-9afd-4142-b8d0-c23ee885bcc3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:22.750910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b27a4-9afd-4142-b8d0-c23ee885bcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:22.751391 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b27a4-9afd-4142-b8d0-c23ee885bcc3 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:22.752425 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b27a4-9afd-4142-b8d0-c23ee885bcc3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:22.752949 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b27a4-9afd-4142-b8d0-c23ee885bcc3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:22.754581 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b27a4-9afd-4142-b8d0-c23ee885bcc3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:22.767725 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 297/600] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:23:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:22.768854 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b27a4-9afd-4142-b8d0-c23ee885bcc3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:22.856100 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa81b4-9c40-49af-b481-96a8cfb807c2 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:22.866412 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:22.895042 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbca3e5-d8b2-4c77-86b5-dfa59e3452b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:22.895684 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbca3e5-d8b2-4c77-86b5-dfa59e3452b2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:22.895972 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbca3e5-d8b2-4c77-86b5-dfa59e3452b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:22.896253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbca3e5-d8b2-4c77-86b5-dfa59e3452b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:22.897086 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbca3e5-d8b2-4c77-86b5-dfa59e3452b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:22.897398 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbca3e5-d8b2-4c77-86b5-dfa59e3452b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:22.898839 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbca3e5-d8b2-4c77-86b5-dfa59e3452b2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:22.906544 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b27a4-9afd-4142-b8d0-c23ee885bcc3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:22.911708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 304/601] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:23:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:22.912645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbca3e5-d8b2-4c77-86b5-dfa59e3452b2 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:22.944562 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e07d8c-b21f-429f-9d73-5179764e0bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:22.945661 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e07d8c-b21f-429f-9d73-5179764e0bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:22.946161 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e07d8c-b21f-429f-9d73-5179764e0bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:22.947166 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e07d8c-b21f-429f-9d73-5179764e0bc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:22.948194 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e07d8c-b21f-429f-9d73-5179764e0bc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:22.948783 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e07d8c-b21f-429f-9d73-5179764e0bc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:22.950419 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e07d8c-b21f-429f-9d73-5179764e0bc8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:22.964522 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 298/602] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:22.965702 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e07d8c-b21f-429f-9d73-5179764e0bc8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:22.995603 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:23.021111 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbca3e5-d8b2-4c77-86b5-dfa59e3452b2 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:23.058604 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d1893-a456-43fb-967d-0e84f34add43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:23.059882 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d1893-a456-43fb-967d-0e84f34add43 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:23.060357 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d1893-a456-43fb-967d-0e84f34add43 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:23.060825 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d1893-a456-43fb-967d-0e84f34add43 None admin] PATH_INFO: `/v3/projects/a9007447059e4862972078c032a5d67b/users/9e239e4e9b99433ca9d1a8db45e24b56/roles/a12865c9fb9e4fa0b61e4adfd53188fb` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:23.077603 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d1893-a456-43fb-967d-0e84f34add43 None admin] RBAC: Authorizing `identity:create_grant(project_id=a9007447059e4862972078c032a5d67b, user_id=9e239e4e9b99433ca9d1a8db45e24b56, role_id=a12865c9fb9e4fa0b61e4adfd53188fb)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:23.079451 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d1893-a456-43fb-967d-0e84f34add43 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:23.082922 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e07d8c-b21f-429f-9d73-5179764e0bc8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:23.094788 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 305/603] 10.222.0.32 () {58 vars in 1439 bytes} [Thu Jun 2 13:23:22 2022] PUT /identity/v3/projects/a9007447059e4862972078c032a5d67b/users/9e239e4e9b99433ca9d1a8db45e24b56/roles/a12865c9fb9e4fa0b61e4adfd53188fb => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:23.096124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d1893-a456-43fb-967d-0e84f34add43 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:23.116978 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:23.124336 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa1624-4e94-4ffc-affb-ec6cfc3f63cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:23.124917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa1624-4e94-4ffc-affb-ec6cfc3f63cb None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:23.127407 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa1624-4e94-4ffc-affb-ec6cfc3f63cb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:23.127407 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa1624-4e94-4ffc-affb-ec6cfc3f63cb None admin] PATH_INFO: `/v3/projects/a9007447059e4862972078c032a5d67b/users/09a1e517aa87428ebdb1e54671a8d93d/roles/a12865c9fb9e4fa0b61e4adfd53188fb` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:23.145232 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa1624-4e94-4ffc-affb-ec6cfc3f63cb None admin] RBAC: Authorizing `identity:create_grant(project_id=a9007447059e4862972078c032a5d67b, user_id=09a1e517aa87428ebdb1e54671a8d93d, role_id=a12865c9fb9e4fa0b61e4adfd53188fb)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:23.146782 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa1624-4e94-4ffc-affb-ec6cfc3f63cb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:23.168759 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 299/604] 10.222.0.32 () {58 vars in 1439 bytes} [Thu Jun 2 13:23:22 2022] PUT /identity/v3/projects/a9007447059e4862972078c032a5d67b/users/09a1e517aa87428ebdb1e54671a8d93d/roles/a12865c9fb9e4fa0b61e4adfd53188fb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:23.214076 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c761d4-c14c-44ee-8ad3-f1246020e76d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:23.214414 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c761d4-c14c-44ee-8ad3-f1246020e76d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:23.214688 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c761d4-c14c-44ee-8ad3-f1246020e76d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:23.216274 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 300/605] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:23:23.224003 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eead75-8946-4c8c-bb67-d888bd5696ce None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:23.224722 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eead75-8946-4c8c-bb67-d888bd5696ce None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:23.225222 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eead75-8946-4c8c-bb67-d888bd5696ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:23.247585 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-77eead75-8946-4c8c-bb67-d888bd5696ce None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:23.248857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-77eead75-8946-4c8c-bb67-d888bd5696ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:23.265921 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d1893-a456-43fb-967d-0e84f34add43 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:23.310198 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78155a-05cb-4e26-bd96-08ab99ab6b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:23.311501 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78155a-05cb-4e26-bd96-08ab99ab6b69 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:23.312007 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78155a-05cb-4e26-bd96-08ab99ab6b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:23.312580 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78155a-05cb-4e26-bd96-08ab99ab6b69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:23.322122 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78155a-05cb-4e26-bd96-08ab99ab6b69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:23.324001 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78155a-05cb-4e26-bd96-08ab99ab6b69 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:23.330873 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 301/606] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:23:23.349019 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-8c78155a-05cb-4e26-bd96-08ab99ab6b69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:23.349019 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:23.349019 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:23.349019 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:23.349019 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:23.349019 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:23.349019 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:23.349019 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:23.349019 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:23.349019 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:23.349019 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:23.349019 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:23.349019 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:23:23.349019 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:23:23.349019 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:23:23.350018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:23:23.350018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:23.350018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:23.350018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:23.350018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:23.350018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:23.350018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:23.350018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:23.350018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:23.350018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:23.350018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:23.350018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:23.350018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:23.350018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:23.350018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:23.350018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:23.350018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:23.350918 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:23:23.350918 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:23:23.350918 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:23:23.350918 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:23:23.350918 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:23:23.350918 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:23:23.350918 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:23.350918 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:23.353661 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 306/607] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:23.358141 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eead75-8946-4c8c-bb67-d888bd5696ce None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:23.358972 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78155a-05cb-4e26-bd96-08ab99ab6b69 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:23.368033 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:23.459442 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:23.491091 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eead75-8946-4c8c-bb67-d888bd5696ce None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:23.491425 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78155a-05cb-4e26-bd96-08ab99ab6b69 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:23.532213 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0cd01-0081-4ec6-947d-76868b7d25e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:23.533728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0cd01-0081-4ec6-947d-76868b7d25e9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:23.534208 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0cd01-0081-4ec6-947d-76868b7d25e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:23.534675 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0cd01-0081-4ec6-947d-76868b7d25e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:23.542725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7be48a-760f-427d-a039-dcc5cbe7cee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:23.543458 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7be48a-760f-427d-a039-dcc5cbe7cee9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:23.543811 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7be48a-760f-427d-a039-dcc5cbe7cee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:23.544172 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7be48a-760f-427d-a039-dcc5cbe7cee9 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:23.546301 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7be48a-760f-427d-a039-dcc5cbe7cee9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:23.546301 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7be48a-760f-427d-a039-dcc5cbe7cee9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:23.547448 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7be48a-760f-427d-a039-dcc5cbe7cee9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:23.549539 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0cd01-0081-4ec6-947d-76868b7d25e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:23.557642 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-58e0cd01-0081-4ec6-947d-76868b7d25e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:23.557642 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:23.557642 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:23.557642 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:23.557642 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:23.557642 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:23.557642 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:23.557642 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:23.557642 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:23.557642 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:23.557642 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:23.557642 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:23.557642 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:23.557642 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:23.557642 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:23.557642 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:23.558632 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:23.558632 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:23.558632 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:23.558632 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:23.558632 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:23.558632 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:23.558632 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:23.558632 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:23.558632 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:23.558632 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:23.558632 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:23.558632 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:23.558632 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:23.558632 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:23.558632 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:23.558632 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:23.559555 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:23.559555 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:23.559555 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:23.559555 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:23.559555 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:23.559555 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:23.559555 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:23.559555 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:23.559555 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:23.559555 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:23.559555 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:23.559555 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:23.561519 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 307/608] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:23:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:23.562496 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 302/609] 10.222.0.32 () {56 vars in 1102 bytes} [Thu Jun 2 13:23:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:23.566797 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7be48a-760f-427d-a039-dcc5cbe7cee9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:23.568331 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0cd01-0081-4ec6-947d-76868b7d25e9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:23.648220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:23.689909 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0cd01-0081-4ec6-947d-76868b7d25e9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:23.730595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee01b0-b9da-4cd9-9997-e700a844fd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:23.731649 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee01b0-b9da-4cd9-9997-e700a844fd81 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:23.732217 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee01b0-b9da-4cd9-9997-e700a844fd81 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:23.732678 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee01b0-b9da-4cd9-9997-e700a844fd81 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:23.733725 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee01b0-b9da-4cd9-9997-e700a844fd81 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:23.734188 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee01b0-b9da-4cd9-9997-e700a844fd81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:23.736047 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee01b0-b9da-4cd9-9997-e700a844fd81 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:23.746091 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 303/610] 10.222.0.32 () {56 vars in 1103 bytes} [Thu Jun 2 13:23:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:23.752182 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee01b0-b9da-4cd9-9997-e700a844fd81 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:23.781772 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7be48a-760f-427d-a039-dcc5cbe7cee9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:23.843159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bec2f-342c-4b93-aa55-dee606eb093c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:23.844608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bec2f-342c-4b93-aa55-dee606eb093c None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:23.844900 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bec2f-342c-4b93-aa55-dee606eb093c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:23.845185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bec2f-342c-4b93-aa55-dee606eb093c None admin] PATH_INFO: `/v3/projects/a9007447059e4862972078c032a5d67b/users/9eb2722c122f4aeba23ec16b5a3c485f/roles/a12865c9fb9e4fa0b61e4adfd53188fb` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:23.856733 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:23.865144 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bec2f-342c-4b93-aa55-dee606eb093c None admin] RBAC: Authorizing `identity:create_grant(project_id=a9007447059e4862972078c032a5d67b, user_id=9eb2722c122f4aeba23ec16b5a3c485f, role_id=a12865c9fb9e4fa0b61e4adfd53188fb)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:23.867263 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bec2f-342c-4b93-aa55-dee606eb093c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:23.877494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee01b0-b9da-4cd9-9997-e700a844fd81 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:23.885689 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 308/611] 10.222.0.32 () {58 vars in 1439 bytes} [Thu Jun 2 13:23:23 2022] PUT /identity/v3/projects/a9007447059e4862972078c032a5d67b/users/9eb2722c122f4aeba23ec16b5a3c485f/roles/a12865c9fb9e4fa0b61e4adfd53188fb => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:23:23.893427 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb769a-f452-4933-b7b8-1442937c0b63 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:23.896325 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb769a-f452-4933-b7b8-1442937c0b63 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:23.898238 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb769a-f452-4933-b7b8-1442937c0b63 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:23.901869 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 309/612] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:23 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:23.912411 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95e4fd-af9e-419c-a5cd-f9c8ef0779cd None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:23.912411 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95e4fd-af9e-419c-a5cd-f9c8ef0779cd None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:23.912411 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95e4fd-af9e-419c-a5cd-f9c8ef0779cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:23.938553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-9f95e4fd-af9e-419c-a5cd-f9c8ef0779cd None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:23.940154 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9f95e4fd-af9e-419c-a5cd-f9c8ef0779cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:23.944636 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:23.961834 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ccd0e-3bd1-4305-b6cd-ef98e2e21375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:23.964437 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ccd0e-3bd1-4305-b6cd-ef98e2e21375 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:23.965006 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ccd0e-3bd1-4305-b6cd-ef98e2e21375 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:23.965400 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ccd0e-3bd1-4305-b6cd-ef98e2e21375 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:23.991623 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ccd0e-3bd1-4305-b6cd-ef98e2e21375 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:23.995884 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ccd0e-3bd1-4305-b6cd-ef98e2e21375 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:24.029674 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-881ccd0e-3bd1-4305-b6cd-ef98e2e21375 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:24.029674 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:24.029674 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:24.029674 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:24.029674 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:24.029674 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:24.029674 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:24.029674 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:24.029674 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:24.029674 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:24.029674 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:24.029674 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:24.029674 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:24.029674 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:24.029674 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:24.030668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:24.030668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:24.030668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:24.030668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:24.030668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:24.030668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:24.030668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:24.030668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:24.030668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:24.030668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:24.030668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:24.030668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:24.030668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:24.030668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:24.030668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:24.030668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:24.030668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:24.031569 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:24.031569 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:24.031569 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:24.031569 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:24.032458 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 304/613] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:24.039019 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ccd0e-3bd1-4305-b6cd-ef98e2e21375 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:24.116507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 310/614] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:23:24.148206 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95e4fd-af9e-419c-a5cd-f9c8ef0779cd None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:24.164594 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ccd0e-3bd1-4305-b6cd-ef98e2e21375 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:24.206030 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f562c-46d4-4f88-a8c6-bd7ea4dcda96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:24.206698 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f562c-46d4-4f88-a8c6-bd7ea4dcda96 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:24.207013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f562c-46d4-4f88-a8c6-bd7ea4dcda96 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:24.207361 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f562c-46d4-4f88-a8c6-bd7ea4dcda96 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:24.208187 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f562c-46d4-4f88-a8c6-bd7ea4dcda96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:24.208545 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f562c-46d4-4f88-a8c6-bd7ea4dcda96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:24.210199 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f562c-46d4-4f88-a8c6-bd7ea4dcda96 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:24.223852 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 305/615] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:24.230681 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f562c-46d4-4f88-a8c6-bd7ea4dcda96 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:24.302779 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95e4fd-af9e-419c-a5cd-f9c8ef0779cd None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:24.309251 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:24.320864 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:24.347685 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c93507-0bde-41c8-ac7e-7a97b62a4190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:24.348515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c93507-0bde-41c8-ac7e-7a97b62a4190 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:24.348804 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c93507-0bde-41c8-ac7e-7a97b62a4190 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:24.349079 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c93507-0bde-41c8-ac7e-7a97b62a4190 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:24.375112 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c93507-0bde-41c8-ac7e-7a97b62a4190 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:24.382843 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-49c93507-0bde-41c8-ac7e-7a97b62a4190 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:24.382843 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:24.382843 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:24.382843 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:24.382843 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:24.382843 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:24.382843 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:24.382843 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:24.382843 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:24.382843 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:24.382843 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:24.382843 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:24.382843 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:24.382843 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:24.382843 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:24.382843 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:24.383999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:24.383999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:24.383999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:24.383999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:24.383999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:24.383999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:24.383999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:24.383999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:24.383999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:24.383999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:24.383999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:24.383999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:24.383999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:24.383999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:24.383999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:24.383999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:24.385056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:24.385056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:24.385056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:24.385056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:24.385056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:24.385056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:24.385056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:24.385056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:24.385056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:24.385056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:24.385056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:24.385056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:24.385955 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 311/616] 10.222.0.32 () {56 vars in 1102 bytes} [Thu Jun 2 13:23:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:23:24.394334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c93507-0bde-41c8-ac7e-7a97b62a4190 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:24.415014 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f562c-46d4-4f88-a8c6-bd7ea4dcda96 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:24.477629 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f745d-8d3e-4bfd-b17d-4fd6ba511b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:24.478958 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f745d-8d3e-4bfd-b17d-4fd6ba511b6a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:24.479240 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f745d-8d3e-4bfd-b17d-4fd6ba511b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:24.479517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f745d-8d3e-4bfd-b17d-4fd6ba511b6a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:24.489444 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f745d-8d3e-4bfd-b17d-4fd6ba511b6a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:24.490905 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f745d-8d3e-4bfd-b17d-4fd6ba511b6a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:24.510668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-3c3f745d-8d3e-4bfd-b17d-4fd6ba511b6a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:23:24.510668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:24.510668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:24.510668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:24.510668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:24.510668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:24.510668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:24.510668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:24.510668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:24.510668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:24.510668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:24.510668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:24.510668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:23:24.510668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:23:24.510668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:23:24.510668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:23:24.511860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:24.511860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:24.511860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:23:24.511860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:24.511860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:23:24.511860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:24.511860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:24.511860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:24.511860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:24.511860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:24.511860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:24.511860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:24.511860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:24.511860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:24.511860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:24.511860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:24.511860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:24.511860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:24.513051 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:24.513051 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:24.513051 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:23:24.513051 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:23:24.513051 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:23:24.513051 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:23:24.513051 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:23:24.513051 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:23:24.513051 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:23:24.513051 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:24.513051 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 306/617] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:23:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:24.522858 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f745d-8d3e-4bfd-b17d-4fd6ba511b6a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:24.572635 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c93507-0bde-41c8-ac7e-7a97b62a4190 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:24.671409 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:24.676800 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f745d-8d3e-4bfd-b17d-4fd6ba511b6a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:24.677766 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae712d-7b3f-41b9-aa2f-5b351179636a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:24.678528 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae712d-7b3f-41b9-aa2f-5b351179636a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:24.678883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae712d-7b3f-41b9-aa2f-5b351179636a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:24.679314 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae712d-7b3f-41b9-aa2f-5b351179636a None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:24.680050 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae712d-7b3f-41b9-aa2f-5b351179636a None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:24.680475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae712d-7b3f-41b9-aa2f-5b351179636a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:24.681955 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae712d-7b3f-41b9-aa2f-5b351179636a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:24.706843 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 312/618] 10.222.0.32 () {56 vars in 1103 bytes} [Thu Jun 2 13:23:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:24.712007 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae712d-7b3f-41b9-aa2f-5b351179636a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:24.731902 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d52d7-a93f-43ef-9621-46ba1fa59fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:24.732627 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d52d7-a93f-43ef-9621-46ba1fa59fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:24.732912 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d52d7-a93f-43ef-9621-46ba1fa59fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:24.733188 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d52d7-a93f-43ef-9621-46ba1fa59fd5 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:24.734042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d52d7-a93f-43ef-9621-46ba1fa59fd5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:24.734354 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d52d7-a93f-43ef-9621-46ba1fa59fd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:24.735801 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d52d7-a93f-43ef-9621-46ba1fa59fd5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:24.767742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 307/619] 10.222.0.32 () {56 vars in 1135 bytes} [Thu Jun 2 13:23:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:24.773196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d52d7-a93f-43ef-9621-46ba1fa59fd5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:24.792445 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:24.893737 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae712d-7b3f-41b9-aa2f-5b351179636a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:24.949438 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d52d7-a93f-43ef-9621-46ba1fa59fd5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:24.959299 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3cddd-7423-445d-b4b5-291c1960f16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:24.960373 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3cddd-7423-445d-b4b5-291c1960f16f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:24.960659 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3cddd-7423-445d-b4b5-291c1960f16f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:24.960940 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3cddd-7423-445d-b4b5-291c1960f16f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:24.985441 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b31c2-08c0-482a-88b8-9a1137e60ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:24.986163 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3cddd-7423-445d-b4b5-291c1960f16f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:24.986288 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b31c2-08c0-482a-88b8-9a1137e60ccf None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:24.986504 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b31c2-08c0-482a-88b8-9a1137e60ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:24.986782 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b31c2-08c0-482a-88b8-9a1137e60ccf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:24.987684 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3cddd-7423-445d-b4b5-291c1960f16f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:24.997374 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b31c2-08c0-482a-88b8-9a1137e60ccf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:24.998825 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b31c2-08c0-482a-88b8-9a1137e60ccf None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:25.019946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-241b31c2-08c0-482a-88b8-9a1137e60ccf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:25.019946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:25.019946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:25.019946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:25.019946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:25.019946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:25.019946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:25.019946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:25.019946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:25.019946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:25.019946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:25.019946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:25.019946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:25.019946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:25.019946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:25.020895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:25.020895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:25.020895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:25.020895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:25.020895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:25.020895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:25.020895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:25.020895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:25.020895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:25.020895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:25.020895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:25.020895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:25.020895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:25.020895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:25.020895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:25.020895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:25.020895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:25.021789 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:25.021789 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:25.021789 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:25.021789 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:25.021789 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 308/620] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:25.023392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-4bc3cddd-7423-445d-b4b5-291c1960f16f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:25.023392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:25.023392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:25.023392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:25.023392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:25.023392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:25.023392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:25.023392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:25.023392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:25.023392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:25.023392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:25.023392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:25.023392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:25.023392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:25.023392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:25.024428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:25.024428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:25.024428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:25.024428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:25.024428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:25.024428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:25.024428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:25.024428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:25.024428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:25.024428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:25.024428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:25.024428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:25.024428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:25.024428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:25.024428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:25.024428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:25.024428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:25.025504 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:25.025504 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:25.025504 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:25.025504 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:25.025504 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 313/621] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:25.029967 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b31c2-08c0-482a-88b8-9a1137e60ccf None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:25.031465 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3cddd-7423-445d-b4b5-291c1960f16f None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:25.053557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:25.196782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:25.204548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b31c2-08c0-482a-88b8-9a1137e60ccf None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:25.207831 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3cddd-7423-445d-b4b5-291c1960f16f None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:25.275597 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66708e-34f3-4937-a574-a914b4e7f460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:25.276264 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66708e-34f3-4937-a574-a914b4e7f460 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:25.276577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66708e-34f3-4937-a574-a914b4e7f460 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:25.276857 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66708e-34f3-4937-a574-a914b4e7f460 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:25.277587 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66708e-34f3-4937-a574-a914b4e7f460 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:25.277895 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66708e-34f3-4937-a574-a914b4e7f460 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:25.279275 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66708e-34f3-4937-a574-a914b4e7f460 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:25.282271 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce967a-b2e3-4b30-924d-a8727185338b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:25.283002 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce967a-b2e3-4b30-924d-a8727185338b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:25.283288 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce967a-b2e3-4b30-924d-a8727185338b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:25.283566 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce967a-b2e3-4b30-924d-a8727185338b None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:25.284307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce967a-b2e3-4b30-924d-a8727185338b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:25.284619 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce967a-b2e3-4b30-924d-a8727185338b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:25.285994 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce967a-b2e3-4b30-924d-a8727185338b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:25.309732 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 309/622] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:25.315139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce967a-b2e3-4b30-924d-a8727185338b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:25.315605 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 314/623] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:25.316512 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66708e-34f3-4937-a574-a914b4e7f460 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:25.395763 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:25.433827 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce967a-b2e3-4b30-924d-a8727185338b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:25.485098 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e406b-798d-4c5d-83dc-114dc55dacbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:25.486248 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e406b-798d-4c5d-83dc-114dc55dacbf None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:25.486742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e406b-798d-4c5d-83dc-114dc55dacbf None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:25.487233 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e406b-798d-4c5d-83dc-114dc55dacbf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:25.501829 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e406b-798d-4c5d-83dc-114dc55dacbf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:25.512347 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e406b-798d-4c5d-83dc-114dc55dacbf None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:25.532277 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66708e-34f3-4937-a574-a914b4e7f460 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:25.544323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-943e406b-798d-4c5d-83dc-114dc55dacbf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:23:25.544323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:25.544323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:25.544323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:25.544323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:25.544323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:25.544323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:25.544323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:25.544323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:25.544323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:25.544323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:25.544323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:25.544323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:23:25.544323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:23:25.544323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:23:25.544323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:23:25.545303 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:25.545303 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:25.545303 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:23:25.545303 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:25.545303 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:23:25.545303 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:25.545303 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:25.545303 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:25.545303 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:25.545303 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:25.545303 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:25.545303 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:25.545303 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:25.545303 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:25.545303 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:25.545303 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:25.545303 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:25.545303 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:25.546255 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:25.546255 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:25.546255 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:23:25.546255 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:23:25.546255 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:23:25.546255 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:23:25.546255 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:23:25.546255 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:23:25.546255 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:23:25.546255 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:25.553176 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 310/624] 10.222.0.32 () {56 vars in 1093 bytes} [Thu Jun 2 13:23:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:23:25.565623 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e406b-798d-4c5d-83dc-114dc55dacbf None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:25.593468 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78890a0c-dc1d-417a-ba9d-b453ec487d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:25.594262 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78890a0c-dc1d-417a-ba9d-b453ec487d9c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:25.594548 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78890a0c-dc1d-417a-ba9d-b453ec487d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:25.594835 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78890a0c-dc1d-417a-ba9d-b453ec487d9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:25.610243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78890a0c-dc1d-417a-ba9d-b453ec487d9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:25.611800 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78890a0c-dc1d-417a-ba9d-b453ec487d9c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:25.645632 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-78890a0c-dc1d-417a-ba9d-b453ec487d9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:25.645632 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:25.645632 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:25.645632 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:25.645632 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:25.645632 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:25.645632 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:25.645632 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:25.645632 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:25.645632 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:25.645632 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:25.645632 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:25.645632 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:23:25.645632 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:23:25.645632 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:23:25.646606 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:23:25.646606 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:25.646606 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:25.646606 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:25.646606 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:25.646606 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:25.646606 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:25.646606 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:25.646606 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:25.646606 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:25.646606 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:25.646606 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:25.646606 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:25.646606 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:25.646606 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:25.646606 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:25.646606 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:25.647489 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:23:25.647489 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:23:25.647489 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:23:25.647489 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:23:25.647489 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:23:25.647489 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:23:25.647489 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:25.647489 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:25.648388 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 315/625] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:25.656163 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78890a0c-dc1d-417a-ba9d-b453ec487d9c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:25.683627 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e406b-798d-4c5d-83dc-114dc55dacbf None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:25.692746 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:25.751545 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:25.759366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42646996-bd4c-4dc2-9528-f9bd1fe3aff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:25.760042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42646996-bd4c-4dc2-9528-f9bd1fe3aff6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:25.760346 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42646996-bd4c-4dc2-9528-f9bd1fe3aff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:25.760631 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42646996-bd4c-4dc2-9528-f9bd1fe3aff6 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:25.761480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42646996-bd4c-4dc2-9528-f9bd1fe3aff6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:25.761792 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42646996-bd4c-4dc2-9528-f9bd1fe3aff6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:25.764774 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42646996-bd4c-4dc2-9528-f9bd1fe3aff6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:25.797240 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 311/626] 10.222.0.32 () {56 vars in 1133 bytes} [Thu Jun 2 13:23:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:25.809357 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42646996-bd4c-4dc2-9528-f9bd1fe3aff6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:25.835997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78890a0c-dc1d-417a-ba9d-b453ec487d9c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:25.876003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd97419-42eb-4482-b983-ee70a57865b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:25.876697 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd97419-42eb-4482-b983-ee70a57865b8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:25.877097 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd97419-42eb-4482-b983-ee70a57865b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:25.877456 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd97419-42eb-4482-b983-ee70a57865b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:25.878713 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd97419-42eb-4482-b983-ee70a57865b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:25.879031 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd97419-42eb-4482-b983-ee70a57865b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:25.880648 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd97419-42eb-4482-b983-ee70a57865b8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:25.894501 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 316/627] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:23:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:25.895851 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f204f-0f86-4b03-858c-3f0207af7e0e None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:25.896144 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f204f-0f86-4b03-858c-3f0207af7e0e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:25.896450 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f204f-0f86-4b03-858c-3f0207af7e0e None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:25.902061 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 317/628] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:25.902866 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f204f-0f86-4b03-858c-3f0207af7e0e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:25.933920 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42646996-bd4c-4dc2-9528-f9bd1fe3aff6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:25.982743 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c947d0-5985-452d-b9d2-09387032d138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:25.983447 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c947d0-5985-452d-b9d2-09387032d138 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:25.983736 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c947d0-5985-452d-b9d2-09387032d138 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:25.984014 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c947d0-5985-452d-b9d2-09387032d138 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:25.991199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:26.031443 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f204f-0f86-4b03-858c-3f0207af7e0e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:26.053336 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:26.068531 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c947d0-5985-452d-b9d2-09387032d138 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:26.070553 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c947d0-5985-452d-b9d2-09387032d138 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:26.072945 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae9e8c-8f30-45ea-a930-e8e69c12e9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:26.073848 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae9e8c-8f30-45ea-a930-e8e69c12e9b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:26.074166 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae9e8c-8f30-45ea-a930-e8e69c12e9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:26.075166 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae9e8c-8f30-45ea-a930-e8e69c12e9b5 None admin] PATH_INFO: `/v3/projects/a9007447059e4862972078c032a5d67b/users/3aea97e7b39448a283032f662142b6e0/roles/a12865c9fb9e4fa0b61e4adfd53188fb` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:26.091080 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae9e8c-8f30-45ea-a930-e8e69c12e9b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a9007447059e4862972078c032a5d67b, user_id=3aea97e7b39448a283032f662142b6e0, role_id=a12865c9fb9e4fa0b61e4adfd53188fb)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:26.092798 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae9e8c-8f30-45ea-a930-e8e69c12e9b5 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:26.106741 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 318/629] 10.222.0.32 () {58 vars in 1439 bytes} [Thu Jun 2 13:23:25 2022] PUT /identity/v3/projects/a9007447059e4862972078c032a5d67b/users/3aea97e7b39448a283032f662142b6e0/roles/a12865c9fb9e4fa0b61e4adfd53188fb => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:26.108058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1a0ae-699e-4844-9efb-9bfb48ec4021 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:26.112616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1a0ae-699e-4844-9efb-9bfb48ec4021 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:26.112616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1a0ae-699e-4844-9efb-9bfb48ec4021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:26.131480 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d4c1a0ae-699e-4844-9efb-9bfb48ec4021 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:26.133036 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d4c1a0ae-699e-4844-9efb-9bfb48ec4021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:26.196611 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 312/630] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:23:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:26.198576 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f325881-8c87-43bc-9d0c-8b9fa4b5a2f1 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:26.199103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f325881-8c87-43bc-9d0c-8b9fa4b5a2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:26.199649 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f325881-8c87-43bc-9d0c-8b9fa4b5a2f1 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:26.201647 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 313/631] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:26.202705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f325881-8c87-43bc-9d0c-8b9fa4b5a2f1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:26.223393 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 319/632] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:23:26.225213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152b616-9dba-4fcd-aa9e-56edb1f44158 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:26.225517 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152b616-9dba-4fcd-aa9e-56edb1f44158 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:26.225802 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152b616-9dba-4fcd-aa9e-56edb1f44158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:26.257905 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3152b616-9dba-4fcd-aa9e-56edb1f44158 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:26.259166 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3152b616-9dba-4fcd-aa9e-56edb1f44158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:26.309954 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:26.320376 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:26.324883 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f325881-8c87-43bc-9d0c-8b9fa4b5a2f1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:26.346037 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 320/633] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:23:26.346971 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152b616-9dba-4fcd-aa9e-56edb1f44158 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:26.368228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ad92c-8d6a-4980-850f-dd4e28908ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:26.369164 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ad92c-8d6a-4980-850f-dd4e28908ded None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:26.369516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ad92c-8d6a-4980-850f-dd4e28908ded None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:26.370265 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ad92c-8d6a-4980-850f-dd4e28908ded None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:26.384251 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ad92c-8d6a-4980-850f-dd4e28908ded None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:26.385757 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ad92c-8d6a-4980-850f-dd4e28908ded None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:26.411522 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e41ad92c-8d6a-4980-850f-dd4e28908ded None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:26.411522 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:26.411522 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:26.411522 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:26.411522 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:26.411522 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:26.411522 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:26.411522 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:26.411522 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:26.411522 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:26.411522 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:26.411522 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:26.411522 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:26.411522 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:26.411522 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:26.412486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:26.412486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:26.412486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:26.412486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:26.412486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:26.412486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:26.412486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:26.412486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:26.412486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:26.412486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:26.412486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:26.412486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:26.412486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:26.412486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:26.412486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:26.412486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:26.412486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:26.413397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:26.413397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:26.413397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:26.413397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:26.414039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 314/634] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:26.414817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ad92c-8d6a-4980-850f-dd4e28908ded None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:26.458469 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152b616-9dba-4fcd-aa9e-56edb1f44158 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:26.500492 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a295d7-7169-44da-9324-877f1141e4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:26.501347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a295d7-7169-44da-9324-877f1141e4ad None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:26.501765 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a295d7-7169-44da-9324-877f1141e4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:26.502044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a295d7-7169-44da-9324-877f1141e4ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:26.513640 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a295d7-7169-44da-9324-877f1141e4ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:26.522018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-f1a295d7-7169-44da-9324-877f1141e4ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:26.522018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:26.522018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:26.522018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:26.522018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:26.522018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:26.522018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:26.522018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:26.522018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:26.522018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:26.522018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:26.522018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:26.522018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:26.522018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:26.522018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:26.522018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:26.522959 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:26.522959 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:26.522959 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:26.522959 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:26.522959 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:26.522959 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:26.522959 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:26.522959 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:26.522959 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:26.522959 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:26.522959 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:26.522959 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:26.522959 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:26.522959 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:26.522959 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:26.522959 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:26.523794 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:26.523794 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:26.523794 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:26.523794 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:26.523794 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:26.523794 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:26.523794 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:26.523794 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:26.523794 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:26.523794 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:26.523794 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:26.523794 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:26.527695 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ad92c-8d6a-4980-850f-dd4e28908ded None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:26.528669 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 321/635] 10.222.0.32 () {56 vars in 1102 bytes} [Thu Jun 2 13:23:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:26.529392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a295d7-7169-44da-9324-877f1141e4ad None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:26.561528 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae394b-3095-4305-bad1-16f7238f0fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:26.562238 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae394b-3095-4305-bad1-16f7238f0fcc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:26.562519 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae394b-3095-4305-bad1-16f7238f0fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:26.562791 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae394b-3095-4305-bad1-16f7238f0fcc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:26.570336 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:26.574375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae394b-3095-4305-bad1-16f7238f0fcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:26.575323 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:26.582536 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-74ae394b-3095-4305-bad1-16f7238f0fcc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:26.582536 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:26.582536 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:26.582536 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:26.582536 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:26.582536 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:26.582536 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:26.582536 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:26.582536 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:26.582536 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:26.582536 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:26.582536 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:26.582536 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:26.582536 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:26.582536 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:26.582536 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:26.583501 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:26.583501 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:26.583501 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:26.583501 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:26.583501 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:26.583501 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:26.583501 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:26.583501 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:26.583501 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:26.583501 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:26.583501 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:26.583501 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:26.583501 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:26.583501 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:26.583501 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:26.583501 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:26.584429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:26.584429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:26.584429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:26.584429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:26.584429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:26.584429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:26.584429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:26.584429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:26.584429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:26.584429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:26.584429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:26.584429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:26.584429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 315/636] 10.222.0.32 () {56 vars in 1102 bytes} [Thu Jun 2 13:23:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:26.585698 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ac097-5882-4efd-a463-93b5da34c7fd None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:26.585698 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ac097-5882-4efd-a463-93b5da34c7fd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:26.586128 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ac097-5882-4efd-a463-93b5da34c7fd None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:26.592237 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 316/637] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:26.592237 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ac097-5882-4efd-a463-93b5da34c7fd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:26.645271 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a295d7-7169-44da-9324-877f1141e4ad None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:26.683184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacbcc6-18a0-4613-bba5-8b08c479692b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:26.684191 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacbcc6-18a0-4613-bba5-8b08c479692b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:26.684565 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacbcc6-18a0-4613-bba5-8b08c479692b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:26.684905 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacbcc6-18a0-4613-bba5-8b08c479692b None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:26.685855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacbcc6-18a0-4613-bba5-8b08c479692b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:26.686518 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacbcc6-18a0-4613-bba5-8b08c479692b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:26.688385 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacbcc6-18a0-4613-bba5-8b08c479692b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:26.695412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ac097-5882-4efd-a463-93b5da34c7fd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:26.703530 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 322/638] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:26.704768 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacbcc6-18a0-4613-bba5-8b08c479692b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:26.734467 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab9c49-f01a-467f-bba7-c4c942765b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:26.735138 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab9c49-f01a-467f-bba7-c4c942765b6d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:26.735440 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab9c49-f01a-467f-bba7-c4c942765b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:26.735810 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab9c49-f01a-467f-bba7-c4c942765b6d None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:26.737312 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab9c49-f01a-467f-bba7-c4c942765b6d None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:26.737312 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab9c49-f01a-467f-bba7-c4c942765b6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:26.738174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab9c49-f01a-467f-bba7-c4c942765b6d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:26.746713 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 317/639] 10.222.0.32 () {56 vars in 1103 bytes} [Thu Jun 2 13:23:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:26.752177 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50a7d1-f9e4-411b-b276-4e99466868af None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:26.752492 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50a7d1-f9e4-411b-b276-4e99466868af None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:26.752771 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50a7d1-f9e4-411b-b276-4e99466868af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:26.772838 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7c50a7d1-f9e4-411b-b276-4e99466868af None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:26.774032 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7c50a7d1-f9e4-411b-b276-4e99466868af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:26.823335 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:26.826308 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacbcc6-18a0-4613-bba5-8b08c479692b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:26.837488 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:26.856331 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 318/640] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:23:26.856331 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50a7d1-f9e4-411b-b276-4e99466868af None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:26.870568 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab49a40-ff80-4b70-909f-52c10a924153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:26.871233 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab49a40-ff80-4b70-909f-52c10a924153 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:26.871513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab49a40-ff80-4b70-909f-52c10a924153 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:26.871787 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab49a40-ff80-4b70-909f-52c10a924153 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:26.872569 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab49a40-ff80-4b70-909f-52c10a924153 None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:26.872874 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab49a40-ff80-4b70-909f-52c10a924153 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:26.874521 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab49a40-ff80-4b70-909f-52c10a924153 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:26.883462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 323/641] 10.222.0.32 () {56 vars in 1103 bytes} [Thu Jun 2 13:23:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:26.884970 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab49a40-ff80-4b70-909f-52c10a924153 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:26.962006 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50a7d1-f9e4-411b-b276-4e99466868af None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:26.988936 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab49a40-ff80-4b70-909f-52c10a924153 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:26.997960 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404392a-3eb7-4213-be55-6dfc482bd325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:26.998768 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404392a-3eb7-4213-be55-6dfc482bd325 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:26.999055 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404392a-3eb7-4213-be55-6dfc482bd325 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:26.999334 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404392a-3eb7-4213-be55-6dfc482bd325 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:27.008555 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404392a-3eb7-4213-be55-6dfc482bd325 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:27.010635 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404392a-3eb7-4213-be55-6dfc482bd325 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:27.027423 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2404392a-3eb7-4213-be55-6dfc482bd325 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:27.027423 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:27.027423 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:27.027423 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:27.027423 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:27.027423 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:27.027423 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:27.027423 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:27.027423 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:27.027423 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:27.027423 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:27.027423 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:27.027423 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:23:27.027423 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:23:27.027423 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:23:27.028573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:23:27.028573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:27.028573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:27.028573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:27.028573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:27.028573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:27.028573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:27.028573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:27.028573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:27.028573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:27.028573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:27.028573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:27.028573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:27.028573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:27.028573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:27.028573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:27.028573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:27.029495 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:23:27.029495 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:23:27.029495 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:23:27.029495 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:23:27.029495 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:23:27.029495 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:23:27.029495 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:27.029495 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:27.029495 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 319/642] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:27.029991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404392a-3eb7-4213-be55-6dfc482bd325 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:27.036278 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336b607-01f8-4426-8ce6-9e2be21271e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:27.037280 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336b607-01f8-4426-8ce6-9e2be21271e8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:27.037722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336b607-01f8-4426-8ce6-9e2be21271e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:27.038143 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336b607-01f8-4426-8ce6-9e2be21271e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:27.050256 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336b607-01f8-4426-8ce6-9e2be21271e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:27.052167 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336b607-01f8-4426-8ce6-9e2be21271e8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:27.073782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-3336b607-01f8-4426-8ce6-9e2be21271e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:27.073782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:27.073782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:27.073782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:27.073782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:27.073782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:27.073782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:27.073782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:27.073782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:27.073782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:27.073782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:27.073782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:27.073782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:27.073782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:27.073782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:27.074809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:27.074809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:27.074809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:27.074809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:27.074809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:27.074809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:27.074809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:27.074809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:27.074809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:27.074809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:27.074809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:27.074809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:27.074809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:27.074809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:27.074809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:27.074809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:27.074809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:27.080768 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:27.080768 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:27.080768 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:27.080768 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:27.080768 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 324/643] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:27.080768 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336b607-01f8-4426-8ce6-9e2be21271e8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:27.092540 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:27.094216 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:27.146877 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404392a-3eb7-4213-be55-6dfc482bd325 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:27.184235 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ace5f-71d2-43a6-a65e-53522e6a0359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:27.185054 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ace5f-71d2-43a6-a65e-53522e6a0359 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:27.185343 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ace5f-71d2-43a6-a65e-53522e6a0359 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:27.185516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336b607-01f8-4426-8ce6-9e2be21271e8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:27.185630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ace5f-71d2-43a6-a65e-53522e6a0359 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:27.200673 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ace5f-71d2-43a6-a65e-53522e6a0359 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:27.208380 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f40ace5f-71d2-43a6-a65e-53522e6a0359 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:27.208380 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:27.208380 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:27.208380 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:27.208380 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:27.208380 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:27.208380 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:27.208380 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:27.208380 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:27.208380 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:27.208380 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:27.208380 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:27.208380 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:27.208380 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:27.208380 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:27.208380 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:27.209366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:27.209366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:27.209366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:27.209366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:27.209366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:27.209366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:27.209366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:27.209366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:27.209366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:27.209366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:27.209366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:27.209366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:27.209366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:27.209366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:27.209366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:27.209366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:27.210519 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:27.210519 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:27.210519 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:27.210519 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:27.210519 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:27.210519 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:27.210519 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:27.210519 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:27.210519 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:27.210519 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:27.210519 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:27.210519 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:27.210519 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 320/644] 10.222.0.32 () {56 vars in 1102 bytes} [Thu Jun 2 13:23:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:27.211320 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ace5f-71d2-43a6-a65e-53522e6a0359 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:27.228177 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6689b77-33a7-4fc7-b0d5-7348b7c0c6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:27.229005 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6689b77-33a7-4fc7-b0d5-7348b7c0c6c1 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:27.229295 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6689b77-33a7-4fc7-b0d5-7348b7c0c6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:27.229572 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6689b77-33a7-4fc7-b0d5-7348b7c0c6c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:27.240942 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6689b77-33a7-4fc7-b0d5-7348b7c0c6c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:27.242399 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6689b77-33a7-4fc7-b0d5-7348b7c0c6c1 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:27.260472 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-e6689b77-33a7-4fc7-b0d5-7348b7c0c6c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:27.260472 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:27.260472 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:27.260472 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:27.260472 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:27.260472 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:27.260472 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:27.260472 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:27.260472 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:27.260472 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:27.260472 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:27.260472 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:27.260472 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:27.260472 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:27.260472 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:27.261400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:27.261400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:27.261400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:27.261400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:27.261400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:27.261400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:27.261400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:27.261400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:27.261400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:27.261400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:27.261400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:27.261400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:27.261400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:27.261400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:27.261400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:27.261400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:27.261400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:27.262284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:27.262284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:27.262284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:27.262284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:27.262284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 325/645] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:27.262573 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6689b77-33a7-4fc7-b0d5-7348b7c0c6c1 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:27.327242 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ace5f-71d2-43a6-a65e-53522e6a0359 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:27.331605 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:27.340790 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:27.364344 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5702e7c-b414-49ed-a1d9-56476a6d9ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:27.365126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5702e7c-b414-49ed-a1d9-56476a6d9ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:27.365480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5702e7c-b414-49ed-a1d9-56476a6d9ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:27.365772 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5702e7c-b414-49ed-a1d9-56476a6d9ee1 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:27.366567 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5702e7c-b414-49ed-a1d9-56476a6d9ee1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:27.366884 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5702e7c-b414-49ed-a1d9-56476a6d9ee1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:27.368997 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5702e7c-b414-49ed-a1d9-56476a6d9ee1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:27.371414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6689b77-33a7-4fc7-b0d5-7348b7c0c6c1 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:27.386568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 321/646] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:23:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:27.386568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5702e7c-b414-49ed-a1d9-56476a6d9ee1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:27.411704 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2305cf-9d1e-4c7e-bca2-dfb2fa31a73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:27.412409 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2305cf-9d1e-4c7e-bca2-dfb2fa31a73b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:27.412718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2305cf-9d1e-4c7e-bca2-dfb2fa31a73b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:27.412972 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2305cf-9d1e-4c7e-bca2-dfb2fa31a73b None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:27.413695 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2305cf-9d1e-4c7e-bca2-dfb2fa31a73b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:27.414004 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2305cf-9d1e-4c7e-bca2-dfb2fa31a73b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:27.415905 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2305cf-9d1e-4c7e-bca2-dfb2fa31a73b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:27.429452 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 326/647] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:27.430399 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2305cf-9d1e-4c7e-bca2-dfb2fa31a73b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:27.491624 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5702e7c-b414-49ed-a1d9-56476a6d9ee1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:27.525279 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321aceb-e5be-4814-86c3-fc32416fc108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:27.525943 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321aceb-e5be-4814-86c3-fc32416fc108 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:27.526233 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321aceb-e5be-4814-86c3-fc32416fc108 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:27.526508 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321aceb-e5be-4814-86c3-fc32416fc108 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:27.527244 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321aceb-e5be-4814-86c3-fc32416fc108 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:27.527550 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321aceb-e5be-4814-86c3-fc32416fc108 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:27.528948 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321aceb-e5be-4814-86c3-fc32416fc108 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:27.536699 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 322/648] 10.222.0.32 () {56 vars in 1103 bytes} [Thu Jun 2 13:23:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:27.537475 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321aceb-e5be-4814-86c3-fc32416fc108 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:27.544942 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2305cf-9d1e-4c7e-bca2-dfb2fa31a73b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:27.573552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:27.580609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:27.584010 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42e988-6c96-4adf-89bd-f7e6708ca897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:27.584700 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42e988-6c96-4adf-89bd-f7e6708ca897 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:27.585248 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42e988-6c96-4adf-89bd-f7e6708ca897 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:27.585521 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42e988-6c96-4adf-89bd-f7e6708ca897 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:27.586244 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42e988-6c96-4adf-89bd-f7e6708ca897 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:27.586550 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42e988-6c96-4adf-89bd-f7e6708ca897 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:27.588460 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42e988-6c96-4adf-89bd-f7e6708ca897 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:27.600532 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 327/649] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:27.605944 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42e988-6c96-4adf-89bd-f7e6708ca897 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:27.648505 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321aceb-e5be-4814-86c3-fc32416fc108 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:27.684376 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9707e7-b950-402a-b217-1417dea777ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:27.685030 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9707e7-b950-402a-b217-1417dea777ec None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:27.685319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9707e7-b950-402a-b217-1417dea777ec None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:27.685599 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9707e7-b950-402a-b217-1417dea777ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:27.686437 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9707e7-b950-402a-b217-1417dea777ec None admin] RBAC: Adding query filter params (role.id=a12865c9fb9e4fa0b61e4adfd53188fb, scope.project.id=a9007447059e4862972078c032a5d67b, user.id=b2e5d9f3c4e04ca3bf52b28b67d2a4d6) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:27.686751 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9707e7-b950-402a-b217-1417dea777ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:27.688188 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9707e7-b950-402a-b217-1417dea777ec None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:27.694252 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 323/650] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:23:27 2022] GET /identity/v3/role_assignments?user.id=b2e5d9f3c4e04ca3bf52b28b67d2a4d6&scope.project.id=a9007447059e4862972078c032a5d67b&role.id=a12865c9fb9e4fa0b61e4adfd53188fb => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:27.694989 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9707e7-b950-402a-b217-1417dea777ec None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:27.744592 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42e988-6c96-4adf-89bd-f7e6708ca897 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:27.818521 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab866c-37da-49f6-a41c-8ee8c540d4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:27.819348 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab866c-37da-49f6-a41c-8ee8c540d4ff None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:27.819902 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab866c-37da-49f6-a41c-8ee8c540d4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:27.820186 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab866c-37da-49f6-a41c-8ee8c540d4ff None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:27.840410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab866c-37da-49f6-a41c-8ee8c540d4ff None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:27.840410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab866c-37da-49f6-a41c-8ee8c540d4ff None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:27.857882 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:27.860826 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9707e7-b950-402a-b217-1417dea777ec None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:27.865815 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-e5ab866c-37da-49f6-a41c-8ee8c540d4ff None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:23:27.865815 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:27.865815 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:27.865815 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:27.865815 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:27.865815 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:27.865815 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:27.865815 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:27.865815 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:27.865815 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:27.865815 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:27.865815 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:27.865815 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:23:27.865815 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:23:27.865815 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:23:27.865815 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:23:27.866967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:27.866967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:27.866967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:23:27.866967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:27.866967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:23:27.866967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:27.866967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:27.866967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:27.866967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:27.866967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:27.866967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:27.866967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:27.866967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:27.866967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:27.866967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:27.866967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:27.866967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:27.866967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:27.868140 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:27.868140 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:27.868140 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:23:27.868140 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:23:27.868140 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:23:27.868140 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:23:27.868140 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:23:27.868140 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:23:27.868140 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:23:27.868140 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:27.871559 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 328/651] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:23:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:27.871559 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab866c-37da-49f6-a41c-8ee8c540d4ff None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:27.912221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ed87e-6c60-4c11-904e-400863fbdbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:27.913210 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ed87e-6c60-4c11-904e-400863fbdbac None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:27.914137 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ed87e-6c60-4c11-904e-400863fbdbac None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:27.914137 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ed87e-6c60-4c11-904e-400863fbdbac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:27.927819 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ed87e-6c60-4c11-904e-400863fbdbac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:27.929740 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ed87e-6c60-4c11-904e-400863fbdbac None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:27.951375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:27.954641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b92ed87e-6c60-4c11-904e-400863fbdbac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:27.954641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:27.954641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:27.954641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:27.954641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:27.954641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:27.954641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:27.954641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:27.954641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:27.954641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:27.954641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:27.954641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:27.954641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:27.954641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:27.954641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:27.955666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:27.955666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:27.955666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:27.955666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:27.955666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:27.955666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:27.955666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:27.955666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:27.955666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:27.955666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:27.955666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:27.955666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:27.955666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:27.955666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:27.955666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:27.955666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:27.955666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:27.956747 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:27.956747 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:27.956747 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:27.956747 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:27.964676 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 324/652] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:27.965614 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ed87e-6c60-4c11-904e-400863fbdbac None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:28.030893 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab866c-37da-49f6-a41c-8ee8c540d4ff None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:28.075481 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9929605-9baa-41db-ab11-b5c8b74d4c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:28.076293 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9929605-9baa-41db-ab11-b5c8b74d4c89 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:28.076608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9929605-9baa-41db-ab11-b5c8b74d4c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:28.076885 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9929605-9baa-41db-ab11-b5c8b74d4c89 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:28.090153 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9929605-9baa-41db-ab11-b5c8b74d4c89 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:28.091686 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9929605-9baa-41db-ab11-b5c8b74d4c89 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:28.119798 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-b9929605-9baa-41db-ab11-b5c8b74d4c89 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 13:23:28.119798 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:28.119798 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:28.119798 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:28.119798 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:28.119798 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:28.119798 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:28.119798 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:28.119798 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:28.119798 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:28.119798 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:28.119798 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:28.119798 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:23:28.119798 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:23:28.119798 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:23:28.119798 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:23:28.120953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:28.120953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:28.120953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:23:28.120953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:28.120953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:23:28.120953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:28.120953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:28.120953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:28.120953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:28.120953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:28.120953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:28.120953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:28.120953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:28.120953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:28.120953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:28.120953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:28.120953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:28.120953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:28.121873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:28.121873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:28.121873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:23:28.121873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:23:28.121873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:23:28.121873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:23:28.121873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:23:28.121873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:23:28.121873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 13:23:28.121873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:28.124060 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 329/653] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:23:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:28.126145 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9929605-9baa-41db-ab11-b5c8b74d4c89 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:28.138006 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ed87e-6c60-4c11-904e-400863fbdbac None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:28.181104 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6397543-93ac-41b5-a571-b436d5108610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:28.182304 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6397543-93ac-41b5-a571-b436d5108610 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:28.182785 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6397543-93ac-41b5-a571-b436d5108610 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:28.183254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6397543-93ac-41b5-a571-b436d5108610 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:28.184496 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6397543-93ac-41b5-a571-b436d5108610 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:28.185023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6397543-93ac-41b5-a571-b436d5108610 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:28.186855 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6397543-93ac-41b5-a571-b436d5108610 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:28.207874 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 325/654] 10.222.0.32 () {56 vars in 1137 bytes} [Thu Jun 2 13:23:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:28.209562 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6397543-93ac-41b5-a571-b436d5108610 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:28.222594 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:28.335575 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9929605-9baa-41db-ab11-b5c8b74d4c89 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:28.346326 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:28.371196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6397543-93ac-41b5-a571-b436d5108610 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:28.374487 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9113d-9284-4a55-bfe3-4062e10aef08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:28.374933 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9113d-9284-4a55-bfe3-4062e10aef08 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:28.375219 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9113d-9284-4a55-bfe3-4062e10aef08 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:28.375494 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9113d-9284-4a55-bfe3-4062e10aef08 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:28.376215 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9113d-9284-4a55-bfe3-4062e10aef08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:28.376554 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9113d-9284-4a55-bfe3-4062e10aef08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:28.377916 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9113d-9284-4a55-bfe3-4062e10aef08 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:28.391855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 330/655] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:28.392817 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9113d-9284-4a55-bfe3-4062e10aef08 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:28.411349 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e8653-ffdd-479b-bb46-2a6d7661d7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:28.412511 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e8653-ffdd-479b-bb46-2a6d7661d7fd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:28.413112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e8653-ffdd-479b-bb46-2a6d7661d7fd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:28.413609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e8653-ffdd-479b-bb46-2a6d7661d7fd None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:28.414658 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e8653-ffdd-479b-bb46-2a6d7661d7fd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:28.415300 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e8653-ffdd-479b-bb46-2a6d7661d7fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:28.417383 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e8653-ffdd-479b-bb46-2a6d7661d7fd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:28.437842 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 326/656] 10.222.0.32 () {56 vars in 1137 bytes} [Thu Jun 2 13:23:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:28.439254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e8653-ffdd-479b-bb46-2a6d7661d7fd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:28.502970 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9113d-9284-4a55-bfe3-4062e10aef08 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:28.511807 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:28.537881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f733db-8537-4435-876d-5856203cd67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:28.538526 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f733db-8537-4435-876d-5856203cd67d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:28.538814 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f733db-8537-4435-876d-5856203cd67d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:28.539094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f733db-8537-4435-876d-5856203cd67d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:28.548860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e8653-ffdd-479b-bb46-2a6d7661d7fd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:28.575771 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:28.587991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e43d2b-247d-4c90-be54-a0cc9eaaef59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:28.588877 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e43d2b-247d-4c90-be54-a0cc9eaaef59 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:28.589125 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e43d2b-247d-4c90-be54-a0cc9eaaef59 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:28.589404 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e43d2b-247d-4c90-be54-a0cc9eaaef59 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:28.597149 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e43d2b-247d-4c90-be54-a0cc9eaaef59 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:28.598559 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e43d2b-247d-4c90-be54-a0cc9eaaef59 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:28.612046 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f733db-8537-4435-876d-5856203cd67d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:28.613139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-43e43d2b-247d-4c90-be54-a0cc9eaaef59 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 13:23:28.613139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:28.613139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:28.613139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:28.613139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:28.613139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:28.613139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:28.613139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:28.613139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:28.613139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:28.613139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:28.613139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:28.613139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:23:28.613139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:23:28.613139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:23:28.613139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:23:28.614039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:28.614039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:28.614039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:23:28.614039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:28.614039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:23:28.614039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:28.614039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:28.614039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:28.614039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:28.614039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:28.614039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:28.614039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:28.614039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:28.614039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:28.614039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:28.614039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:28.614039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:28.614039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:28.620381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:28.620381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:28.620381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:23:28.620381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:23:28.620381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:23:28.620381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:23:28.620381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:23:28.620381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:23:28.620381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 13:23:28.620381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:28.620945 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f733db-8537-4435-876d-5856203cd67d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:28.621018 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 327/657] 10.222.0.32 () {56 vars in 1102 bytes} [Thu Jun 2 13:23:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:28.621018 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e43d2b-247d-4c90-be54-a0cc9eaaef59 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:28.723838 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 331/658] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:23:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:28.725391 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d034d8e-03ba-46f1-8b6d-b16035f271a4 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:28.725759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d034d8e-03ba-46f1-8b6d-b16035f271a4 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:28.726112 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d034d8e-03ba-46f1-8b6d-b16035f271a4 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:28.728136 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 332/659] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:28.728936 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d034d8e-03ba-46f1-8b6d-b16035f271a4 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:28.738250 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e43d2b-247d-4c90-be54-a0cc9eaaef59 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:28.766034 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:28.776001 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84235d86-b0c2-4a47-9d89-acb97f238137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:28.776775 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84235d86-b0c2-4a47-9d89-acb97f238137 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:28.777068 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84235d86-b0c2-4a47-9d89-acb97f238137 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:28.777346 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84235d86-b0c2-4a47-9d89-acb97f238137 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:28.803036 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:28.842119 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d034d8e-03ba-46f1-8b6d-b16035f271a4 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:28.852367 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84235d86-b0c2-4a47-9d89-acb97f238137 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:28.854333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84235d86-b0c2-4a47-9d89-acb97f238137 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:28.880129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba11e42-6b6d-4125-850a-114f1103579f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:28.881180 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba11e42-6b6d-4125-850a-114f1103579f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:28.881638 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba11e42-6b6d-4125-850a-114f1103579f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:28.882101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba11e42-6b6d-4125-850a-114f1103579f None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:28.883222 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba11e42-6b6d-4125-850a-114f1103579f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:28.883767 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba11e42-6b6d-4125-850a-114f1103579f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:28.885480 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba11e42-6b6d-4125-850a-114f1103579f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:28.903752 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 333/660] 10.222.0.32 () {56 vars in 1139 bytes} [Thu Jun 2 13:23:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:28.904910 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba11e42-6b6d-4125-850a-114f1103579f None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:28.962704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 328/661] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:23:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:28.964061 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1820ee-f0b7-4bf9-9ffc-81b64afcacab None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:28.964373 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1820ee-f0b7-4bf9-9ffc-81b64afcacab None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:28.964655 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1820ee-f0b7-4bf9-9ffc-81b64afcacab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:28.981288 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-fe1820ee-f0b7-4bf9-9ffc-81b64afcacab None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:28.982479 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fe1820ee-f0b7-4bf9-9ffc-81b64afcacab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:29.011939 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:29.019992 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba11e42-6b6d-4125-850a-114f1103579f None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:29.048221 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:29.060641 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d6500-1854-4b78-931e-94eb6ef838a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:29.061432 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d6500-1854-4b78-931e-94eb6ef838a8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:29.061718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d6500-1854-4b78-931e-94eb6ef838a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:29.061994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d6500-1854-4b78-931e-94eb6ef838a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:29.064596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 329/662] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:23:29.065302 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1820ee-f0b7-4bf9-9ffc-81b64afcacab None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:29.076557 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d6500-1854-4b78-931e-94eb6ef838a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:29.078128 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d6500-1854-4b78-931e-94eb6ef838a8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:29.097273 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-926d6500-1854-4b78-931e-94eb6ef838a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:29.097273 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:29.097273 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:29.097273 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:29.097273 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:29.097273 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:29.097273 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:29.097273 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:29.097273 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:29.097273 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:29.097273 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:29.097273 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:29.097273 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:29.097273 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:29.097273 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:29.098240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:29.098240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:29.098240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:29.098240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:29.098240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:29.098240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:29.098240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:29.098240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:29.098240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:29.098240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:29.098240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:29.098240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:29.098240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:29.098240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:29.098240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:29.098240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:29.098240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:29.099148 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:29.099148 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:29.099148 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:29.099148 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:29.099148 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 334/663] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:29.099422 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d6500-1854-4b78-931e-94eb6ef838a8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:29.173724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1820ee-f0b7-4bf9-9ffc-81b64afcacab None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:29.209385 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587057d6-2b40-42ef-83e9-7543b1517c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:29.210507 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587057d6-2b40-42ef-83e9-7543b1517c97 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:29.210956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587057d6-2b40-42ef-83e9-7543b1517c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:29.211232 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587057d6-2b40-42ef-83e9-7543b1517c97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:29.214248 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d6500-1854-4b78-931e-94eb6ef838a8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:29.236393 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:29.252512 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915d1df-a6c4-4769-9380-e7a3733e44a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:29.253301 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915d1df-a6c4-4769-9380-e7a3733e44a4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:29.253592 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915d1df-a6c4-4769-9380-e7a3733e44a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:29.253874 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915d1df-a6c4-4769-9380-e7a3733e44a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:29.265165 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915d1df-a6c4-4769-9380-e7a3733e44a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:29.266760 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915d1df-a6c4-4769-9380-e7a3733e44a4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:29.283073 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587057d6-2b40-42ef-83e9-7543b1517c97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:29.284639 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587057d6-2b40-42ef-83e9-7543b1517c97 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:29.286026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-a915d1df-a6c4-4769-9380-e7a3733e44a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:29.286026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:29.286026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:29.286026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:29.286026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:29.286026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:29.286026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:29.286026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:29.286026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:29.286026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:29.286026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:29.286026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:29.286026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:29.286026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:29.286026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:29.286906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:29.286906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:29.286906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:29.286906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:29.286906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:29.286906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:29.286906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:29.286906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:29.286906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:29.286906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:29.286906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:29.286906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:29.286906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:29.286906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:29.286906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:29.286906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:29.286906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:29.287828 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:29.287828 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:29.287828 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:29.287828 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:29.287828 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 335/664] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:29.288102 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915d1df-a6c4-4769-9380-e7a3733e44a4 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:29.317670 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:29.402401 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 330/665] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:23:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:29.402600 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915d1df-a6c4-4769-9380-e7a3733e44a4 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:29.402697 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587057d6-2b40-42ef-83e9-7543b1517c97 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:29.438812 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f761ee9-420b-4a39-b5f3-18582bb05e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:29.439521 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f761ee9-420b-4a39-b5f3-18582bb05e11 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:29.439807 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f761ee9-420b-4a39-b5f3-18582bb05e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:29.440083 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f761ee9-420b-4a39-b5f3-18582bb05e11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:29.451702 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f761ee9-420b-4a39-b5f3-18582bb05e11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:29.457149 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:29.462609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-9f761ee9-420b-4a39-b5f3-18582bb05e11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:29.462609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:29.462609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:29.462609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:29.462609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:29.462609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:29.462609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:29.462609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:29.462609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:29.462609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:29.462609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:29.462609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:29.462609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:29.462609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:29.462609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:29.462609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:29.463749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:29.463749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:29.463749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:29.463749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:29.463749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:29.463749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:29.463749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:29.463749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:29.463749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:29.463749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:29.463749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:29.463749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:29.463749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:29.463749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:29.463749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:29.463749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:29.464644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:29.464644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:29.464644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:29.464644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:29.464644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:29.464644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:29.464644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:29.464644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:29.464644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:29.464644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:29.464644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:29.464644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:29.464644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 336/666] 10.222.0.32 () {56 vars in 1102 bytes} [Thu Jun 2 13:23:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:29.465351 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f761ee9-420b-4a39-b5f3-18582bb05e11 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:29.513175 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587057d6-2b40-42ef-83e9-7543b1517c97 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:29.551245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c331de-587a-4d01-a101-11d9e7e4fd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:29.551900 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c331de-587a-4d01-a101-11d9e7e4fd2e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:29.552181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c331de-587a-4d01-a101-11d9e7e4fd2e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:29.552496 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c331de-587a-4d01-a101-11d9e7e4fd2e None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:29.553229 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c331de-587a-4d01-a101-11d9e7e4fd2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:29.553522 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c331de-587a-4d01-a101-11d9e7e4fd2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:29.554906 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c331de-587a-4d01-a101-11d9e7e4fd2e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:29.559490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:29.571277 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 331/667] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:29.571277 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c331de-587a-4d01-a101-11d9e7e4fd2e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:29.579686 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f761ee9-420b-4a39-b5f3-18582bb05e11 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:29.615871 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efde299-e162-4bc8-8fd7-1b7b8bddb17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:29.616937 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efde299-e162-4bc8-8fd7-1b7b8bddb17d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:29.617376 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efde299-e162-4bc8-8fd7-1b7b8bddb17d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:29.617705 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efde299-e162-4bc8-8fd7-1b7b8bddb17d None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:29.618479 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efde299-e162-4bc8-8fd7-1b7b8bddb17d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:29.618784 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efde299-e162-4bc8-8fd7-1b7b8bddb17d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:29.620144 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efde299-e162-4bc8-8fd7-1b7b8bddb17d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:29.634685 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 337/668] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:29.635897 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efde299-e162-4bc8-8fd7-1b7b8bddb17d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:29.675687 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c331de-587a-4d01-a101-11d9e7e4fd2e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:29.692933 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:29.712655 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d413a69-ec75-4ded-8533-22cff5aac780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:29.713458 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d413a69-ec75-4ded-8533-22cff5aac780 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:29.713742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d413a69-ec75-4ded-8533-22cff5aac780 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:29.714011 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d413a69-ec75-4ded-8533-22cff5aac780 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:29.724964 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d413a69-ec75-4ded-8533-22cff5aac780 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:29.726637 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d413a69-ec75-4ded-8533-22cff5aac780 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:29.744385 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efde299-e162-4bc8-8fd7-1b7b8bddb17d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:29.745972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-0d413a69-ec75-4ded-8533-22cff5aac780 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:29.745972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:29.745972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:29.745972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:29.745972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:29.745972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:29.745972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:29.745972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:29.745972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:29.745972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:29.745972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:29.745972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:29.745972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:29.745972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:29.745972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:29.746993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:29.746993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:29.746993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:29.746993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:29.746993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:29.746993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:29.746993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:29.746993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:29.746993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:29.746993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:29.746993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:29.746993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:29.746993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:29.746993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:29.746993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:29.746993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:29.746993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:29.747965 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:29.747965 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:29.747965 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:29.747965 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:29.747965 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 332/669] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:29.749522 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d413a69-ec75-4ded-8533-22cff5aac780 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:29.783146 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d255f-86c2-4460-9484-79e7a70768ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:29.784140 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d255f-86c2-4460-9484-79e7a70768ac None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:29.784253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d255f-86c2-4460-9484-79e7a70768ac None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:29.784548 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d255f-86c2-4460-9484-79e7a70768ac None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:29.785328 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d255f-86c2-4460-9484-79e7a70768ac None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:29.785641 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d255f-86c2-4460-9484-79e7a70768ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:29.787231 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d255f-86c2-4460-9484-79e7a70768ac None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:29.802084 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 338/670] 10.222.0.32 () {56 vars in 1103 bytes} [Thu Jun 2 13:23:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:29.802084 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d255f-86c2-4460-9484-79e7a70768ac None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:29.817807 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:29.869791 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d413a69-ec75-4ded-8533-22cff5aac780 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:29.907086 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabe3f5-4c86-4db5-aebb-91f4cf9f92d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:29.908136 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabe3f5-4c86-4db5-aebb-91f4cf9f92d9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:29.908562 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabe3f5-4c86-4db5-aebb-91f4cf9f92d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:29.908739 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabe3f5-4c86-4db5-aebb-91f4cf9f92d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:29.912528 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d255f-86c2-4460-9484-79e7a70768ac None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:29.915620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabe3f5-4c86-4db5-aebb-91f4cf9f92d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:29.917106 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabe3f5-4c86-4db5-aebb-91f4cf9f92d9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:29.931818 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2fabe3f5-4c86-4db5-aebb-91f4cf9f92d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:29.931818 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:29.931818 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:29.931818 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:29.931818 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:29.931818 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:29.931818 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:29.931818 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:29.931818 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:29.931818 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:29.931818 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:29.931818 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:29.931818 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:23:29.931818 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:23:29.931818 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:23:29.932880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:23:29.932880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:29.932880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:29.932880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:29.932880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:29.932880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:29.932880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:29.932880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:29.932880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:29.932880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:29.932880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:29.932880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:29.932880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:29.932880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:29.932880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:29.932880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:29.932880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:29.933783 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:23:29.933783 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:23:29.933783 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:23:29.933783 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:23:29.933783 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:23:29.933783 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:23:29.933783 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:29.933783 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:29.933783 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 333/671] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:29.933783 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabe3f5-4c86-4db5-aebb-91f4cf9f92d9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:29.954773 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654f650-2c35-4dbc-a68b-8eb7b036d419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:29.955491 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654f650-2c35-4dbc-a68b-8eb7b036d419 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:29.955771 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654f650-2c35-4dbc-a68b-8eb7b036d419 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:29.956043 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654f650-2c35-4dbc-a68b-8eb7b036d419 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:29.963260 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654f650-2c35-4dbc-a68b-8eb7b036d419 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:29.964732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654f650-2c35-4dbc-a68b-8eb7b036d419 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:29.966422 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:29.979296 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-a654f650-2c35-4dbc-a68b-8eb7b036d419 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:29.979296 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:29.979296 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:29.979296 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:29.979296 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:29.979296 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:29.979296 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:29.979296 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:29.979296 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:29.979296 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:29.979296 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:29.979296 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:29.979296 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:23:29.979296 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:23:29.979296 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:23:29.980334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:23:29.980334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:29.980334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:29.980334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:29.980334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:29.980334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:29.980334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:29.980334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:29.980334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:29.980334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:29.980334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:29.980334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:29.980334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:29.980334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:29.980334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:29.980334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:29.980334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:29.981249 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:23:29.981249 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:23:29.981249 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:23:29.981249 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:23:29.981249 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:23:29.981249 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:23:29.981249 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:29.981249 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:29.985625 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 339/672] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:29.986446 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654f650-2c35-4dbc-a68b-8eb7b036d419 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:30.043537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabe3f5-4c86-4db5-aebb-91f4cf9f92d9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:30.066482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:30.081338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3371ea-7568-4750-bff5-97abb6f45d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:30.082004 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3371ea-7568-4750-bff5-97abb6f45d65 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:30.082284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3371ea-7568-4750-bff5-97abb6f45d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:30.082561 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3371ea-7568-4750-bff5-97abb6f45d65 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:30.083273 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3371ea-7568-4750-bff5-97abb6f45d65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:30.083577 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3371ea-7568-4750-bff5-97abb6f45d65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:30.085243 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3371ea-7568-4750-bff5-97abb6f45d65 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:30.097159 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 334/673] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:30.097964 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3371ea-7568-4750-bff5-97abb6f45d65 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:30.103990 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654f650-2c35-4dbc-a68b-8eb7b036d419 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:30.139983 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8c2e0-ad09-4886-aa18-75e59ee35798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:30.140794 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8c2e0-ad09-4886-aa18-75e59ee35798 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:30.141079 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8c2e0-ad09-4886-aa18-75e59ee35798 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:30.141352 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8c2e0-ad09-4886-aa18-75e59ee35798 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:30.151304 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8c2e0-ad09-4886-aa18-75e59ee35798 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:30.152775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8c2e0-ad09-4886-aa18-75e59ee35798 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:30.170608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-fdb8c2e0-ad09-4886-aa18-75e59ee35798 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:30.170608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:30.170608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:30.170608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:30.170608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:30.170608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:30.170608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:30.170608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:30.170608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:30.170608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:30.170608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:30.170608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:30.170608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:30.170608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:30.170608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:30.171561 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:30.171561 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:30.171561 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:30.171561 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:30.171561 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:30.171561 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:30.171561 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:30.171561 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:30.171561 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:30.171561 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:30.171561 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:30.171561 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:30.171561 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:30.171561 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:30.171561 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:30.171561 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:30.171561 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:30.172473 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:30.172473 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:30.172473 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:30.172473 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:30.176268 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 340/674] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:30.177284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8c2e0-ad09-4886-aa18-75e59ee35798 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:30.186307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:30.199057 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3371ea-7568-4750-bff5-97abb6f45d65 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:30.233029 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfb60d-f1fa-4f9f-b217-af41b1e9248f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:30.233892 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfb60d-f1fa-4f9f-b217-af41b1e9248f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:30.234176 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfb60d-f1fa-4f9f-b217-af41b1e9248f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:30.234454 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfb60d-f1fa-4f9f-b217-af41b1e9248f None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:30.235232 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcfb60d-f1fa-4f9f-b217-af41b1e9248f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:30.235543 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcfb60d-f1fa-4f9f-b217-af41b1e9248f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:30.237019 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcfb60d-f1fa-4f9f-b217-af41b1e9248f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:30.249215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 335/675] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:23:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:30.249990 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfb60d-f1fa-4f9f-b217-af41b1e9248f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:30.274045 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8c2e0-ad09-4886-aa18-75e59ee35798 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:30.296506 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:30.308952 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74353ac9-0e98-484a-9977-d6e0634f2007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:30.309607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74353ac9-0e98-484a-9977-d6e0634f2007 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:30.309893 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74353ac9-0e98-484a-9977-d6e0634f2007 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:30.310175 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74353ac9-0e98-484a-9977-d6e0634f2007 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:30.310962 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74353ac9-0e98-484a-9977-d6e0634f2007 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:30.311277 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74353ac9-0e98-484a-9977-d6e0634f2007 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:30.312737 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74353ac9-0e98-484a-9977-d6e0634f2007 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:30.324247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 341/676] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:23:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:30.325492 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e7ade-2574-4e2b-8027-20ef51f2a119 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:30.325783 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e7ade-2574-4e2b-8027-20ef51f2a119 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:30.326062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e7ade-2574-4e2b-8027-20ef51f2a119 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:30.327275 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 342/677] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:30.328128 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e7ade-2574-4e2b-8027-20ef51f2a119 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:30.352135 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfb60d-f1fa-4f9f-b217-af41b1e9248f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:30.386468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1246256-ec16-47cd-ab6a-26c2529311bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:30.387265 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1246256-ec16-47cd-ab6a-26c2529311bf None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:30.387550 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1246256-ec16-47cd-ab6a-26c2529311bf None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:30.387823 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1246256-ec16-47cd-ab6a-26c2529311bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:30.394452 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1246256-ec16-47cd-ab6a-26c2529311bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:30.395910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1246256-ec16-47cd-ab6a-26c2529311bf None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:30.409436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f1246256-ec16-47cd-ab6a-26c2529311bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:30.409436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:30.409436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:30.409436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:30.409436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:30.409436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:30.409436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:30.409436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:30.409436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:30.409436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:30.409436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:30.409436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:30.409436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:23:30.409436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:23:30.409436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:23:30.410394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:23:30.410394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:30.410394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:30.410394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:30.410394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:30.410394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:30.410394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:30.410394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:30.410394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:30.410394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:30.410394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:30.410394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:30.410394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:30.410394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:30.410394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:30.410394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:30.410394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:30.411285 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:23:30.411285 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:23:30.411285 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:23:30.411285 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:23:30.411285 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:23:30.411285 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:23:30.411285 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:30.411285 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:30.411285 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 336/678] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:30.411774 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1246256-ec16-47cd-ab6a-26c2529311bf None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:30.422422 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:30.433725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e7ade-2574-4e2b-8027-20ef51f2a119 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:30.466852 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec1d58-bff0-4efd-be12-5dbee2b0155c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:30.467695 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec1d58-bff0-4efd-be12-5dbee2b0155c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:30.467985 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec1d58-bff0-4efd-be12-5dbee2b0155c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:30.468265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec1d58-bff0-4efd-be12-5dbee2b0155c None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:30.469016 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec1d58-bff0-4efd-be12-5dbee2b0155c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:30.469521 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec1d58-bff0-4efd-be12-5dbee2b0155c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:30.470891 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec1d58-bff0-4efd-be12-5dbee2b0155c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:30.482866 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 343/679] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:30.482866 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec1d58-bff0-4efd-be12-5dbee2b0155c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:30.513087 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1246256-ec16-47cd-ab6a-26c2529311bf None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:30.524641 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:30.546364 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3141d-d978-4ab7-83f3-a29314ff3a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:30.547008 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3141d-d978-4ab7-83f3-a29314ff3a64 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:30.547290 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3141d-d978-4ab7-83f3-a29314ff3a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:30.547565 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3141d-d978-4ab7-83f3-a29314ff3a64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:30.548415 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3141d-d978-4ab7-83f3-a29314ff3a64 None admin] RBAC: Adding query filter params (role.id=a12865c9fb9e4fa0b61e4adfd53188fb, scope.project.id=a9007447059e4862972078c032a5d67b, user.id=09a1e517aa87428ebdb1e54671a8d93d) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:30.548730 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3141d-d978-4ab7-83f3-a29314ff3a64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:30.550153 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3141d-d978-4ab7-83f3-a29314ff3a64 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:30.556465 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 337/680] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:23:30 2022] GET /identity/v3/role_assignments?user.id=09a1e517aa87428ebdb1e54671a8d93d&scope.project.id=a9007447059e4862972078c032a5d67b&role.id=a12865c9fb9e4fa0b61e4adfd53188fb => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:30.557854 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a61c25-f78d-4851-8dfb-b45f46a538fd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:30.558151 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a61c25-f78d-4851-8dfb-b45f46a538fd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:30.558552 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a61c25-f78d-4851-8dfb-b45f46a538fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:30.576222 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-62a61c25-f78d-4851-8dfb-b45f46a538fd None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:30.577506 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-62a61c25-f78d-4851-8dfb-b45f46a538fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:30.585825 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec1d58-bff0-4efd-be12-5dbee2b0155c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:30.626149 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682f647-9b10-4a95-b2c1-50f850362453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:30.626834 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682f647-9b10-4a95-b2c1-50f850362453 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:30.627115 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682f647-9b10-4a95-b2c1-50f850362453 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:30.627388 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682f647-9b10-4a95-b2c1-50f850362453 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:30.628253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682f647-9b10-4a95-b2c1-50f850362453 None admin] RBAC: Adding query filter params (role.id=a12865c9fb9e4fa0b61e4adfd53188fb, scope.project.id=a9007447059e4862972078c032a5d67b, user.id=9e239e4e9b99433ca9d1a8db45e24b56) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:30.628620 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682f647-9b10-4a95-b2c1-50f850362453 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:30.630111 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682f647-9b10-4a95-b2c1-50f850362453 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:30.636753 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 344/681] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:23:30 2022] GET /identity/v3/role_assignments?user.id=9e239e4e9b99433ca9d1a8db45e24b56&scope.project.id=a9007447059e4862972078c032a5d67b&role.id=a12865c9fb9e4fa0b61e4adfd53188fb => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:30.637597 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682f647-9b10-4a95-b2c1-50f850362453 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:30.658669 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 338/682] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:23:30.660162 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a61c25-f78d-4851-8dfb-b45f46a538fd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:30.662961 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:30.786879 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682f647-9b10-4a95-b2c1-50f850362453 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:30.800743 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:30.808028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a61c25-f78d-4851-8dfb-b45f46a538fd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:30.840830 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1353e-4875-4a1b-ab58-ebf8a5961e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:30.841514 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1353e-4875-4a1b-ab58-ebf8a5961e3a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:30.841805 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1353e-4875-4a1b-ab58-ebf8a5961e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:30.842087 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1353e-4875-4a1b-ab58-ebf8a5961e3a None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:30.842896 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1353e-4875-4a1b-ab58-ebf8a5961e3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:30.843212 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1353e-4875-4a1b-ab58-ebf8a5961e3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:30.844966 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1353e-4875-4a1b-ab58-ebf8a5961e3a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:30.859229 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 345/683] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:23:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:30.860097 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1353e-4875-4a1b-ab58-ebf8a5961e3a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:30.862671 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624a47d-4a78-4f98-9315-dfeb207a8e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:30.863590 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624a47d-4a78-4f98-9315-dfeb207a8e52 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:30.863945 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624a47d-4a78-4f98-9315-dfeb207a8e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:30.864288 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624a47d-4a78-4f98-9315-dfeb207a8e52 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:30.873638 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624a47d-4a78-4f98-9315-dfeb207a8e52 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:30.875701 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624a47d-4a78-4f98-9315-dfeb207a8e52 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:30.892147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f624a47d-4a78-4f98-9315-dfeb207a8e52 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:23:30.892147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:30.892147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:30.892147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:30.892147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:30.892147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:30.892147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:30.892147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:30.892147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:30.892147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:30.892147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:30.892147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:30.892147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:23:30.892147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:23:30.892147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:23:30.892147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:23:30.893196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:30.893196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:30.893196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:23:30.893196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:30.893196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:23:30.893196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:30.893196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:30.893196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:30.893196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:30.893196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:30.893196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:30.893196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:30.893196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:30.893196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:30.893196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:30.893196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:30.893196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:30.893196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:30.894142 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:30.894142 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:30.894142 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:23:30.894142 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:23:30.894142 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:23:30.894142 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:23:30.894142 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:23:30.894142 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:23:30.894142 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:23:30.894142 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:30.896535 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 339/684] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:23:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:30.896535 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624a47d-4a78-4f98-9315-dfeb207a8e52 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:30.974705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:30.998009 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1353e-4875-4a1b-ab58-ebf8a5961e3a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:31.031927 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624a47d-4a78-4f98-9315-dfeb207a8e52 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:31.046490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b75245-916d-470c-ae5b-a48c0c35f2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:31.047615 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b75245-916d-470c-ae5b-a48c0c35f2f3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:31.047910 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b75245-916d-470c-ae5b-a48c0c35f2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:31.048190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b75245-916d-470c-ae5b-a48c0c35f2f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:31.061625 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b75245-916d-470c-ae5b-a48c0c35f2f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:31.072347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-c6b75245-916d-470c-ae5b-a48c0c35f2f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:23:31.072347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:31.072347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:31.072347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:31.072347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:31.072347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:31.072347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:31.072347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:31.072347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:31.072347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:31.072347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:31.072347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:31.072347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:31.072347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:31.072347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:31.072347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:31.073284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:31.073284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:31.073284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:31.073284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:31.073284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:31.073284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:31.073284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:31.073284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:31.073284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:31.073284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:31.073284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:31.073284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:31.073284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:31.073284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:31.073284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:31.073284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:31.074129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:31.074129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:31.074129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:31.074129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:31.074129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:31.074129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:31.074129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:31.074129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:31.074129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:31.074129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:31.074129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:23:31.074129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:31.074129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 346/685] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:23:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:31.074823 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b75245-916d-470c-ae5b-a48c0c35f2f3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:31.077043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5348ace-8733-4158-be2f-a87872daf6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:31.077933 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5348ace-8733-4158-be2f-a87872daf6ae None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:31.078425 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5348ace-8733-4158-be2f-a87872daf6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:31.078899 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5348ace-8733-4158-be2f-a87872daf6ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:31.081216 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5348ace-8733-4158-be2f-a87872daf6ae None admin] RBAC: Adding query filter params (role.id=a12865c9fb9e4fa0b61e4adfd53188fb, scope.project.id=a9007447059e4862972078c032a5d67b, user.id=9eb2722c122f4aeba23ec16b5a3c485f) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:31.081747 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5348ace-8733-4158-be2f-a87872daf6ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:31.083381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5348ace-8733-4158-be2f-a87872daf6ae None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:31.093503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 340/686] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:23:30 2022] GET /identity/v3/role_assignments?user.id=9eb2722c122f4aeba23ec16b5a3c485f&scope.project.id=a9007447059e4862972078c032a5d67b&role.id=a12865c9fb9e4fa0b61e4adfd53188fb => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:31.094594 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5348ace-8733-4158-be2f-a87872daf6ae None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:31.128772 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:31.278558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5348ace-8733-4158-be2f-a87872daf6ae None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:31.302812 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b75245-916d-470c-ae5b-a48c0c35f2f3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:31.335645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:31.348495 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cd790-2130-4f11-bcd1-12995ce28558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:31.349203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cd790-2130-4f11-bcd1-12995ce28558 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:31.349487 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cd790-2130-4f11-bcd1-12995ce28558 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:31.349767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cd790-2130-4f11-bcd1-12995ce28558 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:31.350640 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89cd790-2130-4f11-bcd1-12995ce28558 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:31.350839 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89cd790-2130-4f11-bcd1-12995ce28558 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:31.352207 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89cd790-2130-4f11-bcd1-12995ce28558 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:31.358931 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f74c99-690e-4007-8b5c-422e08d46890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:31.359885 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f74c99-690e-4007-8b5c-422e08d46890 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:31.360427 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f74c99-690e-4007-8b5c-422e08d46890 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:31.360922 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f74c99-690e-4007-8b5c-422e08d46890 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:31.361959 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f74c99-690e-4007-8b5c-422e08d46890 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:31.362209 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 341/687] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:23:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:31.362698 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f74c99-690e-4007-8b5c-422e08d46890 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:31.364316 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f74c99-690e-4007-8b5c-422e08d46890 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:31.368731 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cd790-2130-4f11-bcd1-12995ce28558 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:31.387193 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 347/688] 10.222.0.32 () {56 vars in 1135 bytes} [Thu Jun 2 13:23:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:31.393496 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f74c99-690e-4007-8b5c-422e08d46890 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:31.497035 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cd790-2130-4f11-bcd1-12995ce28558 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:31.505788 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:31.528157 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f74c99-690e-4007-8b5c-422e08d46890 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:31.537804 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71421ce4-0e4c-4435-bd6f-241de0f0a3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:31.539096 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71421ce4-0e4c-4435-bd6f-241de0f0a3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:31.539096 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71421ce4-0e4c-4435-bd6f-241de0f0a3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:31.539270 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71421ce4-0e4c-4435-bd6f-241de0f0a3c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:31.551136 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71421ce4-0e4c-4435-bd6f-241de0f0a3c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:31.552791 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71421ce4-0e4c-4435-bd6f-241de0f0a3c4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:31.572121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-71421ce4-0e4c-4435-bd6f-241de0f0a3c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:31.572121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:31.572121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:31.572121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:31.572121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:31.572121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:31.572121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:31.572121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:31.572121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:31.572121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:31.572121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:31.572121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:31.572121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:31.572121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:31.572121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:31.573077 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:31.573077 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:31.573077 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:31.573077 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:31.573077 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:31.573077 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:31.573077 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:31.573077 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:31.573077 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:31.573077 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:31.573077 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:31.573077 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:31.573077 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:31.573077 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:31.573077 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:31.573077 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:31.573077 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:31.573968 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:31.573968 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:31.573968 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:31.573968 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:31.573968 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 342/689] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:23:31.575123 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a6d4b-7f2f-4eda-ac68-27ed433d50b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:31.575779 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a6d4b-7f2f-4eda-ac68-27ed433d50b9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:31.576064 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a6d4b-7f2f-4eda-ac68-27ed433d50b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:31.584346 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a6d4b-7f2f-4eda-ac68-27ed433d50b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:31.585788 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71421ce4-0e4c-4435-bd6f-241de0f0a3c4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:31.654441 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a6d4b-7f2f-4eda-ac68-27ed433d50b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:31.656352 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a6d4b-7f2f-4eda-ac68-27ed433d50b9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:31.678771 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:31.752076 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:31.772100 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 348/690] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:23:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:31.781642 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a6d4b-7f2f-4eda-ac68-27ed433d50b9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:31.827455 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71421ce4-0e4c-4435-bd6f-241de0f0a3c4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:31.898681 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306d8ae-67fc-49ff-b7cf-b03a89901e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:31.899809 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306d8ae-67fc-49ff-b7cf-b03a89901e6e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:31.900785 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306d8ae-67fc-49ff-b7cf-b03a89901e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:31.901075 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306d8ae-67fc-49ff-b7cf-b03a89901e6e None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:31.907984 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306d8ae-67fc-49ff-b7cf-b03a89901e6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:31.907984 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306d8ae-67fc-49ff-b7cf-b03a89901e6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:31.907984 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306d8ae-67fc-49ff-b7cf-b03a89901e6e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:31.917320 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 343/691] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:31.922331 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306d8ae-67fc-49ff-b7cf-b03a89901e6e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:32.003577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a6d4b-7f2f-4eda-ac68-27ed433d50b9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:32.031259 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306d8ae-67fc-49ff-b7cf-b03a89901e6e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:32.033042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:32.084166 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af99e1-80d7-485a-946b-a3a38e035e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:32.084905 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af99e1-80d7-485a-946b-a3a38e035e7c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:32.085454 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af99e1-80d7-485a-946b-a3a38e035e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:32.085731 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af99e1-80d7-485a-946b-a3a38e035e7c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:32.098292 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb649a4-3fbf-4d5c-86e2-f12818c162b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:32.099083 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb649a4-3fbf-4d5c-86e2-f12818c162b7 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:32.099367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb649a4-3fbf-4d5c-86e2-f12818c162b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:32.099643 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb649a4-3fbf-4d5c-86e2-f12818c162b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:32.101221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af99e1-80d7-485a-946b-a3a38e035e7c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:32.103251 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af99e1-80d7-485a-946b-a3a38e035e7c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:32.114445 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb649a4-3fbf-4d5c-86e2-f12818c162b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:32.115879 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb649a4-3fbf-4d5c-86e2-f12818c162b7 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:32.134237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-2bb649a4-3fbf-4d5c-86e2-f12818c162b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:32.134237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:32.134237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:32.134237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:32.134237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:32.134237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:32.134237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:32.134237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:32.134237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:32.134237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:32.134237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:32.134237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:32.134237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:32.134237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:32.134237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:32.135257 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:32.135257 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:32.135257 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:32.135257 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:32.135257 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:32.135257 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:32.135257 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:32.135257 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:32.135257 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:32.135257 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:32.135257 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:32.135257 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:32.135257 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:32.135257 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:32.135257 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:32.135257 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:32.135257 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:32.136583 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:32.136583 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:32.136583 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:32.136583 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:32.136583 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 349/692] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:32.137684 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-65af99e1-80d7-485a-946b-a3a38e035e7c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:23:32.137684 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:32.137684 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:32.137684 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:32.137684 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:32.137684 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:32.137684 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:32.137684 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:32.137684 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:32.137684 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:32.137684 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:32.137684 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:32.137684 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:23:32.137684 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:23:32.137684 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:23:32.137684 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:23:32.139916 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:32.139916 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:32.139916 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:23:32.139916 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:32.139916 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:23:32.139916 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:32.139916 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:32.139916 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:32.139916 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:32.139916 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:32.139916 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:32.139916 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:32.139916 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:32.139916 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:32.139916 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:32.139916 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:32.139916 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:32.139916 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:32.142164 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:32.142164 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:32.142164 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:23:32.142164 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:23:32.142164 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:23:32.142164 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:23:32.142164 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:23:32.142164 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:23:32.142164 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:23:32.142164 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:32.142164 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 344/693] 10.222.0.32 () {56 vars in 1093 bytes} [Thu Jun 2 13:23:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:23:32.149334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb649a4-3fbf-4d5c-86e2-f12818c162b7 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:32.153330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af99e1-80d7-485a-946b-a3a38e035e7c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:32.190399 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:32.300414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb649a4-3fbf-4d5c-86e2-f12818c162b7 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:32.368711 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af99e1-80d7-485a-946b-a3a38e035e7c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:32.381440 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135f89a-558c-4c37-8938-b30a9b47ce55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:32.382106 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135f89a-558c-4c37-8938-b30a9b47ce55 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:32.382391 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135f89a-558c-4c37-8938-b30a9b47ce55 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:32.382672 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135f89a-558c-4c37-8938-b30a9b47ce55 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:32.383407 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5135f89a-558c-4c37-8938-b30a9b47ce55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:32.383716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5135f89a-558c-4c37-8938-b30a9b47ce55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:32.385148 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5135f89a-558c-4c37-8938-b30a9b47ce55 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:32.407742 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 350/694] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:32.413021 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135f89a-558c-4c37-8938-b30a9b47ce55 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:32.423512 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f3a6c-c437-4c1c-b49c-ae6be505b554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:32.424194 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f3a6c-c437-4c1c-b49c-ae6be505b554 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:32.424607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f3a6c-c437-4c1c-b49c-ae6be505b554 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:32.424899 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f3a6c-c437-4c1c-b49c-ae6be505b554 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:32.425727 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f3a6c-c437-4c1c-b49c-ae6be505b554 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:32.426037 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f3a6c-c437-4c1c-b49c-ae6be505b554 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:32.427614 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f3a6c-c437-4c1c-b49c-ae6be505b554 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:32.459644 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 345/695] 10.222.0.32 () {56 vars in 1133 bytes} [Thu Jun 2 13:23:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:32.467177 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f3a6c-c437-4c1c-b49c-ae6be505b554 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:32.497997 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:32.566330 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:32.575668 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135f89a-558c-4c37-8938-b30a9b47ce55 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:32.636125 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c0a46-df13-4434-809b-a3c2c4ae4cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:32.636876 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c0a46-df13-4434-809b-a3c2c4ae4cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:32.637161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c0a46-df13-4434-809b-a3c2c4ae4cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:32.637439 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c0a46-df13-4434-809b-a3c2c4ae4cc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:32.649598 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c0a46-df13-4434-809b-a3c2c4ae4cc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:32.651889 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c0a46-df13-4434-809b-a3c2c4ae4cc1 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:32.654438 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f3a6c-c437-4c1c-b49c-ae6be505b554 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:32.680680 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-578c0a46-df13-4434-809b-a3c2c4ae4cc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:32.680680 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:32.680680 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:32.680680 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:32.680680 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:32.680680 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:32.680680 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:32.680680 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:32.680680 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:32.680680 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:32.680680 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:32.680680 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:32.680680 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:23:32.680680 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:23:32.680680 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:23:32.681630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:23:32.681630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:32.681630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:32.681630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:32.681630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:32.681630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:32.681630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:32.681630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:32.681630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:32.681630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:32.681630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:32.681630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:32.681630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:32.681630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:32.681630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:32.681630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:32.681630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:32.682524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:23:32.682524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:23:32.682524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:23:32.682524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:23:32.682524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:23:32.682524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:23:32.682524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:32.682524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:32.688608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 351/696] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:23:32.694095 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c0a46-df13-4434-809b-a3c2c4ae4cc1 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:32.705166 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b81185-305a-43dc-88e9-3d762a7c6afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:32.705847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b81185-305a-43dc-88e9-3d762a7c6afb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:32.706136 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b81185-305a-43dc-88e9-3d762a7c6afb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:32.706416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b81185-305a-43dc-88e9-3d762a7c6afb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:32.819603 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c0a46-df13-4434-809b-a3c2c4ae4cc1 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:32.860184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c2e8f-5b9b-4662-9c3d-ca67421522c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:32.861590 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c2e8f-5b9b-4662-9c3d-ca67421522c7 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:32.862188 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c2e8f-5b9b-4662-9c3d-ca67421522c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:32.862649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c2e8f-5b9b-4662-9c3d-ca67421522c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:32.863593 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c2e8f-5b9b-4662-9c3d-ca67421522c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:32.864051 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c2e8f-5b9b-4662-9c3d-ca67421522c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:32.865662 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c2e8f-5b9b-4662-9c3d-ca67421522c7 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:32.884557 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 352/697] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:23:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:32.887059 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c2e8f-5b9b-4662-9c3d-ca67421522c7 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:32.907225 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:32.914427 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b81185-305a-43dc-88e9-3d762a7c6afb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:32.915947 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b81185-305a-43dc-88e9-3d762a7c6afb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:32.965838 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:33.071183 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 346/698] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:23:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:33.073983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b81185-305a-43dc-88e9-3d762a7c6afb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:33.098233 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c2e8f-5b9b-4662-9c3d-ca67421522c7 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:33.191523 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b81185-305a-43dc-88e9-3d762a7c6afb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:33.194893 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f5670-d863-462a-9597-a7041e09a1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:33.194893 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f5670-d863-462a-9597-a7041e09a1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:33.195150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f5670-d863-462a-9597-a7041e09a1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:33.195391 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f5670-d863-462a-9597-a7041e09a1d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:33.196267 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f5670-d863-462a-9597-a7041e09a1d5 None admin] RBAC: Adding query filter params (role.id=a12865c9fb9e4fa0b61e4adfd53188fb, scope.project.id=a9007447059e4862972078c032a5d67b, user.id=3aea97e7b39448a283032f662142b6e0) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:33.197179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f5670-d863-462a-9597-a7041e09a1d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:33.198625 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f5670-d863-462a-9597-a7041e09a1d5 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:33.209717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 353/699] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:23:32 2022] GET /identity/v3/role_assignments?user.id=3aea97e7b39448a283032f662142b6e0&scope.project.id=a9007447059e4862972078c032a5d67b&role.id=a12865c9fb9e4fa0b61e4adfd53188fb => generated 608 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:33.209717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8717c-a202-46f7-ab03-e4892bd849e8 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:33.209717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8717c-a202-46f7-ab03-e4892bd849e8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:33.209717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8717c-a202-46f7-ab03-e4892bd849e8 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:33.216560 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 354/700] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:33.218717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f863f75-56b2-45c0-b04e-69c8c6faa896 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:33.219498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f863f75-56b2-45c0-b04e-69c8c6faa896 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:33.219777 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f863f75-56b2-45c0-b04e-69c8c6faa896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:33.228584 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:33.254924 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3f863f75-56b2-45c0-b04e-69c8c6faa896 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:33.256175 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3f863f75-56b2-45c0-b04e-69c8c6faa896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:33.264839 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd778d-c19a-4615-b738-4fc8f470325d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:33.265641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd778d-c19a-4615-b738-4fc8f470325d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:33.265921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd778d-c19a-4615-b738-4fc8f470325d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:33.266193 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd778d-c19a-4615-b738-4fc8f470325d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:33.286792 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd778d-c19a-4615-b738-4fc8f470325d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:33.288275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd778d-c19a-4615-b738-4fc8f470325d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:33.318108 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9dbd778d-c19a-4615-b738-4fc8f470325d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:33.318108 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:33.318108 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:33.318108 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:33.318108 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:33.318108 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:33.318108 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:33.318108 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:33.318108 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:33.318108 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:33.318108 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:33.318108 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:33.318108 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:33.318108 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:33.318108 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:33.319084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:33.319084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:33.319084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:33.319084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:33.319084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:33.319084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:33.319084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:33.319084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:33.319084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:33.319084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:33.319084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:33.319084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:33.319084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:33.319084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:33.319084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:33.319084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:33.319084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:33.320417 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:33.320417 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:33.320417 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:33.320417 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:33.320417 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 347/701] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:23:33.330948 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd778d-c19a-4615-b738-4fc8f470325d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:33.388086 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 355/702] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:23:33.391004 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b958ef2-88b2-46e6-8216-e00229af13b3 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:33.391549 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b958ef2-88b2-46e6-8216-e00229af13b3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:33.392144 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b958ef2-88b2-46e6-8216-e00229af13b3 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:33.394187 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 356/703] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:33.402787 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0fcaa-5e40-47d6-a0fd-7ceae096023a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:33.402787 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0fcaa-5e40-47d6-a0fd-7ceae096023a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:33.402787 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0fcaa-5e40-47d6-a0fd-7ceae096023a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:33.421881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-64b0fcaa-5e40-47d6-a0fd-7ceae096023a None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:33.423767 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-64b0fcaa-5e40-47d6-a0fd-7ceae096023a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:33.428012 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:33.485337 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd778d-c19a-4615-b738-4fc8f470325d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:33.529439 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 357/704] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:23:33.529439 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0fcaa-5e40-47d6-a0fd-7ceae096023a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:33.532292 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79410576-7495-43b9-b0df-547b653dba25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:33.533107 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79410576-7495-43b9-b0df-547b653dba25 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:33.533537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79410576-7495-43b9-b0df-547b653dba25 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:33.533905 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79410576-7495-43b9-b0df-547b653dba25 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:33.534778 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79410576-7495-43b9-b0df-547b653dba25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:33.535202 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79410576-7495-43b9-b0df-547b653dba25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:33.536893 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79410576-7495-43b9-b0df-547b653dba25 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:33.550742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 348/705] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:33.558022 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79410576-7495-43b9-b0df-547b653dba25 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:33.592805 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:33.645399 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0fcaa-5e40-47d6-a0fd-7ceae096023a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:33.679272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79410576-7495-43b9-b0df-547b653dba25 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:33.694982 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74b7aa-936e-4c07-8d50-a7897d405ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:33.696121 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74b7aa-936e-4c07-8d50-a7897d405ebb None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:33.696544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74b7aa-936e-4c07-8d50-a7897d405ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:33.697146 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74b7aa-936e-4c07-8d50-a7897d405ebb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:33.698274 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74b7aa-936e-4c07-8d50-a7897d405ebb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:33.699736 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74b7aa-936e-4c07-8d50-a7897d405ebb None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:33.719579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-0a74b7aa-936e-4c07-8d50-a7897d405ebb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:23:33.719579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:33.719579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:23:33.719579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:23:33.719579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:23:33.719579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:23:33.719579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:23:33.719579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:23:33.719579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:23:33.719579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:33.719579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:23:33.719579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:33.719579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:33.719579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:33.719579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:33.719579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:33.720656 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:33.720656 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:33.720656 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:33.720656 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:33.720656 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:33.720656 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:33.720656 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:33.720656 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:23:33.720656 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:23:33.720656 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:23:33.720656 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:23:33.720656 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:33.720656 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:33.720656 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:33.720656 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:33.720656 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:33.721515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:33.721515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:33.721515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:33.721515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:33.721515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:33.721515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:33.721515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:33.721515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:33.721515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:33.721515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:33.721515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:33.721515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:23:33.721515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:23:33.721515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:23:33.721515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:33.721515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 358/706] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Jun 2 13:23:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:33.722845 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74b7aa-936e-4c07-8d50-a7897d405ebb None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:33.724000 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b34ce2-2ba8-4d8f-bda4-ba6def6c2c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:33.725166 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b34ce2-2ba8-4d8f-bda4-ba6def6c2c33 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:33.725529 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b34ce2-2ba8-4d8f-bda4-ba6def6c2c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:33.725818 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b34ce2-2ba8-4d8f-bda4-ba6def6c2c33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:33.727440 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:33.741359 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b34ce2-2ba8-4d8f-bda4-ba6def6c2c33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:33.743305 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b34ce2-2ba8-4d8f-bda4-ba6def6c2c33 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:33.759637 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-83b34ce2-2ba8-4d8f-bda4-ba6def6c2c33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:33.759637 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:33.759637 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:33.759637 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:33.759637 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:33.759637 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:33.759637 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:33.759637 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:33.759637 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:33.759637 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:33.759637 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:33.759637 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:33.759637 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:23:33.759637 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:23:33.759637 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:23:33.760887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:23:33.760887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:33.760887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:33.760887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:33.760887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:33.760887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:33.760887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:33.760887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:33.760887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:33.760887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:33.760887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:33.760887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:33.760887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:33.760887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:33.760887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:33.760887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:33.760887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:33.761815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:23:33.761815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:23:33.761815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:23:33.761815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:23:33.761815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:23:33.761815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:23:33.761815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:33.761815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:33.764136 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 349/707] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:33.765312 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b34ce2-2ba8-4d8f-bda4-ba6def6c2c33 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:33.847341 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74b7aa-936e-4c07-8d50-a7897d405ebb None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:33.864396 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:33.875618 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b34ce2-2ba8-4d8f-bda4-ba6def6c2c33 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:33.885050 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca58f78-694a-4314-851a-2b1d610fb913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:33.886203 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca58f78-694a-4314-851a-2b1d610fb913 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:33.886487 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca58f78-694a-4314-851a-2b1d610fb913 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:33.887075 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca58f78-694a-4314-851a-2b1d610fb913 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:33.898577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca58f78-694a-4314-851a-2b1d610fb913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:33.900707 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca58f78-694a-4314-851a-2b1d610fb913 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:33.910132 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f50e5-aef2-4c75-9027-1183c27fc24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:33.910805 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f50e5-aef2-4c75-9027-1183c27fc24d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:33.911092 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f50e5-aef2-4c75-9027-1183c27fc24d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:33.911371 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f50e5-aef2-4c75-9027-1183c27fc24d None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:33.912084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f50e5-aef2-4c75-9027-1183c27fc24d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:33.912425 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f50e5-aef2-4c75-9027-1183c27fc24d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:33.913798 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f50e5-aef2-4c75-9027-1183c27fc24d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:33.923606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 350/708] 10.222.0.32 () {56 vars in 1124 bytes} [Thu Jun 2 13:23:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:33.923606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f50e5-aef2-4c75-9027-1183c27fc24d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:33.923836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-0ca58f78-694a-4314-851a-2b1d610fb913 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:33.923836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:33.923836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:33.923836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:33.923836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:33.923836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:33.923836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:33.923836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:33.923836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:33.923836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:33.923836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:33.923836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:33.923836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:33.923836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:33.923836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:33.924723 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:33.924723 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:33.924723 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:33.924723 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:33.924723 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:33.924723 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:33.924723 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:33.924723 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:33.924723 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:33.924723 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:33.924723 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:33.924723 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:33.924723 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:33.924723 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:33.924723 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:33.924723 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:33.924723 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:33.925662 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:33.925662 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:33.925662 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:33.925662 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:33.925662 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 359/709] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:33.925662 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5287c9-cd50-48e1-9e0f-ed42e604b59f None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:33.925662 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5287c9-cd50-48e1-9e0f-ed42e604b59f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:33.925662 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5287c9-cd50-48e1-9e0f-ed42e604b59f None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:33.925662 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 360/710] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:33.926201 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5287c9-cd50-48e1-9e0f-ed42e604b59f None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:33.986393 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:34.040140 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5287c9-cd50-48e1-9e0f-ed42e604b59f None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:34.046618 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f50e5-aef2-4c75-9027-1183c27fc24d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:34.077302 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503d28f-a8b2-4066-8d8b-334f698dd4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:34.077906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503d28f-a8b2-4066-8d8b-334f698dd4ba None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:34.078193 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503d28f-a8b2-4066-8d8b-334f698dd4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:34.078472 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503d28f-a8b2-4066-8d8b-334f698dd4ba None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:34.079299 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a503d28f-a8b2-4066-8d8b-334f698dd4ba None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:34.079740 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a503d28f-a8b2-4066-8d8b-334f698dd4ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:34.081040 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a503d28f-a8b2-4066-8d8b-334f698dd4ba None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:34.084204 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32946c2-d803-4280-a928-2cf6428f86fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:34.084874 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32946c2-d803-4280-a928-2cf6428f86fd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:34.085412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32946c2-d803-4280-a928-2cf6428f86fd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:34.085688 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32946c2-d803-4280-a928-2cf6428f86fd None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:34.086465 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32946c2-d803-4280-a928-2cf6428f86fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:34.086778 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32946c2-d803-4280-a928-2cf6428f86fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:34.096907 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 361/711] 10.222.0.32 () {56 vars in 1124 bytes} [Thu Jun 2 13:23:33 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:34.097131 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32946c2-d803-4280-a928-2cf6428f86fd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:34.097217 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503d28f-a8b2-4066-8d8b-334f698dd4ba None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:34.108643 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 351/712] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:23:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:34.110121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645026ad-6db7-46ce-b6e0-ed3d65676908 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:34.110410 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645026ad-6db7-46ce-b6e0-ed3d65676908 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:34.110730 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645026ad-6db7-46ce-b6e0-ed3d65676908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:34.129561 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-645026ad-6db7-46ce-b6e0-ed3d65676908 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:34.130795 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-645026ad-6db7-46ce-b6e0-ed3d65676908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:34.142512 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:34.220334 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 352/713] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:23:34.220334 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645026ad-6db7-46ce-b6e0-ed3d65676908 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:34.251134 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503d28f-a8b2-4066-8d8b-334f698dd4ba None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:34.275812 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:34.291753 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2c86b-195e-4d62-b078-2dd23e981e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:34.292839 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2c86b-195e-4d62-b078-2dd23e981e44 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:34.293333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2c86b-195e-4d62-b078-2dd23e981e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:34.293841 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2c86b-195e-4d62-b078-2dd23e981e44 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:34.294785 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2c86b-195e-4d62-b078-2dd23e981e44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:34.295393 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2c86b-195e-4d62-b078-2dd23e981e44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:34.297259 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2c86b-195e-4d62-b078-2dd23e981e44 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:34.316472 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 362/714] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:34.317772 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2c86b-195e-4d62-b078-2dd23e981e44 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:34.336557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645026ad-6db7-46ce-b6e0-ed3d65676908 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:34.382014 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812211aa-034a-430c-a1d3-92c8eb91cfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:34.382673 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812211aa-034a-430c-a1d3-92c8eb91cfeb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:34.382956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812211aa-034a-430c-a1d3-92c8eb91cfeb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:34.383233 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812211aa-034a-430c-a1d3-92c8eb91cfeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:34.384672 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812211aa-034a-430c-a1d3-92c8eb91cfeb None admin] RBAC: Adding query filter params (role.id=128feb04d1e042ac844f9ad70b89bb02, scope.project.id=a9007447059e4862972078c032a5d67b, user.id=b2e5d9f3c4e04ca3bf52b28b67d2a4d6) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:34.384989 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812211aa-034a-430c-a1d3-92c8eb91cfeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:34.386738 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812211aa-034a-430c-a1d3-92c8eb91cfeb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:34.393752 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 353/715] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:23:34 2022] GET /identity/v3/role_assignments?user.id=b2e5d9f3c4e04ca3bf52b28b67d2a4d6&scope.project.id=a9007447059e4862972078c032a5d67b&role.id=128feb04d1e042ac844f9ad70b89bb02 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:34.400040 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812211aa-034a-430c-a1d3-92c8eb91cfeb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:34.421114 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:34.496468 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2c86b-195e-4d62-b078-2dd23e981e44 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:34.575058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d606d0f-3cfa-426f-bf88-252900c2f418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:34.575875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d606d0f-3cfa-426f-bf88-252900c2f418 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:34.576158 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d606d0f-3cfa-426f-bf88-252900c2f418 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:34.576754 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d606d0f-3cfa-426f-bf88-252900c2f418 None admin] PATH_INFO: `/v3/services/network` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:34.577491 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d606d0f-3cfa-426f-bf88-252900c2f418 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:34.578926 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d606d0f-3cfa-426f-bf88-252900c2f418 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:34.592258 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-4d606d0f-3cfa-426f-bf88-252900c2f418 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:23:34.592258 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:34.592258 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:23:34.592258 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:23:34.592258 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:23:34.592258 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:23:34.592258 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:23:34.592258 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:23:34.592258 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:23:34.592258 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:34.592258 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:23:34.592258 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:34.592258 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:34.592258 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:34.592258 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:34.592258 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:34.592258 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:34.593353 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:34.593353 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:34.593353 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:34.593353 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:34.593353 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:34.593353 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:34.593353 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:23:34.593353 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:23:34.593353 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:23:34.593353 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:23:34.593353 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:34.593353 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:34.593353 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:34.593353 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:34.593353 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:34.593353 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:34.594206 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:34.594206 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:34.594206 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:34.594206 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:34.594206 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:34.594206 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:34.594206 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:34.594206 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:34.594206 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:34.594206 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:34.594206 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:23:34.594206 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:23:34.594206 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:23:34.594206 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:34.594206 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 363/716] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:34 2022] GET /identity/v3/services/network => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:34.602640 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d606d0f-3cfa-426f-bf88-252900c2f418 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:34.632890 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812211aa-034a-430c-a1d3-92c8eb91cfeb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:34.677078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75718aa8-0183-4da7-8629-56637245954e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:34.678122 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75718aa8-0183-4da7-8629-56637245954e None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:34.678573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75718aa8-0183-4da7-8629-56637245954e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:34.678699 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75718aa8-0183-4da7-8629-56637245954e None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:34.679414 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75718aa8-0183-4da7-8629-56637245954e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:34.680960 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75718aa8-0183-4da7-8629-56637245954e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:34.688891 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:34.716863 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 354/717] 10.222.0.32 () {60 vars in 1132 bytes} [Thu Jun 2 13:23:34 2022] POST /identity/v3/users => generated 254 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:23:34.756465 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d606d0f-3cfa-426f-bf88-252900c2f418 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:34.811369 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0b2d9-f475-4206-a033-2f9be4547f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:34.812458 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0b2d9-f475-4206-a033-2f9be4547f55 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:34.812970 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0b2d9-f475-4206-a033-2f9be4547f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:34.813449 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0b2d9-f475-4206-a033-2f9be4547f55 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:34.814375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0b2d9-f475-4206-a033-2f9be4547f55 None admin] RBAC: Adding query filter params (name=network) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:34.814901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0b2d9-f475-4206-a033-2f9be4547f55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:34.816571 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0b2d9-f475-4206-a033-2f9be4547f55 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:34.824692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 364/718] 10.222.0.32 () {56 vars in 1112 bytes} [Thu Jun 2 13:23:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:34.830389 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75718aa8-0183-4da7-8629-56637245954e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:34.921207 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:34.963704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75718aa8-0183-4da7-8629-56637245954e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:35.026455 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd4f16-0582-4ff9-b998-cdd30a514672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:35.027150 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd4f16-0582-4ff9-b998-cdd30a514672 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:35.027433 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd4f16-0582-4ff9-b998-cdd30a514672 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:35.027708 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd4f16-0582-4ff9-b998-cdd30a514672 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:35.028458 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd4f16-0582-4ff9-b998-cdd30a514672 None admin] RBAC: Adding query filter params (type=network) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:35.028763 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd4f16-0582-4ff9-b998-cdd30a514672 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:35.030677 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd4f16-0582-4ff9-b998-cdd30a514672 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:35.040714 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 355/719] 10.222.0.32 () {56 vars in 1112 bytes} [Thu Jun 2 13:23:34 2022] GET /identity/v3/services?type=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:35.870246 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31337c-1778-49f2-ac4b-212dc8ccd7e8 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:35.871284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31337c-1778-49f2-ac4b-212dc8ccd7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:35.871787 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31337c-1778-49f2-ac4b-212dc8ccd7e8 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:35.873360 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 365/720] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:35.878955 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b66f5b-a78c-4bc0-a846-1e033232f612 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:35.879818 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b66f5b-a78c-4bc0-a846-1e033232f612 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:35.880337 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b66f5b-a78c-4bc0-a846-1e033232f612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:35.897696 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f5b66f5b-a78c-4bc0-a846-1e033232f612 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:35.899167 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f5b66f5b-a78c-4bc0-a846-1e033232f612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:35.983495 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 356/721] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:23:36.021776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31337c-1778-49f2-ac4b-212dc8ccd7e8 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:36.154054 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31337c-1778-49f2-ac4b-212dc8ccd7e8 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:36.163371 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:36.200995 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86117898-55a8-4483-8b98-7c2df0e24dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:36.201795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86117898-55a8-4483-8b98-7c2df0e24dfd None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:36.202087 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86117898-55a8-4483-8b98-7c2df0e24dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:36.202370 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86117898-55a8-4483-8b98-7c2df0e24dfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:36.215217 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86117898-55a8-4483-8b98-7c2df0e24dfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:36.222836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-86117898-55a8-4483-8b98-7c2df0e24dfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:23:36.222836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:36.222836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:36.222836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:36.222836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:36.222836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:36.222836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:36.222836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:36.222836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:36.222836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:36.222836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:36.222836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:36.222836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:36.222836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:36.222836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:36.222836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:36.223873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:36.223873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:36.223873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:36.223873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:36.223873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:36.223873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:36.223873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:36.223873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:36.223873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:36.223873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:36.223873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:36.223873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:36.223873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:36.223873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:36.223873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:36.223873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:36.224739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:36.224739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:36.224739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:36.224739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:36.224739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:36.224739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:36.224739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:36.224739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:36.224739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:36.224739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:36.224739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:23:36.224739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:36.224739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 366/722] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:23:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:36.230021 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b66f5b-a78c-4bc0-a846-1e033232f612 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:36.292727 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:36.352387 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b66f5b-a78c-4bc0-a846-1e033232f612 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:36.400358 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2dc10-ff0e-4f6a-a242-a6ed1f8d20ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:36.401044 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2dc10-ff0e-4f6a-a242-a6ed1f8d20ec None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:36.401327 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2dc10-ff0e-4f6a-a242-a6ed1f8d20ec None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:36.401602 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2dc10-ff0e-4f6a-a242-a6ed1f8d20ec None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:36.402355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a2dc10-ff0e-4f6a-a242-a6ed1f8d20ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:36.402659 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a2dc10-ff0e-4f6a-a242-a6ed1f8d20ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:36.404033 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a2dc10-ff0e-4f6a-a242-a6ed1f8d20ec None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:36.413552 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 357/723] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:23:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:36.419424 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86117898-55a8-4483-8b98-7c2df0e24dfd None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:36.568548 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86117898-55a8-4483-8b98-7c2df0e24dfd None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:36.611900 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f92a6-70ef-4f2d-aa22-3a63c5883406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:36.612721 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f92a6-70ef-4f2d-aa22-3a63c5883406 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:36.613004 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f92a6-70ef-4f2d-aa22-3a63c5883406 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:36.613284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f92a6-70ef-4f2d-aa22-3a63c5883406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:36.630637 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f92a6-70ef-4f2d-aa22-3a63c5883406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:36.632123 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f92a6-70ef-4f2d-aa22-3a63c5883406 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:36.659127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-640f92a6-70ef-4f2d-aa22-3a63c5883406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:36.659127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:36.659127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:36.659127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:36.659127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:36.659127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:36.659127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:36.659127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:36.659127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:36.659127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:36.659127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:36.659127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:36.659127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:36.659127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:36.659127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:36.660109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:36.660109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:36.660109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:36.660109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:36.660109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:36.660109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:36.660109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:36.660109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:36.660109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:36.660109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:36.660109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:36.660109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:36.660109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:36.660109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:36.660109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:36.660109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:36.660109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:36.661547 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:36.661547 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:36.661547 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:36.661547 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:36.661547 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 367/724] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:36.667709 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2dc10-ff0e-4f6a-a242-a6ed1f8d20ec None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:36.801576 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2dc10-ff0e-4f6a-a242-a6ed1f8d20ec None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:36.822150 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:36.843819 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c48855-ceaf-45e8-9df9-887446097038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:36.844589 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c48855-ceaf-45e8-9df9-887446097038 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:36.844889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c48855-ceaf-45e8-9df9-887446097038 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:36.845171 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c48855-ceaf-45e8-9df9-887446097038 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:36.846008 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c48855-ceaf-45e8-9df9-887446097038 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:36.846412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c48855-ceaf-45e8-9df9-887446097038 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:36.847789 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c48855-ceaf-45e8-9df9-887446097038 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:36.861023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 358/725] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:36.866035 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed86097-cd38-40b1-a2fe-146e0ba6d72b None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:36.866331 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed86097-cd38-40b1-a2fe-146e0ba6d72b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:36.866526 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c48855-ceaf-45e8-9df9-887446097038 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:36.866625 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed86097-cd38-40b1-a2fe-146e0ba6d72b None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:36.868202 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 368/726] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:36.873423 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbeb0e2-b3b1-4936-9265-d425f13a1ba1 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:36.873985 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbeb0e2-b3b1-4936-9265-d425f13a1ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:36.873985 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbeb0e2-b3b1-4936-9265-d425f13a1ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:36.901161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-bcbeb0e2-b3b1-4936-9265-d425f13a1ba1 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:36.902423 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bcbeb0e2-b3b1-4936-9265-d425f13a1ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:36.930606 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:37.021556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 369/727] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:23:37.049388 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c48855-ceaf-45e8-9df9-887446097038 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:37.089384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbeb0e2-b3b1-4936-9265-d425f13a1ba1 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:37.116323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856545c1-1981-4b95-9007-f5d7543fcd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:37.116323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856545c1-1981-4b95-9007-f5d7543fcd6f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:37.116323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856545c1-1981-4b95-9007-f5d7543fcd6f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:37.116323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856545c1-1981-4b95-9007-f5d7543fcd6f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:37.128351 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856545c1-1981-4b95-9007-f5d7543fcd6f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:37.128747 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856545c1-1981-4b95-9007-f5d7543fcd6f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:37.144983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-856545c1-1981-4b95-9007-f5d7543fcd6f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:23:37.144983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:37.144983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:37.144983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:37.144983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:37.144983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:37.144983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:37.144983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:37.144983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:37.144983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:37.144983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:37.144983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:37.144983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:23:37.144983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:23:37.144983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:23:37.144983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:23:37.145975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:37.145975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:37.145975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:23:37.145975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:37.145975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:23:37.145975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:37.145975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:37.145975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:37.145975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:37.145975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:37.145975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:37.145975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:37.145975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:37.145975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:37.145975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:37.145975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:37.145975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:37.145975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:37.146931 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:37.146931 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:37.146931 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:23:37.146931 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:23:37.146931 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:23:37.146931 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:23:37.146931 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:23:37.146931 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:23:37.146931 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:23:37.146931 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:37.150397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 359/728] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:23:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:23:37.161607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856545c1-1981-4b95-9007-f5d7543fcd6f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:37.228782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbeb0e2-b3b1-4936-9265-d425f13a1ba1 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:37.235553 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:37.269060 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6b445-6b2e-4bca-a11c-5f3543668684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:37.270122 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6b445-6b2e-4bca-a11c-5f3543668684 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:37.270613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6b445-6b2e-4bca-a11c-5f3543668684 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:37.271109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6b445-6b2e-4bca-a11c-5f3543668684 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:37.272064 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6b445-6b2e-4bca-a11c-5f3543668684 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:37.273786 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6b445-6b2e-4bca-a11c-5f3543668684 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:37.290737 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 370/729] 10.222.0.32 () {60 vars in 1141 bytes} [Thu Jun 2 13:23:37 2022] POST /identity/v3/services => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:23:37.292643 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d47d5-2f8c-4523-8577-daa5f34925f0 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:37.293139 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d47d5-2f8c-4523-8577-daa5f34925f0 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:37.293617 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d47d5-2f8c-4523-8577-daa5f34925f0 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:37.295177 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 371/730] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:37.303179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec30e21-319b-4bac-be2e-500661d7a014 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:37.303840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec30e21-319b-4bac-be2e-500661d7a014 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:37.306255 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec30e21-319b-4bac-be2e-500661d7a014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:37.327513 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856545c1-1981-4b95-9007-f5d7543fcd6f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:37.344576 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6ec30e21-319b-4bac-be2e-500661d7a014 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:37.346331 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6ec30e21-319b-4bac-be2e-500661d7a014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:37.352710 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:37.428095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a79eb-90a6-4b32-b3cd-210a1b26f4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:37.428825 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a79eb-90a6-4b32-b3cd-210a1b26f4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:37.429110 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a79eb-90a6-4b32-b3cd-210a1b26f4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:37.429386 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a79eb-90a6-4b32-b3cd-210a1b26f4f4 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:37.430256 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a79eb-90a6-4b32-b3cd-210a1b26f4f4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:37.431095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a79eb-90a6-4b32-b3cd-210a1b26f4f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:37.439177 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a79eb-90a6-4b32-b3cd-210a1b26f4f4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:37.476442 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 372/731] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:37 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:23:37.479351 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 360/732] 10.222.0.32 () {56 vars in 1135 bytes} [Thu Jun 2 13:23:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:37.489500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec30e21-319b-4bac-be2e-500661d7a014 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:37.498803 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a79eb-90a6-4b32-b3cd-210a1b26f4f4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:37.635509 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec30e21-319b-4bac-be2e-500661d7a014 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:37.651420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:37.659693 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a79eb-90a6-4b32-b3cd-210a1b26f4f4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:37.689903 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d56f88-070a-416d-8d73-5034b0651ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:37.691406 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d56f88-070a-416d-8d73-5034b0651ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:37.691983 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d56f88-070a-416d-8d73-5034b0651ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:37.693310 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d56f88-070a-416d-8d73-5034b0651ec0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:37.699461 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a1347-dd5d-45d8-940b-2a736d9813b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:37.700571 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a1347-dd5d-45d8-940b-2a736d9813b8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:37.701055 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a1347-dd5d-45d8-940b-2a736d9813b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:37.701526 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a1347-dd5d-45d8-940b-2a736d9813b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:37.707102 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:37.715899 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a1347-dd5d-45d8-940b-2a736d9813b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:37.724420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-799a1347-dd5d-45d8-940b-2a736d9813b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:23:37.724420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:37.724420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:37.724420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:37.724420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:37.724420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:37.724420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:37.724420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:37.724420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:37.724420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:37.724420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:37.724420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:37.724420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:37.724420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:37.724420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:37.724420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:37.725391 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:37.725391 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:37.725391 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:37.725391 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:37.725391 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:37.725391 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:37.725391 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:37.725391 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:37.725391 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:37.725391 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:37.725391 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:37.725391 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:37.725391 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:37.725391 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:37.725391 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:37.725391 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:37.726259 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:37.726259 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:37.726259 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:37.726259 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:37.726259 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:37.726259 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:37.726259 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:37.726259 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:37.726259 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:37.726259 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:37.726259 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:23:37.726259 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:37.729650 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 361/733] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:23:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:37.735631 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a1347-dd5d-45d8-940b-2a736d9813b8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:37.800008 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d56f88-070a-416d-8d73-5034b0651ec0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:37.801526 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d56f88-070a-416d-8d73-5034b0651ec0 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:37.876743 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a1347-dd5d-45d8-940b-2a736d9813b8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:37.912413 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 373/734] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:23:37 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:23:37.912937 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d1d1e-391e-4c92-9f7d-72f5bbf0baac None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:37.912937 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d1d1e-391e-4c92-9f7d-72f5bbf0baac None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:37.913072 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d1d1e-391e-4c92-9f7d-72f5bbf0baac None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:37.914015 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911ecd2-2614-4903-9eda-ffbc310593f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:37.914837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911ecd2-2614-4903-9eda-ffbc310593f5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:37.916087 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911ecd2-2614-4903-9eda-ffbc310593f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:37.916404 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911ecd2-2614-4903-9eda-ffbc310593f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:37.917177 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911ecd2-2614-4903-9eda-ffbc310593f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:37.917488 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911ecd2-2614-4903-9eda-ffbc310593f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:37.918871 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911ecd2-2614-4903-9eda-ffbc310593f5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:37.918966 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 374/735] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:37.920244 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eaed62-d979-49b4-acf4-f8308a682ba1 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:37.920567 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eaed62-d979-49b4-acf4-f8308a682ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:37.920846 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eaed62-d979-49b4-acf4-f8308a682ba1 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:37.922561 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 375/736] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:37.926602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eaed62-d979-49b4-acf4-f8308a682ba1 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:37.930784 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 362/737] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:23:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:37.932333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17262f3-99e7-4af0-b00f-2c5a887ce609 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:37.932333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17262f3-99e7-4af0-b00f-2c5a887ce609 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:37.935525 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17262f3-99e7-4af0-b00f-2c5a887ce609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:37.950385 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e17262f3-99e7-4af0-b00f-2c5a887ce609 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:37.951746 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e17262f3-99e7-4af0-b00f-2c5a887ce609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:37.963906 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:37.977952 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:38.023355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 363/738] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:37 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:23:38.025231 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8683c-0738-4567-9132-d44ddcc0988c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:38.025706 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8683c-0738-4567-9132-d44ddcc0988c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:38.025996 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8683c-0738-4567-9132-d44ddcc0988c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:38.044258 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9da8683c-0738-4567-9132-d44ddcc0988c None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:38.045724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9da8683c-0738-4567-9132-d44ddcc0988c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:38.055157 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eaed62-d979-49b4-acf4-f8308a682ba1 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:38.095578 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5098a2-0656-44e9-988c-08dfe1b60dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:38.096475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5098a2-0656-44e9-988c-08dfe1b60dbe None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:38.096752 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5098a2-0656-44e9-988c-08dfe1b60dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:38.097020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5098a2-0656-44e9-988c-08dfe1b60dbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:38.107581 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5098a2-0656-44e9-988c-08dfe1b60dbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:38.109084 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5098a2-0656-44e9-988c-08dfe1b60dbe None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:38.117493 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 364/739] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:38 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:23:38.118752 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8683c-0738-4567-9132-d44ddcc0988c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:38.138609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-be5098a2-0656-44e9-988c-08dfe1b60dbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:38.138609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:38.138609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:38.138609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:38.138609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:38.138609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:38.138609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:38.138609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:38.138609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:38.138609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:38.138609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:38.138609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:38.138609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:38.138609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:38.138609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:38.139544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:38.139544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:38.139544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:38.139544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:38.139544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:38.139544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:38.139544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:38.139544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:38.139544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:38.139544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:38.139544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:38.139544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:38.139544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:38.139544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:38.139544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:38.139544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:38.139544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:38.140508 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:38.140508 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:38.140508 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:38.140508 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:38.141612 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 376/740] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:38.142408 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5098a2-0656-44e9-988c-08dfe1b60dbe None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:38.199336 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:38.221929 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8683c-0738-4567-9132-d44ddcc0988c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:38.244182 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:38.253803 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5098a2-0656-44e9-988c-08dfe1b60dbe None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:38.257117 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0243cc-e4d8-448f-8a22-56fc0096d23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:38.257918 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0243cc-e4d8-448f-8a22-56fc0096d23c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:38.258209 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0243cc-e4d8-448f-8a22-56fc0096d23c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:38.258490 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0243cc-e4d8-448f-8a22-56fc0096d23c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:38.269593 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0243cc-e4d8-448f-8a22-56fc0096d23c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:38.271020 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0243cc-e4d8-448f-8a22-56fc0096d23c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:38.288171 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-7c0243cc-e4d8-448f-8a22-56fc0096d23c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:38.288171 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:38.288171 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:38.288171 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:38.288171 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:38.288171 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:38.288171 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:38.288171 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:38.288171 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:38.288171 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:38.288171 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:38.288171 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:38.288171 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:38.288171 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:38.288171 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:38.289095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:38.289095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:38.289095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:38.289095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:38.289095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:38.289095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:38.289095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:38.289095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:38.289095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:38.289095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:38.289095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:38.289095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:38.289095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:38.289095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:38.289095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:38.289095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:38.289095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:38.290035 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:38.290035 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:38.290035 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:38.290035 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:38.290035 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 365/741] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:38.290307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0243cc-e4d8-448f-8a22-56fc0096d23c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:38.298361 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d55295-f8fc-47d6-b31f-480c8315e3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:38.299197 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d55295-f8fc-47d6-b31f-480c8315e3ec None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:38.299489 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d55295-f8fc-47d6-b31f-480c8315e3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:38.299771 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d55295-f8fc-47d6-b31f-480c8315e3ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:38.312161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d55295-f8fc-47d6-b31f-480c8315e3ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:38.320009 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-94d55295-f8fc-47d6-b31f-480c8315e3ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:38.320009 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:38.320009 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:38.320009 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:38.320009 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:38.320009 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:38.320009 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:38.320009 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:38.320009 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:38.320009 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:38.320009 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:38.320009 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:38.320009 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:38.320009 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:38.320009 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:38.320009 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:38.321161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:38.321161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:38.321161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:38.321161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:38.321161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:38.321161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:38.321161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:38.321161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:38.321161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:38.321161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:38.321161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:38.321161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:38.321161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:38.321161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:38.321161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:38.321161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:38.322567 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:38.322567 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:38.322567 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:38.322567 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:38.322567 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:38.322567 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:38.322567 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:38.322567 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:38.322567 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:38.322567 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:38.322567 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:38.322567 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:38.322567 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 377/742] 10.222.0.32 () {56 vars in 1102 bytes} [Thu Jun 2 13:23:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:38.322567 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d55295-f8fc-47d6-b31f-480c8315e3ec None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:38.405542 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0243cc-e4d8-448f-8a22-56fc0096d23c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:38.432759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d55295-f8fc-47d6-b31f-480c8315e3ec None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:38.433313 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:38.441674 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02487622-806e-4650-baed-56b4a13b8b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:38.442336 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02487622-806e-4650-baed-56b4a13b8b74 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:38.442621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02487622-806e-4650-baed-56b4a13b8b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:38.442910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02487622-806e-4650-baed-56b4a13b8b74 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:38.443643 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02487622-806e-4650-baed-56b4a13b8b74 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:38.445098 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02487622-806e-4650-baed-56b4a13b8b74 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:38.462467 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 366/743] 10.222.0.32 () {60 vars in 1141 bytes} [Thu Jun 2 13:23:38 2022] POST /identity/v3/services => generated 240 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:23:38.463184 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02487622-806e-4650-baed-56b4a13b8b74 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:38.508097 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a9b6d-2cbc-496a-95b2-029592452015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:38.509755 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a9b6d-2cbc-496a-95b2-029592452015 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:38.510233 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a9b6d-2cbc-496a-95b2-029592452015 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:38.510691 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a9b6d-2cbc-496a-95b2-029592452015 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:38.511993 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a9b6d-2cbc-496a-95b2-029592452015 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:38.512516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a9b6d-2cbc-496a-95b2-029592452015 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:38.514712 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a9b6d-2cbc-496a-95b2-029592452015 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:38.532174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 378/744] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:38.533469 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a9b6d-2cbc-496a-95b2-029592452015 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:38.549654 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:38.587568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02487622-806e-4650-baed-56b4a13b8b74 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:38.636648 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c176509-e677-4141-9aad-13610e835261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:38.637641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c176509-e677-4141-9aad-13610e835261 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:38.638828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c176509-e677-4141-9aad-13610e835261 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:38.639304 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c176509-e677-4141-9aad-13610e835261 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:38.640239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c176509-e677-4141-9aad-13610e835261 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:38.641274 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c176509-e677-4141-9aad-13610e835261 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:38.643450 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c176509-e677-4141-9aad-13610e835261 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:38.663995 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 367/745] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:38.665871 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c176509-e677-4141-9aad-13610e835261 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:38.671193 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a9b6d-2cbc-496a-95b2-029592452015 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:38.720175 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fdff49-fc18-4fb1-bd07-795c198ec008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:38.720175 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdff49-fc18-4fb1-bd07-795c198ec008 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:38.720175 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdff49-fc18-4fb1-bd07-795c198ec008 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:38.720175 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdff49-fc18-4fb1-bd07-795c198ec008 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:38.720590 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fdff49-fc18-4fb1-bd07-795c198ec008 None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:38.720590 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fdff49-fc18-4fb1-bd07-795c198ec008 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:38.720590 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fdff49-fc18-4fb1-bd07-795c198ec008 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:38.729293 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 379/746] 10.222.0.32 () {56 vars in 1103 bytes} [Thu Jun 2 13:23:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:38.730218 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fdff49-fc18-4fb1-bd07-795c198ec008 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:38.733554 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:38.795971 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c176509-e677-4141-9aad-13610e835261 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:38.807453 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:38.838530 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e6f39-3267-4128-9f2e-c1b8f649631c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:38.839356 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e6f39-3267-4128-9f2e-c1b8f649631c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:38.839639 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e6f39-3267-4128-9f2e-c1b8f649631c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:38.839913 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e6f39-3267-4128-9f2e-c1b8f649631c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:38.845565 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fdff49-fc18-4fb1-bd07-795c198ec008 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:38.847348 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e6f39-3267-4128-9f2e-c1b8f649631c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:38.849084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e6f39-3267-4128-9f2e-c1b8f649631c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:38.865066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-591e6f39-3267-4128-9f2e-c1b8f649631c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:38.865066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:38.865066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:38.865066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:38.865066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:38.865066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:38.865066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:38.865066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:38.865066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:38.865066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:38.865066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:38.865066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:38.865066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:23:38.865066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:23:38.865066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:23:38.866024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:23:38.866024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:38.866024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:38.866024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:38.866024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:38.866024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:38.866024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:38.866024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:38.866024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:38.866024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:38.866024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:38.866024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:38.866024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:38.866024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:38.866024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:38.866024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:38.866024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:38.866896 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:23:38.866896 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:23:38.866896 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:23:38.866896 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:23:38.866896 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:23:38.866896 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:23:38.866896 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:38.866896 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:38.866896 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 368/747] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:38.867376 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e6f39-3267-4128-9f2e-c1b8f649631c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:38.886464 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd087f-1306-4f7a-b592-71e545a9494e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:38.887659 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd087f-1306-4f7a-b592-71e545a9494e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:38.888178 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd087f-1306-4f7a-b592-71e545a9494e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:38.888692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd087f-1306-4f7a-b592-71e545a9494e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:38.897601 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd087f-1306-4f7a-b592-71e545a9494e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:38.900060 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd087f-1306-4f7a-b592-71e545a9494e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:38.916498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-9abd087f-1306-4f7a-b592-71e545a9494e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:23:38.916498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:38.916498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:38.916498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:38.916498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:38.916498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:38.916498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:38.916498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:38.916498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:38.916498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:38.916498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:38.916498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:38.916498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:23:38.916498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:23:38.916498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:23:38.916498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:23:38.917899 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:38.917899 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:38.917899 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:23:38.917899 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:38.917899 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:23:38.917899 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:38.917899 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:38.917899 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:38.917899 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:38.917899 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:38.917899 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:38.917899 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:38.917899 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:38.917899 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:38.917899 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:38.917899 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:38.917899 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:38.917899 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:38.918839 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:38.918839 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:38.918839 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:23:38.918839 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:23:38.918839 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:23:38.918839 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:23:38.918839 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:23:38.918839 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:23:38.918839 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:23:38.918839 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:38.921564 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 380/748] 10.222.0.32 () {56 vars in 1093 bytes} [Thu Jun 2 13:23:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:38.922658 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd087f-1306-4f7a-b592-71e545a9494e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:38.983397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e6f39-3267-4128-9f2e-c1b8f649631c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:38.993757 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:39.021364 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f5dd8-b2e1-44c9-8d83-883378d56d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:39.022281 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f5dd8-b2e1-44c9-8d83-883378d56d85 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:39.022569 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f5dd8-b2e1-44c9-8d83-883378d56d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:39.022847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f5dd8-b2e1-44c9-8d83-883378d56d85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:39.035196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f5dd8-b2e1-44c9-8d83-883378d56d85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:39.036252 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd087f-1306-4f7a-b592-71e545a9494e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:39.036734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f5dd8-b2e1-44c9-8d83-883378d56d85 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:39.056234 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-694f5dd8-b2e1-44c9-8d83-883378d56d85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:39.056234 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:39.056234 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:39.056234 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:39.056234 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:39.056234 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:39.056234 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:39.056234 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:39.056234 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:39.056234 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:39.056234 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:39.056234 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:39.056234 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:39.056234 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:39.056234 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:39.057179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:39.057179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:39.057179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:39.057179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:39.057179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:39.057179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:39.057179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:39.057179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:39.057179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:39.057179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:39.057179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:39.057179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:39.057179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:39.057179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:39.057179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:39.057179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:39.057179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:39.058064 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:39.058064 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:39.058064 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:39.058064 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:39.062020 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 369/749] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:39.062949 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f5dd8-b2e1-44c9-8d83-883378d56d85 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:39.070573 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:39.078411 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607de96d-5806-46b6-af26-613a4e23f4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:39.079524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607de96d-5806-46b6-af26-613a4e23f4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:39.080006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607de96d-5806-46b6-af26-613a4e23f4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:39.080537 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607de96d-5806-46b6-af26-613a4e23f4d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:39.081645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607de96d-5806-46b6-af26-613a4e23f4d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:39.082296 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607de96d-5806-46b6-af26-613a4e23f4d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:39.083879 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607de96d-5806-46b6-af26-613a4e23f4d7 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:39.103057 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 381/750] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:23:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:39.103057 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607de96d-5806-46b6-af26-613a4e23f4d7 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:39.207751 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f5dd8-b2e1-44c9-8d83-883378d56d85 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:39.209713 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607de96d-5806-46b6-af26-613a4e23f4d7 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:39.245722 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0fea5-0f66-4ec7-ba7b-9283dd8fc1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:39.246616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef760ccb-837d-4016-8cbe-e3b9dcb9bd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:39.246937 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0fea5-0f66-4ec7-ba7b-9283dd8fc1ff None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:39.247420 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef760ccb-837d-4016-8cbe-e3b9dcb9bd2f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:39.247589 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0fea5-0f66-4ec7-ba7b-9283dd8fc1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:39.247813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef760ccb-837d-4016-8cbe-e3b9dcb9bd2f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:39.248158 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef760ccb-837d-4016-8cbe-e3b9dcb9bd2f None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:39.248400 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0fea5-0f66-4ec7-ba7b-9283dd8fc1ff None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:39.249184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef760ccb-837d-4016-8cbe-e3b9dcb9bd2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:39.249556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef760ccb-837d-4016-8cbe-e3b9dcb9bd2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:39.249786 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0fea5-0f66-4ec7-ba7b-9283dd8fc1ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:39.250264 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0fea5-0f66-4ec7-ba7b-9283dd8fc1ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:39.251520 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef760ccb-837d-4016-8cbe-e3b9dcb9bd2f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:39.252653 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0fea5-0f66-4ec7-ba7b-9283dd8fc1ff None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:39.268487 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 382/751] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:39.268487 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef760ccb-837d-4016-8cbe-e3b9dcb9bd2f None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:39.278586 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 370/752] 10.222.0.32 () {56 vars in 1133 bytes} [Thu Jun 2 13:23:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:39.279807 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0fea5-0f66-4ec7-ba7b-9283dd8fc1ff None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:39.300456 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:39.320239 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:39.374321 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef760ccb-837d-4016-8cbe-e3b9dcb9bd2f None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:39.391311 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0fea5-0f66-4ec7-ba7b-9283dd8fc1ff None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:39.410093 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a369bc5-afd1-458d-9e63-e0a7aef430b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:39.410818 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a369bc5-afd1-458d-9e63-e0a7aef430b5 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:39.411243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a369bc5-afd1-458d-9e63-e0a7aef430b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:39.411373 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a369bc5-afd1-458d-9e63-e0a7aef430b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:39.412188 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a369bc5-afd1-458d-9e63-e0a7aef430b5 None admin] RBAC: Adding query filter params (role.id=128feb04d1e042ac844f9ad70b89bb02, scope.project.id=a9007447059e4862972078c032a5d67b, user.id=3aea97e7b39448a283032f662142b6e0) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:39.412520 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a369bc5-afd1-458d-9e63-e0a7aef430b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:39.413960 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a369bc5-afd1-458d-9e63-e0a7aef430b5 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:39.424343 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 383/753] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:23:39 2022] GET /identity/v3/role_assignments?user.id=3aea97e7b39448a283032f662142b6e0&scope.project.id=a9007447059e4862972078c032a5d67b&role.id=128feb04d1e042ac844f9ad70b89bb02 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:39.424343 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a369bc5-afd1-458d-9e63-e0a7aef430b5 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:39.444257 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26f6d7-73c1-4215-85f7-4b91f668f116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:39.445499 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26f6d7-73c1-4215-85f7-4b91f668f116 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:39.445994 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26f6d7-73c1-4215-85f7-4b91f668f116 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:39.447042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26f6d7-73c1-4215-85f7-4b91f668f116 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:39.460533 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26f6d7-73c1-4215-85f7-4b91f668f116 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:39.468334 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26f6d7-73c1-4215-85f7-4b91f668f116 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:39.493316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-0f26f6d7-73c1-4215-85f7-4b91f668f116 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:23:39.493316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:39.493316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:39.493316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:39.493316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:39.493316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:39.493316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:39.493316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:39.493316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:39.493316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:39.493316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:39.493316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:39.493316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:23:39.493316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:23:39.493316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:23:39.493316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:23:39.494338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:39.494338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:39.494338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:23:39.494338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:39.494338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:23:39.494338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:39.494338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:39.494338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:39.494338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:39.494338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:39.494338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:39.494338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:39.494338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:39.494338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:39.494338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:39.494338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:39.494338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:39.494338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:39.495279 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:39.495279 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:39.495279 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:23:39.495279 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:23:39.495279 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:23:39.495279 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:23:39.495279 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:23:39.495279 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:23:39.495279 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:23:39.495279 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:39.504751 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 371/754] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Jun 2 13:23:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:39.506018 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26f6d7-73c1-4215-85f7-4b91f668f116 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:39.533509 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a369bc5-afd1-458d-9e63-e0a7aef430b5 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:39.550662 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:39.574798 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a51bf-cb04-437b-8c34-353fcbe90c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:39.575936 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a51bf-cb04-437b-8c34-353fcbe90c3c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:39.576460 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a51bf-cb04-437b-8c34-353fcbe90c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:39.576944 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a51bf-cb04-437b-8c34-353fcbe90c3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:39.589828 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a51bf-cb04-437b-8c34-353fcbe90c3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:39.591697 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a51bf-cb04-437b-8c34-353fcbe90c3c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:39.610269 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-0c6a51bf-cb04-437b-8c34-353fcbe90c3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:39.610269 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:39.610269 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:39.610269 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:39.610269 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:39.610269 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:39.610269 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:39.610269 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:39.610269 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:39.610269 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:39.610269 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:39.610269 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:39.610269 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:39.610269 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:39.610269 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:39.611254 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:39.611254 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:39.611254 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:39.611254 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:39.611254 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:39.611254 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:39.611254 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:39.611254 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:39.611254 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:39.611254 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:39.611254 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:39.611254 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:39.611254 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:39.611254 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:39.611254 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:39.611254 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:39.611254 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:39.612147 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:39.612147 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:39.612147 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:39.612147 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:39.614645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 384/755] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:39.620283 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a51bf-cb04-437b-8c34-353fcbe90c3c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:39.667095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:39.713400 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26f6d7-73c1-4215-85f7-4b91f668f116 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:39.791149 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a51bf-cb04-437b-8c34-353fcbe90c3c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:39.793422 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bb4bf-18df-4165-b1bc-f8f32e3ccc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:39.795231 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bb4bf-18df-4165-b1bc-f8f32e3ccc24 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:39.796021 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bb4bf-18df-4165-b1bc-f8f32e3ccc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:39.797208 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bb4bf-18df-4165-b1bc-f8f32e3ccc24 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:39.798268 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bb4bf-18df-4165-b1bc-f8f32e3ccc24 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:39.799350 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bb4bf-18df-4165-b1bc-f8f32e3ccc24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:39.801065 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bb4bf-18df-4165-b1bc-f8f32e3ccc24 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:39.826441 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 372/756] 10.222.0.32 () {56 vars in 1149 bytes} [Thu Jun 2 13:23:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:39.832418 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bb4bf-18df-4165-b1bc-f8f32e3ccc24 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:39.834591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a43624-b9d9-4da7-801e-fcb8087edb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:39.835525 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a43624-b9d9-4da7-801e-fcb8087edb5f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:39.835809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a43624-b9d9-4da7-801e-fcb8087edb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:39.836085 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a43624-b9d9-4da7-801e-fcb8087edb5f None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:39.837559 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a43624-b9d9-4da7-801e-fcb8087edb5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:39.837867 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a43624-b9d9-4da7-801e-fcb8087edb5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:39.845786 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a43624-b9d9-4da7-801e-fcb8087edb5f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:39.874849 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 385/757] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:39.880327 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a43624-b9d9-4da7-801e-fcb8087edb5f None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:39.936158 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:39.957940 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bb4bf-18df-4165-b1bc-f8f32e3ccc24 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:40.008333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4377e-ddd1-4afb-a93b-c94f6e903ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:40.009491 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4377e-ddd1-4afb-a93b-c94f6e903ead None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:40.009991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4377e-ddd1-4afb-a93b-c94f6e903ead None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:40.010466 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4377e-ddd1-4afb-a93b-c94f6e903ead None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:40.015579 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:40.027423 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a43624-b9d9-4da7-801e-fcb8087edb5f None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:40.066439 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7c653-e1fc-4a65-8512-8463e2e07694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:40.067563 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7c653-e1fc-4a65-8512-8463e2e07694 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:40.068081 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7c653-e1fc-4a65-8512-8463e2e07694 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:40.068615 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7c653-e1fc-4a65-8512-8463e2e07694 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:40.076634 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7c653-e1fc-4a65-8512-8463e2e07694 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:40.078324 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7c653-e1fc-4a65-8512-8463e2e07694 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:40.093582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-4cc7c653-e1fc-4a65-8512-8463e2e07694 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:40.093582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:40.093582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:40.093582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:40.093582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:40.093582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:40.093582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:40.093582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:40.093582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:40.093582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:40.093582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:40.093582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:40.093582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:23:40.093582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:23:40.093582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:23:40.094505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:23:40.094505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:40.094505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:40.094505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:40.094505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:40.094505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:40.094505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:40.094505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:40.094505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:40.094505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:40.094505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:40.094505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:40.094505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:40.094505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:40.094505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:40.094505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:40.094505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:40.095422 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:23:40.095422 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:23:40.095422 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:23:40.095422 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:23:40.095422 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:23:40.095422 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:23:40.095422 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:40.095422 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:40.097455 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4377e-ddd1-4afb-a93b-c94f6e903ead None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:40.102182 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4377e-ddd1-4afb-a93b-c94f6e903ead None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:40.102936 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 386/758] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:23:40.104503 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c45028-1e81-4171-b209-db18f872c1e6 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:40.105003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c45028-1e81-4171-b209-db18f872c1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:40.105518 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c45028-1e81-4171-b209-db18f872c1e6 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:40.107355 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 387/759] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:40.108466 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c45028-1e81-4171-b209-db18f872c1e6 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:40.213471 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 373/760] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:23:39 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 13:23:40.215654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad389a-3338-443f-b7ca-997437c8e111 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:40.216166 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad389a-3338-443f-b7ca-997437c8e111 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:40.216667 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad389a-3338-443f-b7ca-997437c8e111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:40.233757 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-efad389a-3338-443f-b7ca-997437c8e111 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:40.234480 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:40.235591 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-efad389a-3338-443f-b7ca-997437c8e111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:40.252947 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c45028-1e81-4171-b209-db18f872c1e6 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:40.267111 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:40.292061 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94ea83-767c-44f5-96ae-1858e1605d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:40.292769 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94ea83-767c-44f5-96ae-1858e1605d52 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:40.293055 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94ea83-767c-44f5-96ae-1858e1605d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:40.293335 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94ea83-767c-44f5-96ae-1858e1605d52 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:40.294131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94ea83-767c-44f5-96ae-1858e1605d52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:40.294441 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94ea83-767c-44f5-96ae-1858e1605d52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:40.295886 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94ea83-767c-44f5-96ae-1858e1605d52 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:40.317110 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 388/761] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:23:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:40.317110 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94ea83-767c-44f5-96ae-1858e1605d52 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:40.317387 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 374/762] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:23:40.317387 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad389a-3338-443f-b7ca-997437c8e111 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:40.434285 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad389a-3338-443f-b7ca-997437c8e111 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:40.471315 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79e752-5cc4-4d0c-97ac-7c05f8a3bc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:40.471745 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94ea83-767c-44f5-96ae-1858e1605d52 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:40.472241 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79e752-5cc4-4d0c-97ac-7c05f8a3bc7f None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:40.472564 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79e752-5cc4-4d0c-97ac-7c05f8a3bc7f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:40.472842 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79e752-5cc4-4d0c-97ac-7c05f8a3bc7f None admin] PATH_INFO: `/v3/projects/a9007447059e4862972078c032a5d67b/users/b2e5d9f3c4e04ca3bf52b28b67d2a4d6/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:40.475586 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79e752-5cc4-4d0c-97ac-7c05f8a3bc7f None admin] RBAC: Authorizing `identity:create_grant(project_id=a9007447059e4862972078c032a5d67b, user_id=b2e5d9f3c4e04ca3bf52b28b67d2a4d6, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:40.476534 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79e752-5cc4-4d0c-97ac-7c05f8a3bc7f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:40.504329 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 375/763] 10.222.0.32 () {58 vars in 1439 bytes} [Thu Jun 2 13:23:40 2022] PUT /identity/v3/projects/a9007447059e4862972078c032a5d67b/users/b2e5d9f3c4e04ca3bf52b28b67d2a4d6/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:40.504329 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79e752-5cc4-4d0c-97ac-7c05f8a3bc7f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:40.530380 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd635821-2218-46bd-a0b6-4dd10d293ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:40.531742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:40.532096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd635821-2218-46bd-a0b6-4dd10d293ade None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:40.533276 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd635821-2218-46bd-a0b6-4dd10d293ade None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:40.533875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd635821-2218-46bd-a0b6-4dd10d293ade None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:40.557483 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd635821-2218-46bd-a0b6-4dd10d293ade None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:40.559470 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd635821-2218-46bd-a0b6-4dd10d293ade None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:40.573977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:40.595093 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-bd635821-2218-46bd-a0b6-4dd10d293ade None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:40.595093 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:40.595093 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:40.595093 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:40.595093 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:40.595093 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:40.595093 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:40.595093 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:40.595093 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:40.595093 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:40.595093 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:40.595093 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:40.595093 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:40.595093 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:40.595093 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:40.596124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:40.596124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:40.596124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:40.596124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:40.596124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:40.596124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:40.596124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:40.596124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:40.596124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:40.596124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:40.596124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:40.596124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:40.596124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:40.596124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:40.596124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:40.596124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:40.596124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:40.597062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:40.597062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:40.597062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:40.597062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:40.599931 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 389/764] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:40.607592 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd635821-2218-46bd-a0b6-4dd10d293ade None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:40.637013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79e752-5cc4-4d0c-97ac-7c05f8a3bc7f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:40.677417 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b2446-7c4a-45e7-903d-93d418db3fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:40.678647 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b2446-7c4a-45e7-903d-93d418db3fec None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:40.679192 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b2446-7c4a-45e7-903d-93d418db3fec None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:40.679671 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b2446-7c4a-45e7-903d-93d418db3fec None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:40.681221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b2446-7c4a-45e7-903d-93d418db3fec None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:40.683135 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b2446-7c4a-45e7-903d-93d418db3fec None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:40.707596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-914b2446-7c4a-45e7-903d-93d418db3fec None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:23:40.707596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:40.707596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:23:40.707596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:23:40.707596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:23:40.707596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:23:40.707596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:23:40.707596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:23:40.707596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:23:40.707596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:40.707596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:23:40.707596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:40.707596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:40.707596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:40.707596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:40.707596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:40.708625 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:40.708625 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:40.708625 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:40.708625 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:40.708625 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:40.708625 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:40.708625 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:40.708625 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:23:40.708625 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:23:40.708625 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:23:40.708625 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:23:40.708625 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:40.708625 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:40.708625 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:40.708625 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:40.708625 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:40.709468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:40.709468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:40.709468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:40.709468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:40.709468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:40.709468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:40.709468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:40.709468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:40.709468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:40.709468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:40.709468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:40.709468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:23:40.709468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:23:40.709468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:23:40.709468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:40.715612 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 376/765] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Jun 2 13:23:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:40.719539 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b2446-7c4a-45e7-903d-93d418db3fec None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:40.836483 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:40.845421 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd635821-2218-46bd-a0b6-4dd10d293ade None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:40.849869 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b2446-7c4a-45e7-903d-93d418db3fec None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:40.890055 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c013db4-fda3-4dd7-b74d-971743499155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:40.890726 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c013db4-fda3-4dd7-b74d-971743499155 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:40.891005 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c013db4-fda3-4dd7-b74d-971743499155 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:40.891282 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c013db4-fda3-4dd7-b74d-971743499155 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:40.891983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c013db4-fda3-4dd7-b74d-971743499155 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:40.892286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c013db4-fda3-4dd7-b74d-971743499155 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:40.894190 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c013db4-fda3-4dd7-b74d-971743499155 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:40.899564 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 377/766] 10.222.0.32 () {56 vars in 1124 bytes} [Thu Jun 2 13:23:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:40.906533 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c013db4-fda3-4dd7-b74d-971743499155 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:40.919460 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f166038-1392-462b-823c-1ab69be946c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:40.920143 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f166038-1392-462b-823c-1ab69be946c2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:40.920456 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f166038-1392-462b-823c-1ab69be946c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:40.920741 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f166038-1392-462b-823c-1ab69be946c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:40.921482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f166038-1392-462b-823c-1ab69be946c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:40.921794 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f166038-1392-462b-823c-1ab69be946c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:40.923185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f166038-1392-462b-823c-1ab69be946c2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:40.939944 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 390/767] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:40.946034 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f166038-1392-462b-823c-1ab69be946c2 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:41.030290 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:41.051918 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c013db4-fda3-4dd7-b74d-971743499155 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:41.075407 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f166038-1392-462b-823c-1ab69be946c2 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:41.088608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f170aea-8eaf-4ed3-a56f-61888e6cff47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:41.089279 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f170aea-8eaf-4ed3-a56f-61888e6cff47 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:41.089568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f170aea-8eaf-4ed3-a56f-61888e6cff47 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:41.089851 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f170aea-8eaf-4ed3-a56f-61888e6cff47 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:41.090560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f170aea-8eaf-4ed3-a56f-61888e6cff47 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:41.090870 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f170aea-8eaf-4ed3-a56f-61888e6cff47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:41.092264 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f170aea-8eaf-4ed3-a56f-61888e6cff47 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:41.097579 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 378/768] 10.222.0.32 () {56 vars in 1124 bytes} [Thu Jun 2 13:23:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:41.098793 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36381d-8af0-4cc1-8c47-e3dc7abc4e5c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:41.099085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36381d-8af0-4cc1-8c47-e3dc7abc4e5c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:41.099368 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36381d-8af0-4cc1-8c47-e3dc7abc4e5c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:41.106195 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 379/769] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:41.107076 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36381d-8af0-4cc1-8c47-e3dc7abc4e5c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:41.116064 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8b591-a093-489a-a61b-683ca84556ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:41.116907 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8b591-a093-489a-a61b-683ca84556ce None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:41.117190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8b591-a093-489a-a61b-683ca84556ce None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:41.117470 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8b591-a093-489a-a61b-683ca84556ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:41.124662 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8b591-a093-489a-a61b-683ca84556ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:41.126126 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8b591-a093-489a-a61b-683ca84556ce None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:41.127561 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:41.144476 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-65a8b591-a093-489a-a61b-683ca84556ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:41.144476 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:41.144476 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:41.144476 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:41.144476 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:41.144476 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:41.144476 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:41.144476 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:41.144476 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:41.144476 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:41.144476 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:41.144476 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:41.144476 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:23:41.144476 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:23:41.144476 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:23:41.145410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:23:41.145410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:41.145410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:41.145410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:41.145410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:41.145410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:41.145410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:41.145410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:41.145410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:41.145410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:41.145410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:41.145410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:41.145410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:41.145410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:41.145410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:41.145410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:41.145410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:41.146315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:23:41.146315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:23:41.146315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:23:41.146315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:23:41.146315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:23:41.146315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:23:41.146315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:41.146315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:41.146315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 391/770] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:41.148517 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a234b5-62c6-4956-8298-64a6ea173eda None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:41.148808 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a234b5-62c6-4956-8298-64a6ea173eda None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:41.149088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a234b5-62c6-4956-8298-64a6ea173eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:41.170896 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-76a234b5-62c6-4956-8298-64a6ea173eda None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:41.172405 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-76a234b5-62c6-4956-8298-64a6ea173eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:41.232351 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36381d-8af0-4cc1-8c47-e3dc7abc4e5c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:41.244054 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 392/771] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:23:41.245212 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a234b5-62c6-4956-8298-64a6ea173eda None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:41.287285 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78240fc6-8ef3-402b-9957-da111d8eb01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:41.288427 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78240fc6-8ef3-402b-9957-da111d8eb01c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:41.288938 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78240fc6-8ef3-402b-9957-da111d8eb01c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:41.289473 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78240fc6-8ef3-402b-9957-da111d8eb01c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:41.291183 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78240fc6-8ef3-402b-9957-da111d8eb01c None admin] RBAC: Adding query filter params (interface=public, service_id=ccbc5fc20eb44d29997d7aeda8d72fae, region_id=RegionOne) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:41.291799 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78240fc6-8ef3-402b-9957-da111d8eb01c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:41.293453 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78240fc6-8ef3-402b-9957-da111d8eb01c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:41.302689 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 380/772] 10.222.0.32 () {56 vars in 1251 bytes} [Thu Jun 2 13:23:41 2022] GET /identity/v3/endpoints?service_id=ccbc5fc20eb44d29997d7aeda8d72fae&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:41.308450 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78240fc6-8ef3-402b-9957-da111d8eb01c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:41.315953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:41.384704 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a234b5-62c6-4956-8298-64a6ea173eda None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:41.425242 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:41.430671 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce63e7-47b3-4842-92c5-6f25f90e3044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:41.431621 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce63e7-47b3-4842-92c5-6f25f90e3044 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:41.432134 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce63e7-47b3-4842-92c5-6f25f90e3044 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:41.432692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce63e7-47b3-4842-92c5-6f25f90e3044 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:41.433719 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce63e7-47b3-4842-92c5-6f25f90e3044 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:41.434268 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce63e7-47b3-4842-92c5-6f25f90e3044 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:41.436172 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce63e7-47b3-4842-92c5-6f25f90e3044 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:41.444638 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78240fc6-8ef3-402b-9957-da111d8eb01c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:41.450589 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 393/773] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:23:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:41.451784 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce63e7-47b3-4842-92c5-6f25f90e3044 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:41.482951 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a9713-ecc1-4225-abb4-57c62aeb767a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:41.483776 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a9713-ecc1-4225-abb4-57c62aeb767a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:41.484440 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a9713-ecc1-4225-abb4-57c62aeb767a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:41.484725 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a9713-ecc1-4225-abb4-57c62aeb767a None admin] PATH_INFO: `/v3/services/network` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:41.485660 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a9713-ecc1-4225-abb4-57c62aeb767a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:41.487207 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a9713-ecc1-4225-abb4-57c62aeb767a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:41.500720 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ed8a9713-ecc1-4225-abb4-57c62aeb767a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:23:41.500720 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:41.500720 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:23:41.500720 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:23:41.500720 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:23:41.500720 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:23:41.500720 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:23:41.500720 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:23:41.500720 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:23:41.500720 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:41.500720 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:23:41.500720 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:41.500720 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:41.500720 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:41.500720 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:41.500720 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:41.500720 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:41.501759 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:41.501759 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:41.501759 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:41.501759 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:41.501759 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:41.501759 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:41.501759 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:23:41.501759 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:23:41.501759 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:23:41.501759 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:23:41.501759 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:41.501759 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:41.501759 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:41.501759 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:41.501759 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:41.501759 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:41.502608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:41.502608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:41.502608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:41.502608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:41.502608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:41.502608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:41.502608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:41.502608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:41.502608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:41.502608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:41.502608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:23:41.502608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:23:41.502608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:23:41.502608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:41.505544 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 381/774] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:41 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:41.506568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a9713-ecc1-4225-abb4-57c62aeb767a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:41.573294 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce63e7-47b3-4842-92c5-6f25f90e3044 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:41.583489 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:41.614558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274a78b-ebe3-4db1-9083-48099662d481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:41.615646 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274a78b-ebe3-4db1-9083-48099662d481 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:41.616168 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274a78b-ebe3-4db1-9083-48099662d481 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:41.616685 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274a78b-ebe3-4db1-9083-48099662d481 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:41.617716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274a78b-ebe3-4db1-9083-48099662d481 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:41.619472 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274a78b-ebe3-4db1-9083-48099662d481 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:41.632580 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a9713-ecc1-4225-abb4-57c62aeb767a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:41.632956 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 394/775] 10.222.0.32 () {56 vars in 1087 bytes} [Thu Jun 2 13:23:41 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:41.634897 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274a78b-ebe3-4db1-9083-48099662d481 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:41.681843 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a49f94-7477-4d26-81da-51c1dc47129f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:41.682514 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a49f94-7477-4d26-81da-51c1dc47129f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:41.682798 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a49f94-7477-4d26-81da-51c1dc47129f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:41.683076 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a49f94-7477-4d26-81da-51c1dc47129f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:41.683921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a49f94-7477-4d26-81da-51c1dc47129f None admin] RBAC: Adding query filter params (role.id=a12865c9fb9e4fa0b61e4adfd53188fb, scope.project.id=a9007447059e4862972078c032a5d67b, user.id=bbcd5ba866b84d099d183fe19ba61a4f) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:41.684236 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a49f94-7477-4d26-81da-51c1dc47129f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:41.685732 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a49f94-7477-4d26-81da-51c1dc47129f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:41.704494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 382/776] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:23:41 2022] GET /identity/v3/role_assignments?user.id=bbcd5ba866b84d099d183fe19ba61a4f&scope.project.id=a9007447059e4862972078c032a5d67b&role.id=a12865c9fb9e4fa0b61e4adfd53188fb => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:41.784063 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274a78b-ebe3-4db1-9083-48099662d481 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:41.828408 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b794e5f-f09e-46bd-9ddc-f26a16a9d710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:41.829030 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b794e5f-f09e-46bd-9ddc-f26a16a9d710 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:41.829317 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b794e5f-f09e-46bd-9ddc-f26a16a9d710 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:41.829595 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b794e5f-f09e-46bd-9ddc-f26a16a9d710 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:41.830368 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b794e5f-f09e-46bd-9ddc-f26a16a9d710 None admin] RBAC: Adding query filter params (name=network) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:41.830679 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b794e5f-f09e-46bd-9ddc-f26a16a9d710 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:41.832152 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b794e5f-f09e-46bd-9ddc-f26a16a9d710 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:41.838161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 395/777] 10.222.0.32 () {56 vars in 1112 bytes} [Thu Jun 2 13:23:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:41.843713 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a49f94-7477-4d26-81da-51c1dc47129f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:41.872838 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:41.971647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e391b16-657b-4013-85b4-09a5fa4386f1 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:41.972169 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e391b16-657b-4013-85b4-09a5fa4386f1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:41.972169 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e391b16-657b-4013-85b4-09a5fa4386f1 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:41.973860 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 396/778] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:23:41.979778 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f955a8-d7ff-42ad-9f0c-73d70447f2ce None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:41.980072 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f955a8-d7ff-42ad-9f0c-73d70447f2ce None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:41.984326 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f955a8-d7ff-42ad-9f0c-73d70447f2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:41.988492 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a49f94-7477-4d26-81da-51c1dc47129f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:42.001868 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e4f955a8-d7ff-42ad-9f0c-73d70447f2ce None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:42.003195 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e4f955a8-d7ff-42ad-9f0c-73d70447f2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:42.039310 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a687db5-9d4a-4226-8d37-9701ecc95050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:42.040024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a687db5-9d4a-4226-8d37-9701ecc95050 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:42.040864 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a687db5-9d4a-4226-8d37-9701ecc95050 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:42.041159 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a687db5-9d4a-4226-8d37-9701ecc95050 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:42.042059 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a687db5-9d4a-4226-8d37-9701ecc95050 None admin] RBAC: Adding query filter params (type=network) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:42.042467 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a687db5-9d4a-4226-8d37-9701ecc95050 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:42.048322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a687db5-9d4a-4226-8d37-9701ecc95050 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:42.050316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 383/779] 10.222.0.32 () {56 vars in 1112 bytes} [Thu Jun 2 13:23:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:42.056271 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a687db5-9d4a-4226-8d37-9701ecc95050 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:42.056627 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:42.127364 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 397/780] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:23:42.167513 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:42.172266 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f955a8-d7ff-42ad-9f0c-73d70447f2ce None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:42.224157 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a687db5-9d4a-4226-8d37-9701ecc95050 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:42.291416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ceda94-77d8-4208-b71b-93628e19afa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:42.292086 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ceda94-77d8-4208-b71b-93628e19afa1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:42.292495 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ceda94-77d8-4208-b71b-93628e19afa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:42.292775 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ceda94-77d8-4208-b71b-93628e19afa1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:42.293569 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ceda94-77d8-4208-b71b-93628e19afa1 None admin] RBAC: Adding query filter params (interface=public, service_id=9aecbf025677489587bc2c5d3990c86b, region_id=RegionOne) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:42.293883 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ceda94-77d8-4208-b71b-93628e19afa1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:42.295411 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ceda94-77d8-4208-b71b-93628e19afa1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:42.309684 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 384/781] 10.222.0.32 () {56 vars in 1251 bytes} [Thu Jun 2 13:23:42 2022] GET /identity/v3/endpoints?service_id=9aecbf025677489587bc2c5d3990c86b&interface=public®ion_id=RegionOne => generated 194 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:42.314445 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f955a8-d7ff-42ad-9f0c-73d70447f2ce None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:42.315068 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ceda94-77d8-4208-b71b-93628e19afa1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:42.349710 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068c2e4-df61-43bd-8a07-0300aa9c4180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:42.350505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068c2e4-df61-43bd-8a07-0300aa9c4180 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:42.350792 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068c2e4-df61-43bd-8a07-0300aa9c4180 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:42.351070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068c2e4-df61-43bd-8a07-0300aa9c4180 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:42.362593 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068c2e4-df61-43bd-8a07-0300aa9c4180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:42.370994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-e068c2e4-df61-43bd-8a07-0300aa9c4180 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:23:42.370994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:42.370994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:42.370994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:42.370994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:42.370994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:42.370994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:42.370994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:42.370994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:42.370994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:42.370994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:42.370994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:42.370994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:42.370994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:42.370994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:42.370994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:42.371969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:42.371969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:42.371969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:42.371969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:42.371969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:42.371969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:42.371969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:42.371969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:42.371969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:42.371969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:42.371969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:42.371969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:42.371969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:42.371969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:42.371969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:42.371969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:42.372871 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:42.372871 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:42.372871 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:42.372871 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:42.372871 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:42.372871 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:42.372871 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:42.372871 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:42.372871 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:42.372871 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:42.372871 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:23:42.372871 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:42.372871 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 398/782] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:23:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:23:42.378231 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068c2e4-df61-43bd-8a07-0300aa9c4180 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:42.412445 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:42.512062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ceda94-77d8-4208-b71b-93628e19afa1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:42.553172 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068c2e4-df61-43bd-8a07-0300aa9c4180 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:42.566808 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde4993-2676-4012-b382-1178275df006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:42.567485 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde4993-2676-4012-b382-1178275df006 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:42.567769 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde4993-2676-4012-b382-1178275df006 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:42.568048 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde4993-2676-4012-b382-1178275df006 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:42.568808 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde4993-2676-4012-b382-1178275df006 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:42.570623 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde4993-2676-4012-b382-1178275df006 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:42.579064 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 385/783] 10.222.0.32 () {56 vars in 1087 bytes} [Thu Jun 2 13:23:42 2022] GET /identity/v3/services => generated 772 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:42.603738 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5baddd-ab29-41f8-b361-d7645073ff74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:42.604469 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5baddd-ab29-41f8-b361-d7645073ff74 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:42.604755 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5baddd-ab29-41f8-b361-d7645073ff74 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:42.605032 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5baddd-ab29-41f8-b361-d7645073ff74 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:42.605809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5baddd-ab29-41f8-b361-d7645073ff74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:42.606176 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5baddd-ab29-41f8-b361-d7645073ff74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:42.607584 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5baddd-ab29-41f8-b361-d7645073ff74 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:42.617308 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 399/784] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:23:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:42.625536 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde4993-2676-4012-b382-1178275df006 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:42.632752 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:42.779399 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde4993-2676-4012-b382-1178275df006 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:42.817745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e579f9-38c7-4f9b-8f51-2b5f63cd956f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:42.818556 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e579f9-38c7-4f9b-8f51-2b5f63cd956f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:42.818844 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e579f9-38c7-4f9b-8f51-2b5f63cd956f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:42.819122 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e579f9-38c7-4f9b-8f51-2b5f63cd956f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:42.831412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e579f9-38c7-4f9b-8f51-2b5f63cd956f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:42.833135 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e579f9-38c7-4f9b-8f51-2b5f63cd956f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:42.854163 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-49e579f9-38c7-4f9b-8f51-2b5f63cd956f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:42.854163 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:42.854163 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:42.854163 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:42.854163 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:42.854163 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:42.854163 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:42.854163 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:42.854163 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:42.854163 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:42.854163 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:42.854163 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:42.854163 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:42.854163 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:42.854163 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:42.855144 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:42.855144 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:42.855144 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:42.855144 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:42.855144 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:42.855144 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:42.855144 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:42.855144 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:42.855144 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:42.855144 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:42.855144 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:42.855144 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:42.855144 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:42.855144 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:42.855144 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:42.855144 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:42.855144 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:42.856037 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:42.856037 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:42.856037 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:42.856037 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:42.856037 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 386/785] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:42.865848 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5baddd-ab29-41f8-b361-d7645073ff74 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:42.971939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:42.987005 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5baddd-ab29-41f8-b361-d7645073ff74 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:43.047368 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8339f-266a-4411-a85a-4b5d5b207e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:43.048038 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8339f-266a-4411-a85a-4b5d5b207e0b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:43.048338 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8339f-266a-4411-a85a-4b5d5b207e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:43.048619 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8339f-266a-4411-a85a-4b5d5b207e0b None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:43.049356 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8339f-266a-4411-a85a-4b5d5b207e0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:43.049663 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8339f-266a-4411-a85a-4b5d5b207e0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:43.051045 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8339f-266a-4411-a85a-4b5d5b207e0b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:43.069939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 400/786] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:43.076281 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e579f9-38c7-4f9b-8f51-2b5f63cd956f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:43.159711 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:43.206406 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e579f9-38c7-4f9b-8f51-2b5f63cd956f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:43.212940 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12d9e5-e771-49a1-abfe-8ad140889ed0 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:43.213235 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12d9e5-e771-49a1-abfe-8ad140889ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:43.213517 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12d9e5-e771-49a1-abfe-8ad140889ed0 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:43.215139 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 401/787] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:43.221540 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81d363-6f54-47c8-8dac-60e0b4fee03d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:43.221832 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81d363-6f54-47c8-8dac-60e0b4fee03d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:43.222160 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81d363-6f54-47c8-8dac-60e0b4fee03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:43.241997 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8cd12-dfad-4c76-831c-cf1c969ee644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:43.242805 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8cd12-dfad-4c76-831c-cf1c969ee644 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:43.243175 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8cd12-dfad-4c76-831c-cf1c969ee644 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:43.243462 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8cd12-dfad-4c76-831c-cf1c969ee644 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:43.251457 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8cd12-dfad-4c76-831c-cf1c969ee644 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:43.252978 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8cd12-dfad-4c76-831c-cf1c969ee644 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:43.262771 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-1a81d363-6f54-47c8-8dac-60e0b4fee03d None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:43.264222 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1a81d363-6f54-47c8-8dac-60e0b4fee03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:43.272322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ebc8cd12-dfad-4c76-831c-cf1c969ee644 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:23:43.272322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:43.272322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:43.272322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:43.272322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:43.272322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:43.272322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:43.272322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:43.272322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:43.272322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:43.272322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:43.272322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:43.272322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:23:43.272322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:23:43.272322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:23:43.272322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:23:43.273307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:43.273307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:43.273307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:23:43.273307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:43.273307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:23:43.273307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:43.273307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:43.273307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:43.273307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:43.273307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:43.273307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:43.273307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:43.273307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:43.273307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:43.273307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:43.273307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:43.273307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:43.273307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:43.274892 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:43.274892 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:43.274892 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:23:43.274892 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:23:43.274892 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:23:43.274892 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:23:43.274892 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:23:43.274892 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:23:43.274892 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:23:43.274892 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:43.274892 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 387/788] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:23:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:43.275994 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8cd12-dfad-4c76-831c-cf1c969ee644 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:43.420870 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 402/789] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:23:43.433239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8cd12-dfad-4c76-831c-cf1c969ee644 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:43.457212 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:43.461808 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81d363-6f54-47c8-8dac-60e0b4fee03d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:43.488239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe77ee-b7c5-4362-b53e-7bd8117acb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:43.488867 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe77ee-b7c5-4362-b53e-7bd8117acb1a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:43.489152 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe77ee-b7c5-4362-b53e-7bd8117acb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:43.489431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe77ee-b7c5-4362-b53e-7bd8117acb1a None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:43.490281 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe77ee-b7c5-4362-b53e-7bd8117acb1a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:43.490596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe77ee-b7c5-4362-b53e-7bd8117acb1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:43.492058 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe77ee-b7c5-4362-b53e-7bd8117acb1a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:43.518284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 388/790] 10.222.0.32 () {56 vars in 1135 bytes} [Thu Jun 2 13:23:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:43.523999 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe77ee-b7c5-4362-b53e-7bd8117acb1a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:43.611514 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:43.672191 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe77ee-b7c5-4362-b53e-7bd8117acb1a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:43.674405 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81d363-6f54-47c8-8dac-60e0b4fee03d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:43.711772 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10aa75f-8c3b-41a8-9f77-f66424318557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:43.712746 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10aa75f-8c3b-41a8-9f77-f66424318557 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:43.713148 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10aa75f-8c3b-41a8-9f77-f66424318557 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:43.713423 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10aa75f-8c3b-41a8-9f77-f66424318557 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:43.726607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10aa75f-8c3b-41a8-9f77-f66424318557 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:43.726607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10aa75f-8c3b-41a8-9f77-f66424318557 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:43.747246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c10aa75f-8c3b-41a8-9f77-f66424318557 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:43.747246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:43.747246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:43.747246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:43.747246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:43.747246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:43.747246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:43.747246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:43.747246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:43.747246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:43.747246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:43.747246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:43.747246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:43.747246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:43.747246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:43.748325 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:43.748325 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:43.748325 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:43.748325 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:43.748325 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:43.748325 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:43.748325 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:43.748325 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:43.748325 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:43.748325 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:43.748325 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:43.748325 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:43.748325 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:43.748325 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:43.748325 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:43.748325 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:43.748325 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:43.749420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:43.749420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:43.749420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:43.749420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:43.751181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 389/791] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:23:43.757042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10aa75f-8c3b-41a8-9f77-f66424318557 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:43.766528 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4639f2-2de7-48ec-904d-14cfbeb5508b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:43.767596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4639f2-2de7-48ec-904d-14cfbeb5508b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:43.768038 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4639f2-2de7-48ec-904d-14cfbeb5508b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:43.768513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4639f2-2de7-48ec-904d-14cfbeb5508b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:43.786491 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:43.792927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4639f2-2de7-48ec-904d-14cfbeb5508b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:43.800951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-4f4639f2-2de7-48ec-904d-14cfbeb5508b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:23:43.800951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:43.800951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:43.800951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:43.800951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:43.800951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:43.800951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:43.800951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:43.800951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:43.800951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:43.800951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:43.800951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:43.800951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:43.800951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:43.800951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:43.800951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:43.801914 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:43.801914 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:43.801914 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:43.801914 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:43.801914 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:43.801914 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:43.801914 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:43.801914 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:43.801914 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:43.801914 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:43.801914 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:43.801914 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:43.801914 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:43.801914 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:43.801914 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:43.801914 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:43.802739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:43.802739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:43.802739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:43.802739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:43.802739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:43.802739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:43.802739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:43.802739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:43.802739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:43.802739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:43.802739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:23:43.802739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:43.814505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 403/792] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:23:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:23:43.819930 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4639f2-2de7-48ec-904d-14cfbeb5508b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:43.870111 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10aa75f-8c3b-41a8-9f77-f66424318557 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:43.914588 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c320a8-2823-4350-82a8-bfcbbd07abf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:43.915799 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c320a8-2823-4350-82a8-bfcbbd07abf1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:43.916084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c320a8-2823-4350-82a8-bfcbbd07abf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:43.919082 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c320a8-2823-4350-82a8-bfcbbd07abf1 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:43.919830 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c320a8-2823-4350-82a8-bfcbbd07abf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:43.920146 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c320a8-2823-4350-82a8-bfcbbd07abf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:43.924129 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c320a8-2823-4350-82a8-bfcbbd07abf1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:43.956084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 390/793] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:43.959186 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c320a8-2823-4350-82a8-bfcbbd07abf1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:44.042627 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4639f2-2de7-48ec-904d-14cfbeb5508b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:44.082722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49321453-a324-4eb0-9c8e-f1cfaca7717a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:44.083548 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49321453-a324-4eb0-9c8e-f1cfaca7717a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:44.083841 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49321453-a324-4eb0-9c8e-f1cfaca7717a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:44.084125 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49321453-a324-4eb0-9c8e-f1cfaca7717a None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:44.084939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49321453-a324-4eb0-9c8e-f1cfaca7717a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:44.085519 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49321453-a324-4eb0-9c8e-f1cfaca7717a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:44.087773 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49321453-a324-4eb0-9c8e-f1cfaca7717a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:44.094573 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:44.102043 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 404/794] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:23:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:44.108126 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49321453-a324-4eb0-9c8e-f1cfaca7717a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:44.195853 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:44.232638 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49321453-a324-4eb0-9c8e-f1cfaca7717a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:44.246536 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c320a8-2823-4350-82a8-bfcbbd07abf1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:44.272428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a807188-a2e6-4afa-a9f2-743d89252707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:44.273519 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a807188-a2e6-4afa-a9f2-743d89252707 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:44.274043 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a807188-a2e6-4afa-a9f2-743d89252707 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:44.275054 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a807188-a2e6-4afa-a9f2-743d89252707 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:44.287111 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a807188-a2e6-4afa-a9f2-743d89252707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:44.288873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a807188-a2e6-4afa-a9f2-743d89252707 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:44.310089 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-1a807188-a2e6-4afa-a9f2-743d89252707 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:44.310089 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:44.310089 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:44.310089 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:44.310089 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:44.310089 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:44.310089 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:44.310089 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:44.310089 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:44.310089 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:44.310089 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:44.310089 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:44.310089 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:44.310089 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:44.310089 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:44.311031 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:44.311031 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:44.311031 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:44.311031 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:44.311031 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:44.311031 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:44.311031 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:44.311031 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:44.311031 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:44.311031 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:44.311031 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:44.311031 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:44.311031 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:44.311031 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:44.311031 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:44.311031 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:44.311031 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:44.311922 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:44.311922 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:44.311922 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:44.311922 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:44.314621 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 405/795] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:23:44.319516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a807188-a2e6-4afa-a9f2-743d89252707 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:44.325465 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a3526-cbbe-4d3d-bfb6-cac5372b9876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:44.331650 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a3526-cbbe-4d3d-bfb6-cac5372b9876 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:44.332217 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a3526-cbbe-4d3d-bfb6-cac5372b9876 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:44.332736 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a3526-cbbe-4d3d-bfb6-cac5372b9876 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:44.347709 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a3526-cbbe-4d3d-bfb6-cac5372b9876 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:44.349489 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a3526-cbbe-4d3d-bfb6-cac5372b9876 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:44.374275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9f5a3526-cbbe-4d3d-bfb6-cac5372b9876 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:44.374275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:44.374275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:44.374275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:44.374275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:44.374275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:44.374275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:44.374275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:44.374275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:44.374275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:44.374275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:44.374275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:44.374275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:23:44.374275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:23:44.374275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:23:44.375245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:23:44.375245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:44.375245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:44.375245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:44.375245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:44.375245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:44.375245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:44.375245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:44.375245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:44.375245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:44.375245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:44.375245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:44.375245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:44.375245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:44.375245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:44.375245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:44.375245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:44.376143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:23:44.376143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:23:44.376143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:23:44.376143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:23:44.376143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:23:44.376143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:23:44.376143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:44.376143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:44.390137 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 391/796] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 433 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:44.405809 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a3526-cbbe-4d3d-bfb6-cac5372b9876 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:44.423306 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:44.513172 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a807188-a2e6-4afa-a9f2-743d89252707 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:44.530211 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a3526-cbbe-4d3d-bfb6-cac5372b9876 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:44.560122 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74518eb8-2726-47ee-be47-c1279a40a4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:44.561340 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74518eb8-2726-47ee-be47-c1279a40a4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:44.561856 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74518eb8-2726-47ee-be47-c1279a40a4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:44.562340 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74518eb8-2726-47ee-be47-c1279a40a4d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:44.563399 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74518eb8-2726-47ee-be47-c1279a40a4d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:44.564094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74518eb8-2726-47ee-be47-c1279a40a4d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:44.565682 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74518eb8-2726-47ee-be47-c1279a40a4d0 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:44.572583 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48406bc-6b55-4dc4-9009-4a35fbcfb5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:44.573430 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48406bc-6b55-4dc4-9009-4a35fbcfb5c0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:44.573958 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48406bc-6b55-4dc4-9009-4a35fbcfb5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:44.574447 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48406bc-6b55-4dc4-9009-4a35fbcfb5c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:44.575429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48406bc-6b55-4dc4-9009-4a35fbcfb5c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:44.576010 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48406bc-6b55-4dc4-9009-4a35fbcfb5c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:44.577676 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48406bc-6b55-4dc4-9009-4a35fbcfb5c0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:44.582759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 406/797] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:44.582759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a5f59-eae8-40e7-80e5-a22e4725c1a4 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:44.582759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a5f59-eae8-40e7-80e5-a22e4725c1a4 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:44.582759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a5f59-eae8-40e7-80e5-a22e4725c1a4 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:44.582759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 407/798] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:44.585785 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a5f59-eae8-40e7-80e5-a22e4725c1a4 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:44.596718 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 392/799] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:23:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:44.598540 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18612c4-3ee7-42bb-8bfb-c07f49a3d9fd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:44.599037 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18612c4-3ee7-42bb-8bfb-c07f49a3d9fd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:44.599495 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18612c4-3ee7-42bb-8bfb-c07f49a3d9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:44.606254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:44.618765 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a18612c4-3ee7-42bb-8bfb-c07f49a3d9fd None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:44.620364 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a18612c4-3ee7-42bb-8bfb-c07f49a3d9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:44.690764 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 393/800] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:23:44.692146 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18612c4-3ee7-42bb-8bfb-c07f49a3d9fd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:44.706005 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a5f59-eae8-40e7-80e5-a22e4725c1a4 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:44.721004 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:44.745721 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854a8ed-51f5-4adf-9725-f8563cf530bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:44.746521 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854a8ed-51f5-4adf-9725-f8563cf530bb None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:44.746806 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854a8ed-51f5-4adf-9725-f8563cf530bb None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:44.747440 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854a8ed-51f5-4adf-9725-f8563cf530bb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:44.756177 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2854a8ed-51f5-4adf-9725-f8563cf530bb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:44.757685 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2854a8ed-51f5-4adf-9725-f8563cf530bb None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:44.773931 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-2854a8ed-51f5-4adf-9725-f8563cf530bb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:23:44.773931 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:44.773931 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:44.773931 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:44.773931 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:44.773931 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:44.773931 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:44.773931 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:44.773931 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:44.773931 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:44.773931 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:44.773931 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:44.773931 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:23:44.773931 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:23:44.773931 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:23:44.773931 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:23:44.775722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:44.775722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:44.775722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:23:44.775722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:44.775722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:23:44.775722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:44.775722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:44.775722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:44.775722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:44.775722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:44.775722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:44.775722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:44.775722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:44.775722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:44.775722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:44.775722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:44.775722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:44.775722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:44.776718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:44.776718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:44.776718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:23:44.776718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:23:44.776718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:23:44.776718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:23:44.776718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:23:44.776718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:23:44.776718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:23:44.776718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:44.776718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 408/801] 10.222.0.32 () {56 vars in 1093 bytes} [Thu Jun 2 13:23:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:44.778570 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50212c80-1e69-43c3-8d33-7e8ac3b7a185 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:44.779072 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50212c80-1e69-43c3-8d33-7e8ac3b7a185 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:44.779543 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50212c80-1e69-43c3-8d33-7e8ac3b7a185 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:44.785486 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 409/802] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:44.785486 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50212c80-1e69-43c3-8d33-7e8ac3b7a185 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:44.823627 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18612c4-3ee7-42bb-8bfb-c07f49a3d9fd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:44.858710 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5aa22a-b961-4d39-be7d-70b6ed63a355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:44.859606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5aa22a-b961-4d39-be7d-70b6ed63a355 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:44.859888 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5aa22a-b961-4d39-be7d-70b6ed63a355 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:44.860163 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5aa22a-b961-4d39-be7d-70b6ed63a355 None admin] PATH_INFO: `/v3/projects/a9007447059e4862972078c032a5d67b/users/3aea97e7b39448a283032f662142b6e0/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:44.862162 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5aa22a-b961-4d39-be7d-70b6ed63a355 None admin] RBAC: Authorizing `identity:create_grant(project_id=a9007447059e4862972078c032a5d67b, user_id=3aea97e7b39448a283032f662142b6e0, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:44.863617 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5aa22a-b961-4d39-be7d-70b6ed63a355 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:44.866371 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:44.878950 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 394/803] 10.222.0.32 () {58 vars in 1439 bytes} [Thu Jun 2 13:23:44 2022] PUT /identity/v3/projects/a9007447059e4862972078c032a5d67b/users/3aea97e7b39448a283032f662142b6e0/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:44.879756 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5aa22a-b961-4d39-be7d-70b6ed63a355 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:44.908763 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50212c80-1e69-43c3-8d33-7e8ac3b7a185 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:44.963463 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d694e-9ef0-4351-a8bb-d2eeba909ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:44.964884 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d694e-9ef0-4351-a8bb-d2eeba909ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:44.965357 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d694e-9ef0-4351-a8bb-d2eeba909ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:44.965967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d694e-9ef0-4351-a8bb-d2eeba909ee9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:44.984576 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d694e-9ef0-4351-a8bb-d2eeba909ee9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:44.994094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-f03d694e-9ef0-4351-a8bb-d2eeba909ee9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:44.994094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:44.994094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:44.994094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:44.994094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:44.994094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:44.994094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:44.994094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:44.994094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:44.994094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:44.994094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:44.994094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:44.994094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:44.994094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:44.994094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:44.994094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:44.995315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:44.995315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:44.995315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:44.995315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:44.995315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:44.995315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:44.995315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:44.995315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:44.995315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:44.995315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:44.995315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:44.995315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:44.995315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:44.995315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:44.995315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:44.995315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:44.996410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:44.996410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:44.996410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:44.996410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:44.996410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:44.996410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:44.996410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:44.996410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:44.996410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:44.996410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:44.996410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:44.996410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:44.996410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 410/804] 10.222.0.32 () {56 vars in 1102 bytes} [Thu Jun 2 13:23:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:44.997134 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90269e57-a4a2-46e9-b823-f99f0e23da68 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:44.997134 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90269e57-a4a2-46e9-b823-f99f0e23da68 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:44.997515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90269e57-a4a2-46e9-b823-f99f0e23da68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:45.023417 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5aa22a-b961-4d39-be7d-70b6ed63a355 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:45.026065 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-90269e57-a4a2-46e9-b823-f99f0e23da68 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:45.027603 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-90269e57-a4a2-46e9-b823-f99f0e23da68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:45.059505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:45.076269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694806b5-507f-4f0d-b1fe-4fdfbd7670d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:45.077251 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694806b5-507f-4f0d-b1fe-4fdfbd7670d4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:45.077718 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694806b5-507f-4f0d-b1fe-4fdfbd7670d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:45.078814 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694806b5-507f-4f0d-b1fe-4fdfbd7670d4 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:45.079855 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694806b5-507f-4f0d-b1fe-4fdfbd7670d4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:45.080351 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694806b5-507f-4f0d-b1fe-4fdfbd7670d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:45.082958 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694806b5-507f-4f0d-b1fe-4fdfbd7670d4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:45.106975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 395/805] 10.222.0.32 () {56 vars in 1133 bytes} [Thu Jun 2 13:23:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:45.108151 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694806b5-507f-4f0d-b1fe-4fdfbd7670d4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:45.116569 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 411/806] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:23:45.118700 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6b691-4ddc-4c8b-9e05-12422b9b8761 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:45.119072 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6b691-4ddc-4c8b-9e05-12422b9b8761 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:45.119430 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6b691-4ddc-4c8b-9e05-12422b9b8761 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:45.121003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 412/807] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:45.121801 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6b691-4ddc-4c8b-9e05-12422b9b8761 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:45.173609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:45.225287 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694806b5-507f-4f0d-b1fe-4fdfbd7670d4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:45.235499 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6b691-4ddc-4c8b-9e05-12422b9b8761 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:45.262317 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db165ed6-5d5a-4407-86bf-5656903f75f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:45.263133 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db165ed6-5d5a-4407-86bf-5656903f75f4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:45.263422 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db165ed6-5d5a-4407-86bf-5656903f75f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:45.263698 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db165ed6-5d5a-4407-86bf-5656903f75f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:45.264800 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db165ed6-5d5a-4407-86bf-5656903f75f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:45.265112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db165ed6-5d5a-4407-86bf-5656903f75f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:45.266477 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db165ed6-5d5a-4407-86bf-5656903f75f4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:45.273239 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae598cf3-60fd-4222-adf9-32abb2b74173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:45.274096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae598cf3-60fd-4222-adf9-32abb2b74173 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:45.274391 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 396/808] 10.222.0.32 () {56 vars in 1103 bytes} [Thu Jun 2 13:23:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:45.274786 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae598cf3-60fd-4222-adf9-32abb2b74173 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:45.275222 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae598cf3-60fd-4222-adf9-32abb2b74173 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:45.275605 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502eaa5-ff0f-4578-9a26-dcc303aa76fd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:45.275888 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502eaa5-ff0f-4578-9a26-dcc303aa76fd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:45.276160 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502eaa5-ff0f-4578-9a26-dcc303aa76fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:45.294431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a502eaa5-ff0f-4578-9a26-dcc303aa76fd None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:45.295615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a502eaa5-ff0f-4578-9a26-dcc303aa76fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:45.313825 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:45.353912 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae598cf3-60fd-4222-adf9-32abb2b74173 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:45.355401 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae598cf3-60fd-4222-adf9-32abb2b74173 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:45.372378 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 397/809] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:23:45.372378 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502eaa5-ff0f-4578-9a26-dcc303aa76fd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:45.429486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:45.463991 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 413/810] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:23:45 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:23:45.464880 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae598cf3-60fd-4222-adf9-32abb2b74173 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:45.494402 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502eaa5-ff0f-4578-9a26-dcc303aa76fd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:45.534786 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:45.535286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f540b41-217c-4200-b401-84370890aebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:45.536099 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f540b41-217c-4200-b401-84370890aebf None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:45.536404 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f540b41-217c-4200-b401-84370890aebf None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:45.536690 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f540b41-217c-4200-b401-84370890aebf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:45.537325 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f540b41-217c-4200-b401-84370890aebf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:45.538698 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f540b41-217c-4200-b401-84370890aebf None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:45.551620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2f540b41-217c-4200-b401-84370890aebf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:23:45.551620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:45.551620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:23:45.551620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:23:45.551620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:23:45.551620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:23:45.551620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:23:45.551620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:23:45.551620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:23:45.551620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:45.551620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:23:45.551620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:45.551620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:45.551620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:45.551620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:45.551620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:45.552641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:45.552641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:45.552641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:45.552641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:45.552641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:45.552641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:45.552641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:45.552641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:23:45.552641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:23:45.552641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:23:45.552641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:23:45.552641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:45.552641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:45.552641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:45.552641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:45.552641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:45.553503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:45.553503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:45.553503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:45.553503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:45.553503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:45.553503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:45.553503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:45.553503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:45.553503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:45.553503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:45.553503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:45.553503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:23:45.553503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:23:45.553503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:23:45.553503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:45.553503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 398/811] 10.222.0.32 () {56 vars in 1129 bytes} [Thu Jun 2 13:23:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:45.554385 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f540b41-217c-4200-b401-84370890aebf None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:45.579956 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae598cf3-60fd-4222-adf9-32abb2b74173 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:45.615384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5665675-b110-46f8-994e-23bb1d5183f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:45.616185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5665675-b110-46f8-994e-23bb1d5183f0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:45.616513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5665675-b110-46f8-994e-23bb1d5183f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:45.616860 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5665675-b110-46f8-994e-23bb1d5183f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:45.627179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5665675-b110-46f8-994e-23bb1d5183f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:45.628698 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5665675-b110-46f8-994e-23bb1d5183f0 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:45.646208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-d5665675-b110-46f8-994e-23bb1d5183f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:45.646208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:45.646208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:45.646208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:45.646208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:45.646208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:45.646208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:45.646208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:45.646208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:45.646208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:45.646208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:45.646208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:45.646208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:45.646208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:45.646208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:45.647299 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:45.647299 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:45.647299 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:45.647299 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:45.647299 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:45.647299 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:45.647299 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:45.647299 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:45.647299 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:45.647299 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:45.647299 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:45.647299 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:45.647299 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:45.647299 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:45.647299 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:45.647299 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:45.647299 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:45.648237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:45.648237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:45.648237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:45.648237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:45.648237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 414/812] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:45.648237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5665675-b110-46f8-994e-23bb1d5183f0 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:45.671405 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f540b41-217c-4200-b401-84370890aebf None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:45.681208 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:45.710010 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4e775-d881-436c-98e1-52389615a4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:45.711071 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4e775-d881-436c-98e1-52389615a4ec None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:45.711354 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4e775-d881-436c-98e1-52389615a4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:45.712337 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4e775-d881-436c-98e1-52389615a4ec None admin] PATH_INFO: `/v3/services/network` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:45.712846 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4e775-d881-436c-98e1-52389615a4ec None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:45.714235 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4e775-d881-436c-98e1-52389615a4ec None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:45.725969 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-44b4e775-d881-436c-98e1-52389615a4ec None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:23:45.725969 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:45.725969 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:23:45.725969 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:23:45.725969 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:23:45.725969 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:23:45.725969 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:23:45.725969 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:23:45.725969 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:23:45.725969 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:45.725969 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:23:45.725969 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:45.725969 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:45.725969 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:45.725969 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:45.725969 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:45.725969 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:45.726962 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:45.726962 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:45.726962 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:45.726962 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:45.726962 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:45.726962 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:45.726962 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:23:45.726962 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:23:45.726962 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:23:45.726962 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:23:45.726962 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:45.726962 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:45.726962 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:45.726962 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:45.726962 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:45.726962 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:45.728431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:45.728431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:45.728431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:45.728431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:45.728431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:45.728431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:45.728431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:45.728431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:45.728431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:45.728431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:45.728431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:23:45.728431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:23:45.728431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:23:45.728431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:45.732611 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 399/813] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:45 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:45.733753 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4e775-d881-436c-98e1-52389615a4ec None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:45.755951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5665675-b110-46f8-994e-23bb1d5183f0 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:45.771666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:45.799978 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4aecae-8c17-4470-b7c0-de5ad313b192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:45.801655 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4aecae-8c17-4470-b7c0-de5ad313b192 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:45.802370 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4aecae-8c17-4470-b7c0-de5ad313b192 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:45.802822 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4aecae-8c17-4470-b7c0-de5ad313b192 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:45.815885 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4aecae-8c17-4470-b7c0-de5ad313b192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:45.817844 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4aecae-8c17-4470-b7c0-de5ad313b192 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:45.835144 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-ab4aecae-8c17-4470-b7c0-de5ad313b192 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:45.835144 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:45.835144 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:45.835144 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:45.835144 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:45.835144 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:45.835144 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:45.835144 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:45.835144 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:45.835144 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:45.835144 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:45.835144 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:45.835144 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:45.835144 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:45.835144 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:45.836250 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:45.836250 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:45.836250 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:45.836250 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:45.836250 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:45.836250 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:45.836250 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:45.836250 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:45.836250 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:45.836250 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:45.836250 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:45.836250 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:45.836250 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:45.836250 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:45.836250 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:45.836250 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:45.836250 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:45.837751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:45.837751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:45.837751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:45.837751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:45.837751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 415/814] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:45.838036 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4aecae-8c17-4470-b7c0-de5ad313b192 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:45.846042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4e775-d881-436c-98e1-52389615a4ec None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:45.881546 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebc690-8fd2-49df-9b83-bf1e1a001d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:45.882323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebc690-8fd2-49df-9b83-bf1e1a001d98 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:45.882710 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebc690-8fd2-49df-9b83-bf1e1a001d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:45.883078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebc690-8fd2-49df-9b83-bf1e1a001d98 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:45.883903 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebc690-8fd2-49df-9b83-bf1e1a001d98 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:45.884327 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebc690-8fd2-49df-9b83-bf1e1a001d98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:45.885809 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebc690-8fd2-49df-9b83-bf1e1a001d98 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:45.894785 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 400/815] 10.222.0.32 () {56 vars in 1124 bytes} [Thu Jun 2 13:23:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:45.894785 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebc690-8fd2-49df-9b83-bf1e1a001d98 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:45.928691 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:45.949735 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4aecae-8c17-4470-b7c0-de5ad313b192 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:45.987007 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d4b05-b95a-48b9-8497-537a3c13a044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:45.987668 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d4b05-b95a-48b9-8497-537a3c13a044 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:45.987953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d4b05-b95a-48b9-8497-537a3c13a044 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:45.988233 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d4b05-b95a-48b9-8497-537a3c13a044 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:45.988996 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d4b05-b95a-48b9-8497-537a3c13a044 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:45.989304 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d4b05-b95a-48b9-8497-537a3c13a044 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:45.990687 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d4b05-b95a-48b9-8497-537a3c13a044 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:46.001682 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebc690-8fd2-49df-9b83-bf1e1a001d98 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:46.006853 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 416/816] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:46.006853 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d4b05-b95a-48b9-8497-537a3c13a044 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:46.039821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:46.047020 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522317f-25cd-4674-ad2a-7f4a0a0cf968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:46.047718 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522317f-25cd-4674-ad2a-7f4a0a0cf968 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:46.048000 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522317f-25cd-4674-ad2a-7f4a0a0cf968 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:46.048282 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522317f-25cd-4674-ad2a-7f4a0a0cf968 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:46.049050 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522317f-25cd-4674-ad2a-7f4a0a0cf968 None admin] RBAC: Adding query filter params (name=network) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:46.049364 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522317f-25cd-4674-ad2a-7f4a0a0cf968 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:46.050797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522317f-25cd-4674-ad2a-7f4a0a0cf968 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:46.056161 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 401/817] 10.222.0.32 () {56 vars in 1112 bytes} [Thu Jun 2 13:23:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:46.061218 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522317f-25cd-4674-ad2a-7f4a0a0cf968 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:46.120808 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d4b05-b95a-48b9-8497-537a3c13a044 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:46.155894 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a24b81-bca3-43ee-a85c-20e744131a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:46.156585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a24b81-bca3-43ee-a85c-20e744131a06 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:46.156866 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a24b81-bca3-43ee-a85c-20e744131a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:46.157148 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a24b81-bca3-43ee-a85c-20e744131a06 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:46.157909 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a24b81-bca3-43ee-a85c-20e744131a06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:46.158218 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a24b81-bca3-43ee-a85c-20e744131a06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:46.159589 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a24b81-bca3-43ee-a85c-20e744131a06 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:46.166554 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:46.170219 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522317f-25cd-4674-ad2a-7f4a0a0cf968 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:46.173768 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 417/818] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:46.174608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a24b81-bca3-43ee-a85c-20e744131a06 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:46.212646 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11886cbb-ae70-4568-95de-88e43bd42aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:46.213313 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11886cbb-ae70-4568-95de-88e43bd42aaa None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:46.213594 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11886cbb-ae70-4568-95de-88e43bd42aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:46.213872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11886cbb-ae70-4568-95de-88e43bd42aaa None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:46.214569 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11886cbb-ae70-4568-95de-88e43bd42aaa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:46.214872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11886cbb-ae70-4568-95de-88e43bd42aaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:46.216249 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11886cbb-ae70-4568-95de-88e43bd42aaa None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:46.221406 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 402/819] 10.222.0.32 () {56 vars in 1124 bytes} [Thu Jun 2 13:23:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:46.222408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11886cbb-ae70-4568-95de-88e43bd42aaa None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:46.275570 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:46.291619 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a24b81-bca3-43ee-a85c-20e744131a06 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:46.328627 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153e05c-9b60-4db4-b137-c37fa15c6112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:46.329482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153e05c-9b60-4db4-b137-c37fa15c6112 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:46.329588 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11886cbb-ae70-4568-95de-88e43bd42aaa None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:46.329766 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153e05c-9b60-4db4-b137-c37fa15c6112 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:46.330039 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153e05c-9b60-4db4-b137-c37fa15c6112 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:46.338012 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153e05c-9b60-4db4-b137-c37fa15c6112 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:46.339576 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153e05c-9b60-4db4-b137-c37fa15c6112 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:46.355493 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-8153e05c-9b60-4db4-b137-c37fa15c6112 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:23:46.355493 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:46.355493 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:46.355493 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:46.355493 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:46.355493 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:46.355493 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:46.355493 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:46.355493 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:46.355493 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:46.355493 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:46.355493 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:46.355493 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:23:46.355493 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:23:46.355493 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:23:46.355493 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:23:46.356513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:46.356513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:46.356513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:23:46.356513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:46.356513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:23:46.356513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:46.356513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:46.356513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:46.356513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:46.356513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:46.356513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:46.356513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:46.356513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:46.356513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:46.356513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:46.356513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:46.356513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:46.356513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:46.357554 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:46.357554 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:46.357554 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:23:46.357554 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:23:46.357554 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:23:46.357554 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:23:46.357554 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:23:46.357554 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:23:46.357554 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:23:46.357554 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:46.357554 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 418/820] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Jun 2 13:23:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:46.357554 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153e05c-9b60-4db4-b137-c37fa15c6112 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:46.368495 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ae8fc-334b-4534-b1d3-a8b48088c50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:46.369161 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ae8fc-334b-4534-b1d3-a8b48088c50d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:46.369444 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ae8fc-334b-4534-b1d3-a8b48088c50d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:46.369721 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ae8fc-334b-4534-b1d3-a8b48088c50d None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:46.370440 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ae8fc-334b-4534-b1d3-a8b48088c50d None admin] RBAC: Adding query filter params (type=network) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:46.370738 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ae8fc-334b-4534-b1d3-a8b48088c50d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:46.372156 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ae8fc-334b-4534-b1d3-a8b48088c50d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:46.376827 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 403/821] 10.222.0.32 () {56 vars in 1112 bytes} [Thu Jun 2 13:23:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:46.377569 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ae8fc-334b-4534-b1d3-a8b48088c50d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:46.411143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:46.473839 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153e05c-9b60-4db4-b137-c37fa15c6112 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:46.485802 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ae8fc-334b-4534-b1d3-a8b48088c50d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:46.511052 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b3992-937b-45d8-b451-dc64e9ad730e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:46.511921 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b3992-937b-45d8-b451-dc64e9ad730e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:46.512335 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b3992-937b-45d8-b451-dc64e9ad730e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:46.512618 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b3992-937b-45d8-b451-dc64e9ad730e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:46.519665 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b3992-937b-45d8-b451-dc64e9ad730e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:46.520446 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a31a35-ec60-410d-8fe4-1b561470f869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:46.521101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a31a35-ec60-410d-8fe4-1b561470f869 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:46.521209 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b3992-937b-45d8-b451-dc64e9ad730e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:46.521414 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a31a35-ec60-410d-8fe4-1b561470f869 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:46.521673 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a31a35-ec60-410d-8fe4-1b561470f869 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:46.522393 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a31a35-ec60-410d-8fe4-1b561470f869 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:46.523757 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a31a35-ec60-410d-8fe4-1b561470f869 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:46.536398 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-d64b3992-937b-45d8-b451-dc64e9ad730e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:46.536398 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:46.536398 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:46.536398 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:46.536398 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:46.536398 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:46.536398 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:46.536398 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:46.536398 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:46.536398 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:46.536398 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:46.536398 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:46.536398 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:23:46.536398 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:23:46.536398 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:23:46.537553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:23:46.537553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:46.537553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:46.537553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:46.537553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:46.537553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:46.537553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:46.537553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:46.537553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:46.537553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:46.537553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:46.537553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:46.537553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:46.537553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:46.537553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:46.537553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:46.537553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:46.538444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:23:46.538444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:23:46.538444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:23:46.538444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:23:46.538444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:23:46.538444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:23:46.538444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:46.538444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:46.540827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 419/822] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:46.541760 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b3992-937b-45d8-b451-dc64e9ad730e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:46.547650 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 404/823] 10.222.0.32 () {60 vars in 1144 bytes} [Thu Jun 2 13:23:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:23:46.549034 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a31a35-ec60-410d-8fe4-1b561470f869 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:46.576778 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:46.669989 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:46.702829 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a31a35-ec60-410d-8fe4-1b561470f869 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:46.718142 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b3992-937b-45d8-b451-dc64e9ad730e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:46.755673 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abda46f-527f-44c7-a559-f0033f76e216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:46.756647 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abda46f-527f-44c7-a559-f0033f76e216 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:46.757186 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abda46f-527f-44c7-a559-f0033f76e216 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:46.757605 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abda46f-527f-44c7-a559-f0033f76e216 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:46.757726 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c2c45-0356-46ca-9ceb-6ea69362dba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:46.758482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c2c45-0356-46ca-9ceb-6ea69362dba8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:46.758796 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abda46f-527f-44c7-a559-f0033f76e216 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:46.758918 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c2c45-0356-46ca-9ceb-6ea69362dba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:46.759299 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c2c45-0356-46ca-9ceb-6ea69362dba8 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:46.760315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c2c45-0356-46ca-9ceb-6ea69362dba8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:46.760758 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abda46f-527f-44c7-a559-f0033f76e216 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:46.760870 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c2c45-0356-46ca-9ceb-6ea69362dba8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:46.762475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c2c45-0356-46ca-9ceb-6ea69362dba8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:46.785355 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 420/824] 10.222.0.32 () {56 vars in 1149 bytes} [Thu Jun 2 13:23:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:46.788671 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c2c45-0356-46ca-9ceb-6ea69362dba8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:46.791213 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 405/825] 10.222.0.32 () {60 vars in 1144 bytes} [Thu Jun 2 13:23:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:23:46.796375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abda46f-527f-44c7-a559-f0033f76e216 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:46.867393 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:46.921700 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c2c45-0356-46ca-9ceb-6ea69362dba8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:46.947706 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abda46f-527f-44c7-a559-f0033f76e216 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:46.959525 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3a019-888a-40ad-9718-c3a71585195e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:46.960184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3a019-888a-40ad-9718-c3a71585195e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:46.960828 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3a019-888a-40ad-9718-c3a71585195e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:46.961096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3a019-888a-40ad-9718-c3a71585195e None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:46.962506 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3a019-888a-40ad-9718-c3a71585195e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:46.962819 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3a019-888a-40ad-9718-c3a71585195e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:46.964259 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3a019-888a-40ad-9718-c3a71585195e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:46.978089 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 421/826] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:23:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:46.984053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3a019-888a-40ad-9718-c3a71585195e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:46.984551 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:46.993615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c9987-1921-4bdf-a8ac-63a37887536e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:46.995227 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c9987-1921-4bdf-a8ac-63a37887536e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:46.995660 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c9987-1921-4bdf-a8ac-63a37887536e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:46.996115 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c9987-1921-4bdf-a8ac-63a37887536e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:47.017773 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c9987-1921-4bdf-a8ac-63a37887536e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:47.019257 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c9987-1921-4bdf-a8ac-63a37887536e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:47.043186 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-743c9987-1921-4bdf-a8ac-63a37887536e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:47.043186 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:47.043186 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:47.043186 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:47.043186 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:47.043186 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:47.043186 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:47.043186 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:47.043186 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:47.043186 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:47.043186 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:47.043186 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:47.043186 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:47.043186 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:47.043186 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:47.044173 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:47.044173 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:47.044173 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:47.044173 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:47.044173 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:47.044173 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:47.044173 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:47.044173 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:47.044173 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:47.044173 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:47.044173 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:47.044173 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:47.044173 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:47.044173 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:47.044173 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:47.044173 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:47.044173 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:47.045125 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:47.045125 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:47.045125 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:47.045125 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:47.048384 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 406/827] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:23:47.050834 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c9987-1921-4bdf-a8ac-63a37887536e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:47.112605 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3a019-888a-40ad-9718-c3a71585195e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:47.147458 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:47.162265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068eecb-de2e-4269-b85c-dd3d2e8a9143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:47.163281 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068eecb-de2e-4269-b85c-dd3d2e8a9143 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:47.163759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068eecb-de2e-4269-b85c-dd3d2e8a9143 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:47.164242 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068eecb-de2e-4269-b85c-dd3d2e8a9143 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:47.165592 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068eecb-de2e-4269-b85c-dd3d2e8a9143 None admin] RBAC: Adding query filter params (role.id=128feb04d1e042ac844f9ad70b89bb02, scope.project.id=a9007447059e4862972078c032a5d67b, user.id=b2e5d9f3c4e04ca3bf52b28b67d2a4d6) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:47.166103 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068eecb-de2e-4269-b85c-dd3d2e8a9143 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:47.167747 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068eecb-de2e-4269-b85c-dd3d2e8a9143 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:47.181332 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 422/828] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:23:46 2022] GET /identity/v3/role_assignments?user.id=b2e5d9f3c4e04ca3bf52b28b67d2a4d6&scope.project.id=a9007447059e4862972078c032a5d67b&role.id=128feb04d1e042ac844f9ad70b89bb02 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:47.188344 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c9987-1921-4bdf-a8ac-63a37887536e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:47.221235 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15923b3a-18b3-410f-ae71-22c4c3c25399 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:47.221546 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15923b3a-18b3-410f-ae71-22c4c3c25399 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:47.221799 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15923b3a-18b3-410f-ae71-22c4c3c25399 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:47.223453 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 423/829] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:23:47.224181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda989e-53dd-4ecb-9a11-9221a5bb2ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:47.224881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda989e-53dd-4ecb-9a11-9221a5bb2ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:47.225167 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda989e-53dd-4ecb-9a11-9221a5bb2ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:47.225450 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda989e-53dd-4ecb-9a11-9221a5bb2ec0 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:47.226238 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda989e-53dd-4ecb-9a11-9221a5bb2ec0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:47.226551 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda989e-53dd-4ecb-9a11-9221a5bb2ec0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:47.228573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda989e-53dd-4ecb-9a11-9221a5bb2ec0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:47.229719 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3aa7cd-ef0e-423e-8117-894869ff284a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:47.230017 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3aa7cd-ef0e-423e-8117-894869ff284a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:47.230301 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3aa7cd-ef0e-423e-8117-894869ff284a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:47.243019 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 407/830] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:47.249732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-4d3aa7cd-ef0e-423e-8117-894869ff284a None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:47.249925 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda989e-53dd-4ecb-9a11-9221a5bb2ec0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:47.250982 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4d3aa7cd-ef0e-423e-8117-894869ff284a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:47.325093 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:47.359493 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 424/831] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:23:47.384913 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3aa7cd-ef0e-423e-8117-894869ff284a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:47.407729 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda989e-53dd-4ecb-9a11-9221a5bb2ec0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:47.451225 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac158422-5a72-40a1-bfab-506a4bb3e076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:47.452259 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac158422-5a72-40a1-bfab-506a4bb3e076 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:47.452978 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac158422-5a72-40a1-bfab-506a4bb3e076 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:47.453411 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac158422-5a72-40a1-bfab-506a4bb3e076 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:47.463044 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac158422-5a72-40a1-bfab-506a4bb3e076 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:47.464753 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac158422-5a72-40a1-bfab-506a4bb3e076 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:47.478853 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ac158422-5a72-40a1-bfab-506a4bb3e076 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:47.478853 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:47.478853 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:47.478853 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:47.478853 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:47.478853 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:47.478853 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:47.478853 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:47.478853 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:47.478853 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:47.478853 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:47.478853 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:47.478853 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:23:47.478853 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:23:47.478853 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:23:47.479880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:23:47.479880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:47.479880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:47.479880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:47.479880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:47.479880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:47.479880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:47.479880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:47.479880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:47.479880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:47.479880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:47.479880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:47.479880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:47.479880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:47.479880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:47.479880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:47.479880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:47.480817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:23:47.480817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:23:47.480817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:23:47.480817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:23:47.480817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:23:47.480817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:23:47.480817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:47.480817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:47.482215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 408/832] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:47.487359 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac158422-5a72-40a1-bfab-506a4bb3e076 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:47.510642 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3aa7cd-ef0e-423e-8117-894869ff284a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:47.535995 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:47.562667 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efa798-330d-4419-b5ce-c1d54c629598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:47.564037 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efa798-330d-4419-b5ce-c1d54c629598 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:47.564549 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efa798-330d-4419-b5ce-c1d54c629598 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:47.565021 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efa798-330d-4419-b5ce-c1d54c629598 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:47.579013 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04efa798-330d-4419-b5ce-c1d54c629598 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:47.590179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-04efa798-330d-4419-b5ce-c1d54c629598 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:23:47.590179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:47.590179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:47.590179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:47.590179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:47.590179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:47.590179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:47.590179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:47.590179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:47.590179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:47.590179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:47.590179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:47.590179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:47.590179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:47.590179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:47.590179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:47.591157 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:47.591157 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:47.591157 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:47.591157 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:47.591157 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:47.591157 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:47.591157 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:47.591157 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:47.591157 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:47.591157 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:47.591157 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:47.591157 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:47.591157 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:47.591157 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:47.591157 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:47.591157 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:47.592003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:47.592003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:47.592003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:47.592003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:47.592003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:47.592003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:47.592003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:47.592003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:47.592003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:47.592003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:47.592003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:23:47.592003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:47.593875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 425/833] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:23:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:23:47.602827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efa798-330d-4419-b5ce-c1d54c629598 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:47.614996 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac158422-5a72-40a1-bfab-506a4bb3e076 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:47.616741 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:47.657055 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1777c47-f4ff-4926-a2e2-a0b68332c338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:47.657749 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1777c47-f4ff-4926-a2e2-a0b68332c338 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:47.658341 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1777c47-f4ff-4926-a2e2-a0b68332c338 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:47.658622 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1777c47-f4ff-4926-a2e2-a0b68332c338 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:47.659778 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1777c47-f4ff-4926-a2e2-a0b68332c338 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:47.660104 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1777c47-f4ff-4926-a2e2-a0b68332c338 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:47.662152 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1777c47-f4ff-4926-a2e2-a0b68332c338 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:47.678828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 409/834] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:23:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:47.685560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1777c47-f4ff-4926-a2e2-a0b68332c338 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:47.724579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efa798-330d-4419-b5ce-c1d54c629598 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:47.760825 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6481eac-41a8-460d-be11-47402bf16ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:47.761708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6481eac-41a8-460d-be11-47402bf16ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:47.762069 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6481eac-41a8-460d-be11-47402bf16ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:47.762420 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6481eac-41a8-460d-be11-47402bf16ea4 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:47.763266 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6481eac-41a8-460d-be11-47402bf16ea4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:47.763649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6481eac-41a8-460d-be11-47402bf16ea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:47.765302 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6481eac-41a8-460d-be11-47402bf16ea4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:47.779253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 426/835] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:23:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:47.780362 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6481eac-41a8-460d-be11-47402bf16ea4 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:47.821195 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1777c47-f4ff-4926-a2e2-a0b68332c338 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:47.827738 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:47.874644 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5d4c0-a54b-4ac6-a9ec-3678d980f083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:47.875534 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5d4c0-a54b-4ac6-a9ec-3678d980f083 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:47.875817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5d4c0-a54b-4ac6-a9ec-3678d980f083 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:47.876091 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5d4c0-a54b-4ac6-a9ec-3678d980f083 None admin] PATH_INFO: `/v3/projects/a9007447059e4862972078c032a5d67b/users/bbcd5ba866b84d099d183fe19ba61a4f/roles/a12865c9fb9e4fa0b61e4adfd53188fb` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:47.891436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5d4c0-a54b-4ac6-a9ec-3678d980f083 None admin] RBAC: Authorizing `identity:create_grant(project_id=a9007447059e4862972078c032a5d67b, user_id=bbcd5ba866b84d099d183fe19ba61a4f, role_id=a12865c9fb9e4fa0b61e4adfd53188fb)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:47.892735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5d4c0-a54b-4ac6-a9ec-3678d980f083 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:47.898753 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6481eac-41a8-460d-be11-47402bf16ea4 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:47.907772 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 410/836] 10.222.0.32 () {58 vars in 1439 bytes} [Thu Jun 2 13:23:47 2022] PUT /identity/v3/projects/a9007447059e4862972078c032a5d67b/users/bbcd5ba866b84d099d183fe19ba61a4f/roles/a12865c9fb9e4fa0b61e4adfd53188fb => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:23:47.938802 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0001935-6e84-47b0-a3c3-a7a06a139672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:47.939794 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0001935-6e84-47b0-a3c3-a7a06a139672 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:47.940190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0001935-6e84-47b0-a3c3-a7a06a139672 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:47.940585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0001935-6e84-47b0-a3c3-a7a06a139672 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:47.953701 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0001935-6e84-47b0-a3c3-a7a06a139672 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:47.955176 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0001935-6e84-47b0-a3c3-a7a06a139672 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:47.975586 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-c0001935-6e84-47b0-a3c3-a7a06a139672 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:47.975586 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:47.975586 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:47.975586 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:47.975586 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:47.975586 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:47.975586 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:47.975586 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:47.975586 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:47.975586 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:47.975586 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:47.975586 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:47.975586 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:47.975586 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:47.975586 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:47.976574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:47.976574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:47.976574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:47.976574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:47.976574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:47.976574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:47.976574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:47.976574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:47.976574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:47.976574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:47.976574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:47.976574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:47.976574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:47.976574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:47.976574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:47.976574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:47.976574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:47.978098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:47.978098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:47.978098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:47.978098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:47.978098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 427/837] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:47.984516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5d4c0-a54b-4ac6-a9ec-3678d980f083 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:48.003613 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:48.107191 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5d4c0-a54b-4ac6-a9ec-3678d980f083 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:48.145680 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92318d0-66f4-4a78-ba48-86b1bb6d2d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:48.146745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92318d0-66f4-4a78-ba48-86b1bb6d2d5c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:48.147173 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92318d0-66f4-4a78-ba48-86b1bb6d2d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:48.147605 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92318d0-66f4-4a78-ba48-86b1bb6d2d5c None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:48.148513 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92318d0-66f4-4a78-ba48-86b1bb6d2d5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:48.148971 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92318d0-66f4-4a78-ba48-86b1bb6d2d5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:48.151057 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92318d0-66f4-4a78-ba48-86b1bb6d2d5c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:48.163623 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 411/838] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:48.169879 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0001935-6e84-47b0-a3c3-a7a06a139672 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:48.266846 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:48.277703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0001935-6e84-47b0-a3c3-a7a06a139672 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:48.312180 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268adf1-b366-4db6-bbfd-00e910ae29e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:48.312997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268adf1-b366-4db6-bbfd-00e910ae29e3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:48.313275 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268adf1-b366-4db6-bbfd-00e910ae29e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:48.313553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268adf1-b366-4db6-bbfd-00e910ae29e3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:48.322675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268adf1-b366-4db6-bbfd-00e910ae29e3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:48.324166 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268adf1-b366-4db6-bbfd-00e910ae29e3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:48.339265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-8268adf1-b366-4db6-bbfd-00e910ae29e3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:23:48.339265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:48.339265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:48.339265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:48.339265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:48.339265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:48.339265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:48.339265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:48.339265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:48.339265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:48.339265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:48.339265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:48.339265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:23:48.339265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:23:48.339265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:23:48.339265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:23:48.340215 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:48.340215 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:48.340215 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:23:48.340215 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:48.340215 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:23:48.340215 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:48.340215 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:48.340215 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:48.340215 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:48.340215 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:48.340215 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:48.340215 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:48.340215 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:48.340215 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:48.340215 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:48.340215 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:48.340215 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:48.340215 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:48.341198 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:48.341198 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:48.341198 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:23:48.341198 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:23:48.341198 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:23:48.341198 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:23:48.341198 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:23:48.341198 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:23:48.341198 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:23:48.341198 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:48.341198 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 428/839] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:23:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:48.347932 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92318d0-66f4-4a78-ba48-86b1bb6d2d5c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:48.426317 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:48.454495 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92318d0-66f4-4a78-ba48-86b1bb6d2d5c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:48.491556 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b32a9b-5f42-4011-b58f-dd226bc1d057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:48.492629 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b32a9b-5f42-4011-b58f-dd226bc1d057 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:48.493148 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b32a9b-5f42-4011-b58f-dd226bc1d057 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:48.493630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b32a9b-5f42-4011-b58f-dd226bc1d057 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:48.494710 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b32a9b-5f42-4011-b58f-dd226bc1d057 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:48.495238 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b32a9b-5f42-4011-b58f-dd226bc1d057 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:48.496904 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b32a9b-5f42-4011-b58f-dd226bc1d057 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:48.520755 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 412/840] 10.222.0.32 () {56 vars in 1135 bytes} [Thu Jun 2 13:23:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:48.522540 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268adf1-b366-4db6-bbfd-00e910ae29e3 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:48.635883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268adf1-b366-4db6-bbfd-00e910ae29e3 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:48.670448 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce405d-3b88-448b-8e0d-4d1003d3414d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:48.671105 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce405d-3b88-448b-8e0d-4d1003d3414d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:48.671387 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce405d-3b88-448b-8e0d-4d1003d3414d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:48.671660 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce405d-3b88-448b-8e0d-4d1003d3414d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:48.697764 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:48.742528 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce405d-3b88-448b-8e0d-4d1003d3414d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:48.744542 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce405d-3b88-448b-8e0d-4d1003d3414d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:48.846985 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 429/841] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:23:48 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:23:48.852706 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b32a9b-5f42-4011-b58f-dd226bc1d057 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:48.966436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b32a9b-5f42-4011-b58f-dd226bc1d057 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:48.998530 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:49.004442 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30955850-3552-4551-b06d-78e2025f7142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:49.005520 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30955850-3552-4551-b06d-78e2025f7142 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:49.006013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30955850-3552-4551-b06d-78e2025f7142 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:49.006494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30955850-3552-4551-b06d-78e2025f7142 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:49.017988 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30955850-3552-4551-b06d-78e2025f7142 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:49.019468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30955850-3552-4551-b06d-78e2025f7142 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:49.038277 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-30955850-3552-4551-b06d-78e2025f7142 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:49.038277 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:49.038277 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:49.038277 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:49.038277 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:49.038277 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:49.038277 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:49.038277 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:49.038277 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:49.038277 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:49.038277 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:49.038277 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:49.038277 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:49.038277 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:49.038277 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:49.039185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:49.039185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:49.039185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:49.039185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:49.039185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:49.039185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:49.039185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:49.039185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:49.039185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:49.039185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:49.039185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:49.039185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:49.039185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:49.039185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:49.039185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:49.039185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:49.039185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:49.040630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:49.040630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:49.040630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:49.040630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:49.044287 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 413/842] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:49.045948 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce405d-3b88-448b-8e0d-4d1003d3414d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:49.110247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:49.159565 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce405d-3b88-448b-8e0d-4d1003d3414d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:49.195571 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf8430-0ca3-4115-a860-d49f78333fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:49.196270 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf8430-0ca3-4115-a860-d49f78333fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:49.196558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf8430-0ca3-4115-a860-d49f78333fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:49.196838 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf8430-0ca3-4115-a860-d49f78333fa2 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:49.197568 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf8430-0ca3-4115-a860-d49f78333fa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:49.197877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf8430-0ca3-4115-a860-d49f78333fa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:49.199248 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf8430-0ca3-4115-a860-d49f78333fa2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:49.212010 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 430/843] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:49.217669 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30955850-3552-4551-b06d-78e2025f7142 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:49.283739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf2f40-5955-4ae7-a459-ca9e9006cc21 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:49.283937 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf2f40-5955-4ae7-a459-ca9e9006cc21 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:49.284204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf2f40-5955-4ae7-a459-ca9e9006cc21 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:49.285794 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 431/844] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:23:49.291092 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63de3e-c5b6-45d3-b8ce-6390c7b18d0b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:49.291385 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63de3e-c5b6-45d3-b8ce-6390c7b18d0b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:49.291668 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63de3e-c5b6-45d3-b8ce-6390c7b18d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:49.308980 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-df63de3e-c5b6-45d3-b8ce-6390c7b18d0b None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:49.310339 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-df63de3e-c5b6-45d3-b8ce-6390c7b18d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:49.329810 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30955850-3552-4551-b06d-78e2025f7142 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:49.379718 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52440bfd-ff5a-4f80-8d40-cd0da8e75534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:49.380923 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52440bfd-ff5a-4f80-8d40-cd0da8e75534 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:49.381420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52440bfd-ff5a-4f80-8d40-cd0da8e75534 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:49.381904 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52440bfd-ff5a-4f80-8d40-cd0da8e75534 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:49.384368 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 432/845] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:23:49.395287 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52440bfd-ff5a-4f80-8d40-cd0da8e75534 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:49.397056 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52440bfd-ff5a-4f80-8d40-cd0da8e75534 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:49.403071 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63de3e-c5b6-45d3-b8ce-6390c7b18d0b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:49.415802 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-52440bfd-ff5a-4f80-8d40-cd0da8e75534 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:49.415802 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:49.415802 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:49.415802 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:49.415802 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:49.415802 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:49.415802 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:49.415802 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:49.415802 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:49.415802 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:49.415802 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:49.415802 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:49.415802 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:23:49.415802 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:23:49.415802 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:23:49.416929 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:23:49.416929 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:49.416929 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:49.416929 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:49.416929 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:49.416929 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:49.416929 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:49.416929 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:49.416929 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:49.416929 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:49.416929 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:49.416929 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:49.416929 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:49.416929 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:49.416929 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:49.416929 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:49.416929 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:49.417828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:23:49.417828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:23:49.417828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:23:49.417828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:23:49.417828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:23:49.417828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:23:49.417828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:49.417828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:49.420193 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 414/846] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:49.425757 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52440bfd-ff5a-4f80-8d40-cd0da8e75534 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:49.465065 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:49.479945 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:49.536876 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63de3e-c5b6-45d3-b8ce-6390c7b18d0b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:49.543466 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52440bfd-ff5a-4f80-8d40-cd0da8e75534 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:49.580392 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3cbb44-c121-440c-a0d5-590c522eb481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:49.581061 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cbb44-c121-440c-a0d5-590c522eb481 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:49.581347 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cbb44-c121-440c-a0d5-590c522eb481 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:49.581629 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cbb44-c121-440c-a0d5-590c522eb481 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:49.581938 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c40347-29dd-48b1-895a-67c72063c008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:49.582417 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3cbb44-c121-440c-a0d5-590c522eb481 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:49.582728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3cbb44-c121-440c-a0d5-590c522eb481 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:49.582823 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c40347-29dd-48b1-895a-67c72063c008 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:49.583011 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c40347-29dd-48b1-895a-67c72063c008 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:49.583287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c40347-29dd-48b1-895a-67c72063c008 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:49.583950 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c40347-29dd-48b1-895a-67c72063c008 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:49.584184 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3cbb44-c121-440c-a0d5-590c522eb481 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:49.585613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c40347-29dd-48b1-895a-67c72063c008 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:49.605898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-34c40347-29dd-48b1-895a-67c72063c008 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:23:49.605898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:49.605898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:23:49.605898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:23:49.605898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:23:49.605898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:23:49.605898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:23:49.605898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:23:49.605898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:23:49.605898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:49.605898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:23:49.605898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:49.605898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:49.605898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:49.605898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:49.605898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:49.605898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:49.606928 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:49.606928 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:49.606928 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:49.606928 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:49.606928 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:49.606928 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:49.606928 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:23:49.606928 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:23:49.606928 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:23:49.606928 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:23:49.606928 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:49.606928 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:49.606928 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:49.606928 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:49.606928 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:49.606928 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:49.607776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:49.607776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:49.607776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:49.607776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:49.607776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:49.607776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:49.607776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:49.607776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:49.607776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:49.607776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:49.607776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:23:49.607776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:23:49.607776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:23:49.607776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:49.608537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 415/847] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:23:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:49.608537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbe920-09a6-4365-bfb6-72481b988eae None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:49.608537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbe920-09a6-4365-bfb6-72481b988eae None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:49.608537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbe920-09a6-4365-bfb6-72481b988eae None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:49.608537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 416/848] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:49.608848 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 433/849] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Jun 2 13:23:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:23:49.608918 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbe920-09a6-4365-bfb6-72481b988eae None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:49.608997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c7291-36bd-4b0d-891a-a49f0764b24d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:49.608997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c7291-36bd-4b0d-891a-a49f0764b24d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:49.608997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c7291-36bd-4b0d-891a-a49f0764b24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:49.626704 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6a8c7291-36bd-4b0d-891a-a49f0764b24d None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:49.627880 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6a8c7291-36bd-4b0d-891a-a49f0764b24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:49.704235 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 434/850] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:23:49.705087 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c7291-36bd-4b0d-891a-a49f0764b24d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:49.726608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbe920-09a6-4365-bfb6-72481b988eae None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:49.730615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:49.741272 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:49.768768 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91d8c2-4c5f-4c05-a2c1-b9d4df6ca52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:49.769610 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91d8c2-4c5f-4c05-a2c1-b9d4df6ca52f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:49.769741 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91d8c2-4c5f-4c05-a2c1-b9d4df6ca52f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:49.769964 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91d8c2-4c5f-4c05-a2c1-b9d4df6ca52f None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:49.770675 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91d8c2-4c5f-4c05-a2c1-b9d4df6ca52f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:49.770986 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91d8c2-4c5f-4c05-a2c1-b9d4df6ca52f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:49.772397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91d8c2-4c5f-4c05-a2c1-b9d4df6ca52f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:49.782185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 417/851] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Jun 2 13:23:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:49.782185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91d8c2-4c5f-4c05-a2c1-b9d4df6ca52f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:49.814870 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c7291-36bd-4b0d-891a-a49f0764b24d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:49.853471 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53346369-25ee-45e5-ae64-d474423bb24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:49.854516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53346369-25ee-45e5-ae64-d474423bb24d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:49.855027 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53346369-25ee-45e5-ae64-d474423bb24d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:49.855503 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53346369-25ee-45e5-ae64-d474423bb24d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:49.856382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53346369-25ee-45e5-ae64-d474423bb24d None admin] RBAC: Adding query filter params (role.id=128feb04d1e042ac844f9ad70b89bb02, scope.project.id=a9007447059e4862972078c032a5d67b, user.id=3aea97e7b39448a283032f662142b6e0) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:49.856702 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53346369-25ee-45e5-ae64-d474423bb24d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:49.858228 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53346369-25ee-45e5-ae64-d474423bb24d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:49.864735 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 435/852] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:23:49 2022] GET /identity/v3/role_assignments?user.id=3aea97e7b39448a283032f662142b6e0&scope.project.id=a9007447059e4862972078c032a5d67b&role.id=128feb04d1e042ac844f9ad70b89bb02 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:49.864735 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53346369-25ee-45e5-ae64-d474423bb24d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:49.900142 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91d8c2-4c5f-4c05-a2c1-b9d4df6ca52f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:49.949279 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf77ec-0788-4a39-8d05-6f59348a99ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:49.950615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf77ec-0788-4a39-8d05-6f59348a99ae None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:49.951177 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf77ec-0788-4a39-8d05-6f59348a99ae None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:49.951460 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf77ec-0788-4a39-8d05-6f59348a99ae None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:49.952141 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf77ec-0788-4a39-8d05-6f59348a99ae None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:49.953905 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf77ec-0788-4a39-8d05-6f59348a99ae None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:49.975828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-6cdf77ec-0788-4a39-8d05-6f59348a99ae None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:23:49.975828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:49.975828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:23:49.975828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:23:49.975828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:23:49.975828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:23:49.975828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:23:49.975828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:23:49.975828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:23:49.975828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:49.975828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:23:49.975828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:49.975828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:49.975828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:49.975828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:49.975828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:49.976857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:49.976857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:49.976857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:49.976857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:49.976857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:49.976857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:49.976857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:49.976857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:23:49.976857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:23:49.976857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:23:49.976857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:23:49.976857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:49.976857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:49.976857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:49.976857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:49.976857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:49.977745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:49.977745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:49.977745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:49.977745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:49.977745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:49.977745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:49.977745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:49.977745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:49.977745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:49.977745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:49.977745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:49.977745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:23:49.977745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:23:49.977745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:23:49.977745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:49.978538 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 418/853] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Jun 2 13:23:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:49.985574 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf77ec-0788-4a39-8d05-6f59348a99ae None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:49.995745 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:49.999461 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53346369-25ee-45e5-ae64-d474423bb24d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:50.021449 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:50.042789 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eebf57-541a-4137-9f76-2d61a9a675ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:50.043505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eebf57-541a-4137-9f76-2d61a9a675ca None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:50.043794 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eebf57-541a-4137-9f76-2d61a9a675ca None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:50.044079 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eebf57-541a-4137-9f76-2d61a9a675ca None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:50.044999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eebf57-541a-4137-9f76-2d61a9a675ca None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:50.045340 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eebf57-541a-4137-9f76-2d61a9a675ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:50.046923 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eebf57-541a-4137-9f76-2d61a9a675ca None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:50.060330 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 436/854] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Jun 2 13:23:49 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:50.115081 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf77ec-0788-4a39-8d05-6f59348a99ae None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:50.157956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b4f03-145a-4947-b7b6-f94352408101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:50.158651 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b4f03-145a-4947-b7b6-f94352408101 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:50.158937 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b4f03-145a-4947-b7b6-f94352408101 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:50.159218 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b4f03-145a-4947-b7b6-f94352408101 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:50.159968 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b4f03-145a-4947-b7b6-f94352408101 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:50.160262 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b4f03-145a-4947-b7b6-f94352408101 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:50.161788 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b4f03-145a-4947-b7b6-f94352408101 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:50.169355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 419/855] 10.222.0.32 () {56 vars in 1126 bytes} [Thu Jun 2 13:23:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:50.174569 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eebf57-541a-4137-9f76-2d61a9a675ca None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:50.234094 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3755de-0107-46f2-9409-c84752c16390 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:50.234381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3755de-0107-46f2-9409-c84752c16390 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:50.234570 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3755de-0107-46f2-9409-c84752c16390 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:50.237423 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 420/856] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:23:50.241962 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99981376-c65c-4779-a890-ce5d816e887e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:50.242271 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99981376-c65c-4779-a890-ce5d816e887e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:50.242526 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99981376-c65c-4779-a890-ce5d816e887e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:50.261289 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-99981376-c65c-4779-a890-ce5d816e887e None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:50.262604 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-99981376-c65c-4779-a890-ce5d816e887e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:50.297837 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eebf57-541a-4137-9f76-2d61a9a675ca None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:50.338059 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c495fc6-9f50-42e5-b021-487b66d13d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:50.338726 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c495fc6-9f50-42e5-b021-487b66d13d56 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:50.339008 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c495fc6-9f50-42e5-b021-487b66d13d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:50.339275 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c495fc6-9f50-42e5-b021-487b66d13d56 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:50.339997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c495fc6-9f50-42e5-b021-487b66d13d56 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:50.340330 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c495fc6-9f50-42e5-b021-487b66d13d56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:50.341692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c495fc6-9f50-42e5-b021-487b66d13d56 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:50.346824 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 437/857] 10.222.0.32 () {56 vars in 1126 bytes} [Thu Jun 2 13:23:50 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:50.350550 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 421/858] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:23:50.374214 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c495fc6-9f50-42e5-b021-487b66d13d56 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:50.413312 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:50.507034 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c495fc6-9f50-42e5-b021-487b66d13d56 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:50.546338 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1248f-dd03-4b51-9692-3b4846827e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:50.547211 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1248f-dd03-4b51-9692-3b4846827e03 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:50.547519 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1248f-dd03-4b51-9692-3b4846827e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:50.547776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1248f-dd03-4b51-9692-3b4846827e03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:50.560185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1248f-dd03-4b51-9692-3b4846827e03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:50.568045 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-61b1248f-dd03-4b51-9692-3b4846827e03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:50.568045 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:50.568045 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:50.568045 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:50.568045 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:50.568045 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:50.568045 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:50.568045 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:50.568045 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:50.568045 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:50.568045 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:50.568045 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:50.568045 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:50.568045 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:50.568045 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:50.568045 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:50.569039 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:50.569039 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:50.569039 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:50.569039 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:50.569039 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:50.569039 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:50.569039 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:50.569039 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:50.569039 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:50.569039 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:50.569039 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:50.569039 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:50.569039 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:50.569039 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:50.569039 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:50.569039 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:50.569901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:50.569901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:50.569901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:50.569901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:50.569901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:50.569901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:50.569901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:50.569901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:50.569901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:50.569901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:50.569901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:23:50.569901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:50.569901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 438/859] 10.222.0.32 () {56 vars in 1102 bytes} [Thu Jun 2 13:23:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:50.575517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99981376-c65c-4779-a890-ce5d816e887e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:50.605655 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:50.685657 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99981376-c65c-4779-a890-ce5d816e887e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:50.722224 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa839b7-8913-4459-9457-d9da1e351926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:50.722897 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa839b7-8913-4459-9457-d9da1e351926 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:50.723180 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa839b7-8913-4459-9457-d9da1e351926 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:50.723459 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa839b7-8913-4459-9457-d9da1e351926 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:50.724213 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa839b7-8913-4459-9457-d9da1e351926 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:50.724555 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa839b7-8913-4459-9457-d9da1e351926 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:50.725940 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa839b7-8913-4459-9457-d9da1e351926 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:50.735401 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 422/860] 10.222.0.32 () {56 vars in 1103 bytes} [Thu Jun 2 13:23:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:50.740939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1248f-dd03-4b51-9692-3b4846827e03 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:50.835581 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:50.849648 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1248f-dd03-4b51-9692-3b4846827e03 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:50.885951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd05691-f47b-42d1-962f-ed76368a079a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:50.886745 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd05691-f47b-42d1-962f-ed76368a079a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:50.887026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd05691-f47b-42d1-962f-ed76368a079a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:50.887301 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd05691-f47b-42d1-962f-ed76368a079a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:50.898920 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd05691-f47b-42d1-962f-ed76368a079a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:50.900949 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd05691-f47b-42d1-962f-ed76368a079a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:50.918408 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-0dd05691-f47b-42d1-962f-ed76368a079a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:50.918408 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:50.918408 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:50.918408 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:50.918408 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:50.918408 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:50.918408 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:50.918408 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:50.918408 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:50.918408 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:50.918408 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:50.918408 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:50.918408 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:50.918408 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:50.918408 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:50.920490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:50.920490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:50.920490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:50.920490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:50.920490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:50.920490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:50.920490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:50.920490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:50.920490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:50.920490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:50.920490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:50.920490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:50.920490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:50.920490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:50.920490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:50.920490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:50.920490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:50.922605 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:50.922605 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:50.922605 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:50.922605 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:50.928134 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 439/861] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:50.929385 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa839b7-8913-4459-9457-d9da1e351926 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:51.027388 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:51.040420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa839b7-8913-4459-9457-d9da1e351926 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:51.074978 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bb021-1233-49a4-9869-c55cd25f13e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:51.075645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bb021-1233-49a4-9869-c55cd25f13e3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:51.075932 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bb021-1233-49a4-9869-c55cd25f13e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:51.076211 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bb021-1233-49a4-9869-c55cd25f13e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:51.076964 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3bb021-1233-49a4-9869-c55cd25f13e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:51.077273 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3bb021-1233-49a4-9869-c55cd25f13e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:51.078659 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3bb021-1233-49a4-9869-c55cd25f13e3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:51.092018 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 423/862] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:51.097462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd05691-f47b-42d1-962f-ed76368a079a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:51.202380 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd05691-f47b-42d1-962f-ed76368a079a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:51.237792 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5ee33-55a8-4f41-8238-237e75436ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:51.239029 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5ee33-55a8-4f41-8238-237e75436ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:51.239658 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5ee33-55a8-4f41-8238-237e75436ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:51.240143 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5ee33-55a8-4f41-8238-237e75436ff9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:51.249388 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5ee33-55a8-4f41-8238-237e75436ff9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:51.251253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5ee33-55a8-4f41-8238-237e75436ff9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:51.254297 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:51.268070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-c7f5ee33-55a8-4f41-8238-237e75436ff9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:23:51.268070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:51.268070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:51.268070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:51.268070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:51.268070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:51.268070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:51.268070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:51.268070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:51.268070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:51.268070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:51.268070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:51.268070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:23:51.268070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:23:51.268070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:23:51.268070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:23:51.269063 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:51.269063 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:51.269063 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:23:51.269063 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:51.269063 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:23:51.269063 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:51.269063 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:51.269063 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:51.269063 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:51.269063 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:51.269063 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:51.269063 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:51.269063 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:51.269063 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:51.269063 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:51.269063 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:51.269063 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:51.269063 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:51.270001 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:51.270001 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:51.270001 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:23:51.270001 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:23:51.270001 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:23:51.270001 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:23:51.270001 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:23:51.270001 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:23:51.270001 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:23:51.270001 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:51.276389 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 440/863] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Jun 2 13:23:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:51.278911 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bb021-1233-49a4-9869-c55cd25f13e3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:51.386174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bb021-1233-49a4-9869-c55cd25f13e3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:51.422996 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0b087-a880-45f5-add1-876d2cd85349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:51.424058 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0b087-a880-45f5-add1-876d2cd85349 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:51.424575 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0b087-a880-45f5-add1-876d2cd85349 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:51.425053 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0b087-a880-45f5-add1-876d2cd85349 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:51.426081 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0b087-a880-45f5-add1-876d2cd85349 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:51.426607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0b087-a880-45f5-add1-876d2cd85349 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:51.428243 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0b087-a880-45f5-add1-876d2cd85349 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:51.446774 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 424/864] 10.222.0.32 () {56 vars in 1149 bytes} [Thu Jun 2 13:23:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:51.454678 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5ee33-55a8-4f41-8238-237e75436ff9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:51.554722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5ee33-55a8-4f41-8238-237e75436ff9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:51.589830 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c07dd-b9c5-432f-8697-13b1999ea8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:51.590476 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c07dd-b9c5-432f-8697-13b1999ea8fd None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:51.590759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c07dd-b9c5-432f-8697-13b1999ea8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:51.591035 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c07dd-b9c5-432f-8697-13b1999ea8fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:51.657061 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:51.660990 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c07dd-b9c5-432f-8697-13b1999ea8fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:51.662533 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c07dd-b9c5-432f-8697-13b1999ea8fd None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:51.768419 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 441/865] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:23:51 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:23:51.770569 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0b087-a880-45f5-add1-876d2cd85349 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:51.780037 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:51.878420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0b087-a880-45f5-add1-876d2cd85349 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:51.914739 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446de7d-7b0b-4999-ab08-62ad9c5ab36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:51.915879 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446de7d-7b0b-4999-ab08-62ad9c5ab36e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:51.916396 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446de7d-7b0b-4999-ab08-62ad9c5ab36e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:51.916875 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446de7d-7b0b-4999-ab08-62ad9c5ab36e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:51.928075 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446de7d-7b0b-4999-ab08-62ad9c5ab36e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:51.929897 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446de7d-7b0b-4999-ab08-62ad9c5ab36e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:51.949937 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-3446de7d-7b0b-4999-ab08-62ad9c5ab36e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:51.949937 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:51.949937 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:51.949937 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:51.949937 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:51.949937 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:51.949937 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:51.949937 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:51.949937 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:51.949937 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:51.949937 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:51.949937 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:51.949937 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:51.949937 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:51.949937 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:51.950876 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:51.950876 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:51.950876 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:51.950876 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:51.950876 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:51.950876 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:51.950876 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:51.950876 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:51.950876 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:51.950876 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:51.950876 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:51.950876 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:51.950876 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:51.950876 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:51.950876 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:51.950876 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:51.950876 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:51.951797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:51.951797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:51.951797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:51.951797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:51.954111 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 425/866] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:51.961592 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c07dd-b9c5-432f-8697-13b1999ea8fd None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:52.064293 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:52.067389 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c07dd-b9c5-432f-8697-13b1999ea8fd None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:52.105924 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b54ca0-3847-4338-a037-ca1375777caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:52.106603 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b54ca0-3847-4338-a037-ca1375777caa None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:52.106887 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b54ca0-3847-4338-a037-ca1375777caa None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:52.107163 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b54ca0-3847-4338-a037-ca1375777caa None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:52.107910 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b54ca0-3847-4338-a037-ca1375777caa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:52.108267 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b54ca0-3847-4338-a037-ca1375777caa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:52.109689 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b54ca0-3847-4338-a037-ca1375777caa None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:52.127550 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 442/867] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:52.129389 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446de7d-7b0b-4999-ab08-62ad9c5ab36e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:52.191130 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:52.235864 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446de7d-7b0b-4999-ab08-62ad9c5ab36e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:52.272086 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e15359-12f6-49ef-9a6f-6421ec9c364c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:52.272911 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e15359-12f6-49ef-9a6f-6421ec9c364c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:52.273197 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e15359-12f6-49ef-9a6f-6421ec9c364c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:52.273475 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e15359-12f6-49ef-9a6f-6421ec9c364c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:52.280637 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e15359-12f6-49ef-9a6f-6421ec9c364c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:52.282099 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e15359-12f6-49ef-9a6f-6421ec9c364c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:52.296705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-65e15359-12f6-49ef-9a6f-6421ec9c364c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:52.296705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:52.296705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:52.296705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:52.296705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:52.296705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:52.296705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:52.296705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:52.296705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:52.296705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:52.296705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:52.296705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:52.296705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:23:52.296705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:23:52.296705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:23:52.297621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:23:52.297621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:52.297621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:52.297621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:52.297621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:52.297621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:52.297621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:52.297621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:52.297621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:52.297621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:52.297621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:52.297621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:52.297621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:52.297621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:52.297621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:52.297621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:52.297621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:52.298515 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:23:52.298515 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:23:52.298515 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:23:52.298515 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:23:52.298515 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:23:52.298515 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:23:52.298515 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:52.298515 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:52.298515 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 426/868] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:52.303762 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b54ca0-3847-4338-a037-ca1375777caa None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:52.339381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e25766-71cf-452b-8c0a-4ba1d01aeb83 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:52.339730 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e25766-71cf-452b-8c0a-4ba1d01aeb83 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:52.340008 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e25766-71cf-452b-8c0a-4ba1d01aeb83 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:52.342020 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 427/869] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:52.349489 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9977d6-ca66-47e2-ab84-55e299fc4f46 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:52.350139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9977d6-ca66-47e2-ab84-55e299fc4f46 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:52.351186 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9977d6-ca66-47e2-ab84-55e299fc4f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:52.373568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8a9977d6-ca66-47e2-ab84-55e299fc4f46 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:52.375238 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8a9977d6-ca66-47e2-ab84-55e299fc4f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:52.422792 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b54ca0-3847-4338-a037-ca1375777caa None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:52.460820 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838c367-37b2-493a-9729-3567e516cd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:52.460820 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838c367-37b2-493a-9729-3567e516cd4c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:52.460820 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838c367-37b2-493a-9729-3567e516cd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:52.460820 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838c367-37b2-493a-9729-3567e516cd4c None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:52.462159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838c367-37b2-493a-9729-3567e516cd4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:52.462159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838c367-37b2-493a-9729-3567e516cd4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:52.462530 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 428/870] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:23:52.463034 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838c367-37b2-493a-9729-3567e516cd4c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:52.478696 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d814e0-a025-4d38-a608-6d994a4ce6c8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:52.479011 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d814e0-a025-4d38-a608-6d994a4ce6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:52.479260 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d814e0-a025-4d38-a608-6d994a4ce6c8 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:52.480441 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 443/871] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:23:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:52.482565 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838c367-37b2-493a-9729-3567e516cd4c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:52.484523 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 429/872] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:23:52.485311 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d814e0-a025-4d38-a608-6d994a4ce6c8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:52.505543 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:52.546491 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:52.590254 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838c367-37b2-493a-9729-3567e516cd4c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:52.603492 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d814e0-a025-4d38-a608-6d994a4ce6c8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:52.624038 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5d472-866e-4a91-8694-34e9f8b0c7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:52.624718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5d472-866e-4a91-8694-34e9f8b0c7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:52.625004 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5d472-866e-4a91-8694-34e9f8b0c7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:52.625289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5d472-866e-4a91-8694-34e9f8b0c7f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:52.626126 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5d472-866e-4a91-8694-34e9f8b0c7f9 None admin] RBAC: Adding query filter params (role.id=a12865c9fb9e4fa0b61e4adfd53188fb, scope.project.id=a9007447059e4862972078c032a5d67b, user.id=bbcd5ba866b84d099d183fe19ba61a4f) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:52.626440 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5d472-866e-4a91-8694-34e9f8b0c7f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:52.627867 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5d472-866e-4a91-8694-34e9f8b0c7f9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:52.634264 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 444/873] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:23:52 2022] GET /identity/v3/role_assignments?user.id=bbcd5ba866b84d099d183fe19ba61a4f&scope.project.id=a9007447059e4862972078c032a5d67b&role.id=a12865c9fb9e4fa0b61e4adfd53188fb => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:52.635272 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60414a-486e-41bd-95aa-de724e5c0efe None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:52.635561 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60414a-486e-41bd-95aa-de724e5c0efe None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:52.635839 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60414a-486e-41bd-95aa-de724e5c0efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:52.652196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77213fe8-f9a7-4126-8094-e85402a6ea1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:52.653724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77213fe8-f9a7-4126-8094-e85402a6ea1e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:52.654065 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-9a60414a-486e-41bd-95aa-de724e5c0efe None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:52.654460 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77213fe8-f9a7-4126-8094-e85402a6ea1e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:52.655041 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77213fe8-f9a7-4126-8094-e85402a6ea1e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:52.655364 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9a60414a-486e-41bd-95aa-de724e5c0efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:52.656173 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77213fe8-f9a7-4126-8094-e85402a6ea1e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:52.658234 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77213fe8-f9a7-4126-8094-e85402a6ea1e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:52.674468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-77213fe8-f9a7-4126-8094-e85402a6ea1e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:23:52.674468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:52.674468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:23:52.674468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:23:52.674468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:23:52.674468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:23:52.674468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:23:52.674468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:23:52.674468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:23:52.674468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:52.674468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:23:52.674468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:52.674468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:52.674468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:52.674468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:52.674468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:52.674468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:52.675564 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:52.675564 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:52.675564 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:52.675564 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:52.675564 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:52.675564 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:52.675564 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:23:52.675564 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:23:52.675564 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:23:52.675564 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:23:52.675564 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:52.675564 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:52.675564 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:52.675564 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:52.675564 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:52.675564 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:52.676920 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:52.676920 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:52.676920 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:52.676920 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:52.676920 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:52.676920 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:52.676920 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:52.676920 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:52.676920 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:52.676920 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:52.676920 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:23:52.676920 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:23:52.676920 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:23:52.676920 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:52.676920 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 430/874] 10.222.0.32 () {56 vars in 1126 bytes} [Thu Jun 2 13:23:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:52.677739 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdba60-bab7-452b-9b1c-af5256f904ea None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:52.677739 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdba60-bab7-452b-9b1c-af5256f904ea None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:52.677739 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdba60-bab7-452b-9b1c-af5256f904ea None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:52.679151 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 431/875] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:52.684064 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdba60-bab7-452b-9b1c-af5256f904ea None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:52.739995 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 445/876] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:23:52.741297 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca7ef2-b49d-4f4f-bec4-5da1fe55cc35 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:52.741584 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca7ef2-b49d-4f4f-bec4-5da1fe55cc35 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:52.741858 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca7ef2-b49d-4f4f-bec4-5da1fe55cc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:52.760564 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-bcca7ef2-b49d-4f4f-bec4-5da1fe55cc35 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:52.761783 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bcca7ef2-b49d-4f4f-bec4-5da1fe55cc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:52.772839 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:52.824884 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdba60-bab7-452b-9b1c-af5256f904ea None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:52.839779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:52.845242 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 446/877] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:23:52.846624 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca7ef2-b49d-4f4f-bec4-5da1fe55cc35 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:52.868981 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3456f-ec89-449f-93fd-599213c50dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:52.869594 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3456f-ec89-449f-93fd-599213c50dca None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:52.869905 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3456f-ec89-449f-93fd-599213c50dca None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:52.870152 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3456f-ec89-449f-93fd-599213c50dca None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:52.870867 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3456f-ec89-449f-93fd-599213c50dca None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:52.871175 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3456f-ec89-449f-93fd-599213c50dca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:52.872582 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3456f-ec89-449f-93fd-599213c50dca None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:52.878678 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 432/878] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Jun 2 13:23:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:52.879462 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3456f-ec89-449f-93fd-599213c50dca None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:52.965915 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca7ef2-b49d-4f4f-bec4-5da1fe55cc35 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:52.992877 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3456f-ec89-449f-93fd-599213c50dca None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:53.001286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3ea04-d43e-4ec7-8a12-2a4d5bb4407b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:53.001998 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3ea04-d43e-4ec7-8a12-2a4d5bb4407b None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:53.002290 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3ea04-d43e-4ec7-8a12-2a4d5bb4407b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:53.002570 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3ea04-d43e-4ec7-8a12-2a4d5bb4407b None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:53.003304 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3ea04-d43e-4ec7-8a12-2a4d5bb4407b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:53.004723 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3ea04-d43e-4ec7-8a12-2a4d5bb4407b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:53.028779 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 447/879] 10.222.0.32 () {60 vars in 1141 bytes} [Thu Jun 2 13:23:52 2022] POST /identity/v3/services => generated 251 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:23:53.028779 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3ea04-d43e-4ec7-8a12-2a4d5bb4407b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:53.031854 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:53.058537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176b74d-eed2-4865-b391-082cb76d1e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:53.059390 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176b74d-eed2-4865-b391-082cb76d1e08 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:53.059770 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176b74d-eed2-4865-b391-082cb76d1e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:53.060145 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176b74d-eed2-4865-b391-082cb76d1e08 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:53.061796 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176b74d-eed2-4865-b391-082cb76d1e08 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:53.063817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176b74d-eed2-4865-b391-082cb76d1e08 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:53.092352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 433/880] 10.222.0.32 () {60 vars in 1141 bytes} [Thu Jun 2 13:23:52 2022] POST /identity/v3/services => generated 269 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:23:53.171532 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3ea04-d43e-4ec7-8a12-2a4d5bb4407b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:53.222355 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d532f8-3c66-4bda-a740-49a8c9733e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:53.223044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d532f8-3c66-4bda-a740-49a8c9733e6c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:53.223326 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d532f8-3c66-4bda-a740-49a8c9733e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:53.223602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d532f8-3c66-4bda-a740-49a8c9733e6c None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:53.224360 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d532f8-3c66-4bda-a740-49a8c9733e6c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:53.224674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d532f8-3c66-4bda-a740-49a8c9733e6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:53.226109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d532f8-3c66-4bda-a740-49a8c9733e6c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:53.232354 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 448/881] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Jun 2 13:23:53 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:55.013445 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafbca6-095a-4778-95c7-387bb92567dd None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:55.014347 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafbca6-095a-4778-95c7-387bb92567dd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:55.014848 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafbca6-095a-4778-95c7-387bb92567dd None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:55.016867 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 434/882] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:55.022983 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6c3c6-70ea-4b9e-96c7-9f1ba7eb0440 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:55.024014 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6c3c6-70ea-4b9e-96c7-9f1ba7eb0440 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:55.024546 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6c3c6-70ea-4b9e-96c7-9f1ba7eb0440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:55.044477 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-26b6c3c6-70ea-4b9e-96c7-9f1ba7eb0440 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:55.046054 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-26b6c3c6-70ea-4b9e-96c7-9f1ba7eb0440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:55.114434 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:55.125553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 449/883] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:23:55.149633 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafbca6-095a-4778-95c7-387bb92567dd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:55.184819 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:55.266330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafbca6-095a-4778-95c7-387bb92567dd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:55.301004 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3daf6-4724-48c4-b9ca-70ece0886394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:55.301820 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3daf6-4724-48c4-b9ca-70ece0886394 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:55.302102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3daf6-4724-48c4-b9ca-70ece0886394 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:55.302376 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3daf6-4724-48c4-b9ca-70ece0886394 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:55.313576 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3daf6-4724-48c4-b9ca-70ece0886394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:23:55.321573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-81a3daf6-4724-48c4-b9ca-70ece0886394 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:23:55.321573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:55.321573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:55.321573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:55.321573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:55.321573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:55.321573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:55.321573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:55.321573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:55.321573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:55.321573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:55.321573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:55.321573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:23:55.321573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:23:55.321573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:23:55.321573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:23:55.322607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:23:55.322607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:23:55.322607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:23:55.322607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:23:55.322607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:55.322607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:55.322607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:55.322607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:55.322607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:55.322607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:55.322607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:55.322607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:55.322607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:55.322607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:55.322607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:55.322607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:55.323537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:55.323537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:55.323537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:55.323537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:55.323537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:23:55.323537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:23:55.323537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:23:55.323537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:23:55.323537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:23:55.323537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:23:55.323537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:23:55.323537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:55.323537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 435/884] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Jun 2 13:23:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:55.330624 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6c3c6-70ea-4b9e-96c7-9f1ba7eb0440 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:55.351337 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d153382-d8e3-4c92-98ce-5708879b0e8f None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:55.351642 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d153382-d8e3-4c92-98ce-5708879b0e8f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:55.351901 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d153382-d8e3-4c92-98ce-5708879b0e8f None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:55.353787 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 436/885] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:23:55.361502 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344869b2-9f6d-4265-a18f-f9931c748f48 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:55.362304 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344869b2-9f6d-4265-a18f-f9931c748f48 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:55.362818 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344869b2-9f6d-4265-a18f-f9931c748f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:55.385990 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-344869b2-9f6d-4265-a18f-f9931c748f48 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:55.387799 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-344869b2-9f6d-4265-a18f-f9931c748f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:55.443251 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6c3c6-70ea-4b9e-96c7-9f1ba7eb0440 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:55.475570 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 437/886] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:23:55.477377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979028f-4fcb-4793-8bef-00ac7a1df017 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:55.477663 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979028f-4fcb-4793-8bef-00ac7a1df017 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:55.477936 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979028f-4fcb-4793-8bef-00ac7a1df017 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:55.479439 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 438/887] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:55.480781 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216fb2e-2752-4eb1-9bc8-010f296859f7 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:55.481015 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4b4a9-959a-465a-a494-ee3bcefcdf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:55.481521 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216fb2e-2752-4eb1-9bc8-010f296859f7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:55.481684 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4b4a9-959a-465a-a494-ee3bcefcdf7e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:55.482073 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216fb2e-2752-4eb1-9bc8-010f296859f7 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:55.482316 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4b4a9-959a-465a-a494-ee3bcefcdf7e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:55.482741 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4b4a9-959a-465a-a494-ee3bcefcdf7e None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:55.483656 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4b4a9-959a-465a-a494-ee3bcefcdf7e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:55.483894 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 439/888] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:55.484362 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4b4a9-959a-465a-a494-ee3bcefcdf7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:55.485004 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff750bbe-7ab9-413f-81bc-8472d2f87ff6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:55.485348 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff750bbe-7ab9-413f-81bc-8472d2f87ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:55.485625 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff750bbe-7ab9-413f-81bc-8472d2f87ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:55.486627 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4b4a9-959a-465a-a494-ee3bcefcdf7e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:55.500488 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 450/889] 10.222.0.32 () {56 vars in 1115 bytes} [Thu Jun 2 13:23:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:55.502027 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d7224-582f-4688-95e8-a80eea2454f5 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:55.502321 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d7224-582f-4688-95e8-a80eea2454f5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:55.502599 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d7224-582f-4688-95e8-a80eea2454f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:55.502962 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ff750bbe-7ab9-413f-81bc-8472d2f87ff6 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:55.504135 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ff750bbe-7ab9-413f-81bc-8472d2f87ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:55.519154 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f55d7224-582f-4688-95e8-a80eea2454f5 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:55.520244 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f55d7224-582f-4688-95e8-a80eea2454f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:55.524105 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:55.569614 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:55.574967 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 440/890] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:23:55.575634 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff750bbe-7ab9-413f-81bc-8472d2f87ff6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:55.588513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 451/891] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:23:55.589641 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d7224-582f-4688-95e8-a80eea2454f5 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:55.679416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff750bbe-7ab9-413f-81bc-8472d2f87ff6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:55.688057 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d7224-582f-4688-95e8-a80eea2454f5 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:55.714409 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0783580-7bbb-49a9-a9b6-767fd5a579c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:55.715203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0783580-7bbb-49a9-a9b6-767fd5a579c8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:55.715482 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0783580-7bbb-49a9-a9b6-767fd5a579c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:55.715757 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0783580-7bbb-49a9-a9b6-767fd5a579c8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:55.716449 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0783580-7bbb-49a9-a9b6-767fd5a579c8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:55.717844 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0783580-7bbb-49a9-a9b6-767fd5a579c8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:55.721964 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11750332-ab44-4e79-9472-23aa9dd2e1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:55.722750 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11750332-ab44-4e79-9472-23aa9dd2e1cb None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:55.723039 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11750332-ab44-4e79-9472-23aa9dd2e1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:55.723318 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11750332-ab44-4e79-9472-23aa9dd2e1cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:55.729862 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c0783580-7bbb-49a9-a9b6-767fd5a579c8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:23:55.729862 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:55.729862 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:23:55.729862 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:23:55.729862 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:23:55.729862 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:23:55.729862 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:23:55.729862 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:23:55.729862 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:23:55.729862 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:55.729862 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:23:55.729862 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:55.729862 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:55.729862 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:55.729862 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:55.729862 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:55.729862 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:55.730910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:55.730910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:55.730910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:55.730910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:55.730910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:55.730910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:55.730910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:23:55.730910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:23:55.730910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:23:55.730910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:23:55.730910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:55.730910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:55.730910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:55.730910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:55.730910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:55.730910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:55.731744 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:55.731744 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:55.731744 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:55.731744 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:55.731744 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:55.731744 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:55.731744 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:55.731744 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:55.731744 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:55.731744 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:55.731744 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:23:55.731744 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:23:55.731744 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:23:55.731744 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:55.731744 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 441/892] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Jun 2 13:23:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:55.732869 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0783580-7bbb-49a9-a9b6-767fd5a579c8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:55.738386 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11750332-ab44-4e79-9472-23aa9dd2e1cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:55.739852 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11750332-ab44-4e79-9472-23aa9dd2e1cb None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:55.749861 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:55.759114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-11750332-ab44-4e79-9472-23aa9dd2e1cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:55.759114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:55.759114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:55.759114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:55.759114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:55.759114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:55.759114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:55.759114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:55.759114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:55.759114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:55.759114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:55.759114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:55.759114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:55.759114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:55.759114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:55.760056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:55.760056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:55.760056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:55.760056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:55.760056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:55.760056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:55.760056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:55.760056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:55.760056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:55.760056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:55.760056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:55.760056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:55.760056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:55.760056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:55.760056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:55.760056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:55.760056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:55.760982 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:55.760982 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:55.760982 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:55.760982 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:55.760982 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 452/893] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:55.761501 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11750332-ab44-4e79-9472-23aa9dd2e1cb None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:55.802487 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:55.837151 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0783580-7bbb-49a9-a9b6-767fd5a579c8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:55.862141 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11750332-ab44-4e79-9472-23aa9dd2e1cb None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:55.870536 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f39c6f-f523-4619-8b6b-be9d150c2810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:55.871338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f39c6f-f523-4619-8b6b-be9d150c2810 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:55.871618 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f39c6f-f523-4619-8b6b-be9d150c2810 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:55.871889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f39c6f-f523-4619-8b6b-be9d150c2810 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:55.872560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f39c6f-f523-4619-8b6b-be9d150c2810 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:55.873928 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f39c6f-f523-4619-8b6b-be9d150c2810 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:55.885946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-17f39c6f-f523-4619-8b6b-be9d150c2810 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:23:55.885946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:55.885946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:23:55.885946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:23:55.885946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:23:55.885946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:23:55.885946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:23:55.885946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:23:55.885946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:23:55.885946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:55.885946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:23:55.885946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:55.885946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:55.885946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:55.885946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:55.885946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:55.886914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:55.886914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:55.886914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:55.886914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:55.886914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:55.886914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:55.886914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:55.886914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:23:55.886914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:23:55.886914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:23:55.886914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:23:55.886914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:55.886914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:55.886914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:55.886914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:55.886914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:55.887750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:55.887750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:55.887750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:55.887750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:55.887750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:55.887750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:55.887750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:55.887750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:55.887750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:55.887750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:55.887750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:55.887750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:23:55.887750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:23:55.887750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:23:55.887750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:55.887750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 442/894] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Jun 2 13:23:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:55.889241 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f39c6f-f523-4619-8b6b-be9d150c2810 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:55.900565 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3aded9-9fc4-48a4-8cd2-9598dd524547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:55.901230 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3aded9-9fc4-48a4-8cd2-9598dd524547 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:55.901515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3aded9-9fc4-48a4-8cd2-9598dd524547 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:55.901795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3aded9-9fc4-48a4-8cd2-9598dd524547 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:55.902523 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3aded9-9fc4-48a4-8cd2-9598dd524547 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:55.903886 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3aded9-9fc4-48a4-8cd2-9598dd524547 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:55.917177 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 453/895] 10.222.0.32 () {60 vars in 1141 bytes} [Thu Jun 2 13:23:55 2022] POST /identity/v3/services => generated 241 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:23:55.917977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3aded9-9fc4-48a4-8cd2-9598dd524547 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:55.973132 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:55.997166 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f39c6f-f523-4619-8b6b-be9d150c2810 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:56.047179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c89009-464f-459f-ac5e-b459ce5faf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:56.047884 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c89009-464f-459f-ac5e-b459ce5faf3a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:56.048124 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c89009-464f-459f-ac5e-b459ce5faf3a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:56.048435 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c89009-464f-459f-ac5e-b459ce5faf3a None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:56.048582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:56.049157 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c89009-464f-459f-ac5e-b459ce5faf3a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:56.049499 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c89009-464f-459f-ac5e-b459ce5faf3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:56.050885 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c89009-464f-459f-ac5e-b459ce5faf3a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:56.054705 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3aded9-9fc4-48a4-8cd2-9598dd524547 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:56.057722 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 443/896] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Jun 2 13:23:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:56.058595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c89009-464f-459f-ac5e-b459ce5faf3a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:56.104891 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2d897-3ec8-4db4-8fca-4ff5a011b6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:56.105967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2d897-3ec8-4db4-8fca-4ff5a011b6a4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:56.106255 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2d897-3ec8-4db4-8fca-4ff5a011b6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:56.106883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2d897-3ec8-4db4-8fca-4ff5a011b6a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:56.107620 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2d897-3ec8-4db4-8fca-4ff5a011b6a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:56.108536 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2d897-3ec8-4db4-8fca-4ff5a011b6a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:56.110078 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2d897-3ec8-4db4-8fca-4ff5a011b6a4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:56.124408 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 454/897] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:56.128427 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2d897-3ec8-4db4-8fca-4ff5a011b6a4 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:56.169585 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c89009-464f-459f-ac5e-b459ce5faf3a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:56.204851 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272859a9-c7a9-40b8-9c08-a41049bc6143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:56.205520 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272859a9-c7a9-40b8-9c08-a41049bc6143 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:56.205805 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272859a9-c7a9-40b8-9c08-a41049bc6143 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:56.206086 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272859a9-c7a9-40b8-9c08-a41049bc6143 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:56.206823 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272859a9-c7a9-40b8-9c08-a41049bc6143 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:56.207131 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272859a9-c7a9-40b8-9c08-a41049bc6143 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:56.208540 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272859a9-c7a9-40b8-9c08-a41049bc6143 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:56.218683 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 444/898] 10.222.0.32 () {56 vars in 1126 bytes} [Thu Jun 2 13:23:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:56.218683 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272859a9-c7a9-40b8-9c08-a41049bc6143 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:56.221455 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:56.244776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2d897-3ec8-4db4-8fca-4ff5a011b6a4 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:56.281474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123cd52-e0b7-4764-91c2-3edf72930b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:56.282140 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123cd52-e0b7-4764-91c2-3edf72930b1f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:56.282430 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123cd52-e0b7-4764-91c2-3edf72930b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:56.282721 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123cd52-e0b7-4764-91c2-3edf72930b1f None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:56.283435 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123cd52-e0b7-4764-91c2-3edf72930b1f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:56.283748 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123cd52-e0b7-4764-91c2-3edf72930b1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:56.285151 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123cd52-e0b7-4764-91c2-3edf72930b1f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:56.291458 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 455/899] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Jun 2 13:23:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:56.293183 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123cd52-e0b7-4764-91c2-3edf72930b1f None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:56.323793 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272859a9-c7a9-40b8-9c08-a41049bc6143 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:56.325909 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:56.364047 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763aa602-6e77-4720-9b69-1933b218b417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:56.364901 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763aa602-6e77-4720-9b69-1933b218b417 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:56.365186 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763aa602-6e77-4720-9b69-1933b218b417 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:56.365461 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763aa602-6e77-4720-9b69-1933b218b417 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:56.373569 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763aa602-6e77-4720-9b69-1933b218b417 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:56.375021 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763aa602-6e77-4720-9b69-1933b218b417 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:56.389477 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-763aa602-6e77-4720-9b69-1933b218b417 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:23:56.389477 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:56.389477 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:56.389477 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:56.389477 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:56.389477 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:56.389477 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:56.389477 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:56.389477 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:56.389477 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:56.389477 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:56.389477 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:56.389477 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:23:56.389477 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:23:56.389477 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:23:56.389477 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:23:56.390728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:56.390728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:56.390728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:23:56.390728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:56.390728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:23:56.390728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:23:56.390728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:56.390728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:56.390728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:56.390728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:56.390728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:56.390728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:56.390728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:56.390728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:56.390728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:56.390728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:56.390728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:56.390728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:56.391689 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:56.391689 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:56.391689 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:23:56.391689 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:23:56.391689 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:23:56.391689 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:23:56.391689 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:23:56.391689 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:23:56.391689 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:23:56.391689 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:56.391689 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 445/900] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Jun 2 13:23:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:56.392369 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763aa602-6e77-4720-9b69-1933b218b417 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:56.417000 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123cd52-e0b7-4764-91c2-3edf72930b1f None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:56.454748 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31468722-5e7f-4b9e-b31e-2a4824537df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:56.455404 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31468722-5e7f-4b9e-b31e-2a4824537df2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:56.455686 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31468722-5e7f-4b9e-b31e-2a4824537df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:56.455967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31468722-5e7f-4b9e-b31e-2a4824537df2 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:56.456708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31468722-5e7f-4b9e-b31e-2a4824537df2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:56.457008 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31468722-5e7f-4b9e-b31e-2a4824537df2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:56.458355 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31468722-5e7f-4b9e-b31e-2a4824537df2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:56.468407 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 456/901] 10.222.0.32 () {56 vars in 1126 bytes} [Thu Jun 2 13:23:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:56.468407 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31468722-5e7f-4b9e-b31e-2a4824537df2 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:56.468807 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:56.510966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763aa602-6e77-4720-9b69-1933b218b417 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:56.547193 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c35094-4637-4b54-aed3-a96ffde00470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:56.547842 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c35094-4637-4b54-aed3-a96ffde00470 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:56.548121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c35094-4637-4b54-aed3-a96ffde00470 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:56.548530 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c35094-4637-4b54-aed3-a96ffde00470 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:56.549415 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c35094-4637-4b54-aed3-a96ffde00470 None admin] RBAC: Adding query filter params (interface=public, service_id=a306616050e34f3a82dbb2e5b249b3e0, region_id=RegionOne) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:56.549726 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c35094-4637-4b54-aed3-a96ffde00470 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:56.551200 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c35094-4637-4b54-aed3-a96ffde00470 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:56.556919 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 446/902] 10.222.0.32 () {56 vars in 1251 bytes} [Thu Jun 2 13:23:56 2022] GET /identity/v3/endpoints?service_id=a306616050e34f3a82dbb2e5b249b3e0&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:56.557550 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c35094-4637-4b54-aed3-a96ffde00470 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:56.563310 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:56.579844 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31468722-5e7f-4b9e-b31e-2a4824537df2 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:56.614683 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835bfa1f-ad69-4cf6-98b2-75dc9ac7cec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:56.615356 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bfa1f-ad69-4cf6-98b2-75dc9ac7cec2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:56.615647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bfa1f-ad69-4cf6-98b2-75dc9ac7cec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:56.615927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bfa1f-ad69-4cf6-98b2-75dc9ac7cec2 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:56.616813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835bfa1f-ad69-4cf6-98b2-75dc9ac7cec2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:56.617151 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835bfa1f-ad69-4cf6-98b2-75dc9ac7cec2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:56.618590 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835bfa1f-ad69-4cf6-98b2-75dc9ac7cec2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:56.636541 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 457/903] 10.222.0.32 () {56 vars in 1149 bytes} [Thu Jun 2 13:23:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:56.640290 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835bfa1f-ad69-4cf6-98b2-75dc9ac7cec2 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:56.666571 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c35094-4637-4b54-aed3-a96ffde00470 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:56.695119 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:56.704648 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3dfb8d-5b05-4d1a-99d1-e63660690d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:56.705306 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3dfb8d-5b05-4d1a-99d1-e63660690d60 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:56.705654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3dfb8d-5b05-4d1a-99d1-e63660690d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:56.705983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3dfb8d-5b05-4d1a-99d1-e63660690d60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:56.706872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3dfb8d-5b05-4d1a-99d1-e63660690d60 None admin] RBAC: Adding query filter params (interface=public, service_id=3989d72af94748c4bbb9c7ae2872bb6a, region_id=RegionOne) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:56.707305 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3dfb8d-5b05-4d1a-99d1-e63660690d60 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:56.708964 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3dfb8d-5b05-4d1a-99d1-e63660690d60 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:56.719419 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 447/904] 10.222.0.32 () {56 vars in 1251 bytes} [Thu Jun 2 13:23:56 2022] GET /identity/v3/endpoints?service_id=3989d72af94748c4bbb9c7ae2872bb6a&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:56.719419 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3dfb8d-5b05-4d1a-99d1-e63660690d60 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:56.751001 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835bfa1f-ad69-4cf6-98b2-75dc9ac7cec2 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:56.789955 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7989b6f-ea7a-47ad-b724-f7f2faebad14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:56.790766 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7989b6f-ea7a-47ad-b724-f7f2faebad14 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:56.791049 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7989b6f-ea7a-47ad-b724-f7f2faebad14 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:56.791325 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7989b6f-ea7a-47ad-b724-f7f2faebad14 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:56.792045 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7989b6f-ea7a-47ad-b724-f7f2faebad14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:56.793437 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7989b6f-ea7a-47ad-b724-f7f2faebad14 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:56.800249 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 458/905] 10.222.0.32 () {56 vars in 1087 bytes} [Thu Jun 2 13:23:56 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:23:56.801147 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7989b6f-ea7a-47ad-b724-f7f2faebad14 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:56.813676 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:56.842011 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3dfb8d-5b05-4d1a-99d1-e63660690d60 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:56.887337 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d397ce-680f-4ed1-9cf0-6800dc803d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:56.888443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d397ce-680f-4ed1-9cf0-6800dc803d45 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:56.889211 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d397ce-680f-4ed1-9cf0-6800dc803d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:56.889672 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d397ce-680f-4ed1-9cf0-6800dc803d45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:56.929044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7989b6f-ea7a-47ad-b724-f7f2faebad14 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:56.969584 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70824d1-d171-477e-a8d4-25d7bf694a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:56.970364 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70824d1-d171-477e-a8d4-25d7bf694a3b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:56.970737 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70824d1-d171-477e-a8d4-25d7bf694a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:56.971083 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70824d1-d171-477e-a8d4-25d7bf694a3b None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:56.971855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70824d1-d171-477e-a8d4-25d7bf694a3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:56.973462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70824d1-d171-477e-a8d4-25d7bf694a3b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:56.978728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:56.981428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 459/906] 10.222.0.32 () {56 vars in 1087 bytes} [Thu Jun 2 13:23:56 2022] GET /identity/v3/services => generated 1497 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:23:56.998225 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d397ce-680f-4ed1-9cf0-6800dc803d45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:56.999749 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d397ce-680f-4ed1-9cf0-6800dc803d45 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:57.123654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 448/907] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:23:56 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:23:57.132338 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70824d1-d171-477e-a8d4-25d7bf694a3b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:57.206455 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:57.239664 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70824d1-d171-477e-a8d4-25d7bf694a3b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:57.274368 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4050bf2-9c14-42c1-b615-aa91f868d6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:57.275160 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4050bf2-9c14-42c1-b615-aa91f868d6fe None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:57.275445 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4050bf2-9c14-42c1-b615-aa91f868d6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:57.275724 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4050bf2-9c14-42c1-b615-aa91f868d6fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:57.285941 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4050bf2-9c14-42c1-b615-aa91f868d6fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:57.287392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4050bf2-9c14-42c1-b615-aa91f868d6fe None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:57.306062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-f4050bf2-9c14-42c1-b615-aa91f868d6fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:57.306062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:57.306062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:57.306062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:57.306062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:57.306062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:57.306062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:57.306062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:57.306062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:57.306062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:57.306062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:57.306062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:57.306062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:23:57.306062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:23:57.306062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:23:57.306997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:23:57.306997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:57.306997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:57.306997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:57.306997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:57.306997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:57.306997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:57.306997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:57.306997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:57.306997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:57.306997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:57.306997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:57.306997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:57.306997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:57.306997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:57.306997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:57.306997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:57.307915 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:23:57.307915 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:23:57.307915 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:23:57.307915 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:57.307915 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 460/908] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:57.313130 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d397ce-680f-4ed1-9cf0-6800dc803d45 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:57.409061 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:57.419345 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d397ce-680f-4ed1-9cf0-6800dc803d45 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:57.455618 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7e8f6-b4e7-4cb0-ba58-88a543e3425e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:57.456287 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7e8f6-b4e7-4cb0-ba58-88a543e3425e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:57.456599 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7e8f6-b4e7-4cb0-ba58-88a543e3425e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:57.456882 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7e8f6-b4e7-4cb0-ba58-88a543e3425e None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:57.457608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae7e8f6-b4e7-4cb0-ba58-88a543e3425e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:57.457915 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae7e8f6-b4e7-4cb0-ba58-88a543e3425e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:57.459357 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae7e8f6-b4e7-4cb0-ba58-88a543e3425e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:57.471584 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 449/909] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:57.477620 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4050bf2-9c14-42c1-b615-aa91f868d6fe None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:57.585978 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4050bf2-9c14-42c1-b615-aa91f868d6fe None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:57.611963 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:57.624080 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335ad6e-6278-43e1-af0d-28846f294791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:57.624899 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335ad6e-6278-43e1-af0d-28846f294791 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:57.625179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335ad6e-6278-43e1-af0d-28846f294791 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:57.625451 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335ad6e-6278-43e1-af0d-28846f294791 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:57.632387 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335ad6e-6278-43e1-af0d-28846f294791 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:57.633869 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335ad6e-6278-43e1-af0d-28846f294791 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:57.648098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-4335ad6e-6278-43e1-af0d-28846f294791 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:57.648098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:57.648098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:57.648098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:57.648098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:57.648098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:57.648098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:57.648098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:57.648098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:57.648098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:57.648098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:57.648098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:57.648098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:23:57.648098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:23:57.648098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:23:57.649649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:23:57.649649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:57.649649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:57.649649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:57.649649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:57.649649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:57.649649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:57.649649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:57.649649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:57.649649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:57.649649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:57.649649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:57.649649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:57.649649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:57.649649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:57.649649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:57.649649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:57.650557 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:23:57.650557 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:23:57.650557 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:23:57.650557 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:23:57.650557 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:23:57.650557 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:23:57.650557 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:23:57.650557 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:57.650557 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 461/910] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:23:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:57.656149 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7e8f6-b4e7-4cb0-ba58-88a543e3425e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:57.764773 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7e8f6-b4e7-4cb0-ba58-88a543e3425e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:57.800829 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90fa5d-5940-4fa1-b24b-601669c02593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:57.801945 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90fa5d-5940-4fa1-b24b-601669c02593 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:57.802440 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90fa5d-5940-4fa1-b24b-601669c02593 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:57.802923 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90fa5d-5940-4fa1-b24b-601669c02593 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:57.803927 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90fa5d-5940-4fa1-b24b-601669c02593 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:57.804475 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90fa5d-5940-4fa1-b24b-601669c02593 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:57.806163 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90fa5d-5940-4fa1-b24b-601669c02593 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:57.819205 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 450/911] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:23:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:57.824835 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335ad6e-6278-43e1-af0d-28846f294791 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:57.937099 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335ad6e-6278-43e1-af0d-28846f294791 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:57.973287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af3bd9-7eb7-4fdf-ab96-45fff5a3ed99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:57.973944 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af3bd9-7eb7-4fdf-ab96-45fff5a3ed99 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:57.974229 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af3bd9-7eb7-4fdf-ab96-45fff5a3ed99 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:57.974510 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af3bd9-7eb7-4fdf-ab96-45fff5a3ed99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:57.975354 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af3bd9-7eb7-4fdf-ab96-45fff5a3ed99 None admin] RBAC: Adding query filter params (role.id=f1346f1c619e4ab48ac6d21faa94c720, scope.project.id=a9007447059e4862972078c032a5d67b, user.id=bbcd5ba866b84d099d183fe19ba61a4f) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:57.975732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af3bd9-7eb7-4fdf-ab96-45fff5a3ed99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:57.977226 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af3bd9-7eb7-4fdf-ab96-45fff5a3ed99 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:57.983325 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 462/912] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:23:57 2022] GET /identity/v3/role_assignments?user.id=bbcd5ba866b84d099d183fe19ba61a4f&scope.project.id=a9007447059e4862972078c032a5d67b&role.id=f1346f1c619e4ab48ac6d21faa94c720 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:58.214470 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e388e55-68c6-4fe7-b4a1-07fbd51997a8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:58.215049 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e388e55-68c6-4fe7-b4a1-07fbd51997a8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:58.215049 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e388e55-68c6-4fe7-b4a1-07fbd51997a8 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:58.216793 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 451/913] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:58.222822 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d93e43-76de-438d-84a9-13bf75e03456 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:58.223807 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d93e43-76de-438d-84a9-13bf75e03456 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:58.224350 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d93e43-76de-438d-84a9-13bf75e03456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:58.241847 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e9d93e43-76de-438d-84a9-13bf75e03456 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:58.243416 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e9d93e43-76de-438d-84a9-13bf75e03456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:58.290868 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:58.315813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 463/914] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:23:58.339141 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e388e55-68c6-4fe7-b4a1-07fbd51997a8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:58.354318 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:58.448415 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e388e55-68c6-4fe7-b4a1-07fbd51997a8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:58.483587 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770599a-911d-4e07-bfe0-e2c248157c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:58.484340 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770599a-911d-4e07-bfe0-e2c248157c37 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:58.484634 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770599a-911d-4e07-bfe0-e2c248157c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:58.484910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770599a-911d-4e07-bfe0-e2c248157c37 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:58.485560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770599a-911d-4e07-bfe0-e2c248157c37 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:58.487006 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770599a-911d-4e07-bfe0-e2c248157c37 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:58.500143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e770599a-911d-4e07-bfe0-e2c248157c37 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:23:58.500143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:58.500143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:23:58.500143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:23:58.500143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:23:58.500143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:23:58.500143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:23:58.500143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:23:58.500143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:23:58.500143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:58.500143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:23:58.500143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:58.500143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:58.500143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:58.500143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:58.500143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:58.500143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:58.501397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:58.501397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:58.501397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:58.501397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:58.501397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:58.501397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:58.501397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:23:58.501397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:23:58.501397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:23:58.501397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:23:58.501397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:58.501397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:58.501397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:58.501397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:58.501397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:58.501397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:58.502568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:58.502568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:58.502568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:58.502568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:58.502568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:58.502568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:58.502568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:58.502568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:58.502568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:58.502568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:58.502568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:23:58.502568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:23:58.502568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:23:58.502568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:58.502568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 452/915] 10.222.0.32 () {56 vars in 1126 bytes} [Thu Jun 2 13:23:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:58.507345 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d93e43-76de-438d-84a9-13bf75e03456 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:58.607904 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d93e43-76de-438d-84a9-13bf75e03456 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:58.643544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e3e9f-55ed-4137-87d4-8e9c98bbfca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:58.644617 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e3e9f-55ed-4137-87d4-8e9c98bbfca8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:58.645132 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e3e9f-55ed-4137-87d4-8e9c98bbfca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:58.645614 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e3e9f-55ed-4137-87d4-8e9c98bbfca8 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:58.646536 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e3e9f-55ed-4137-87d4-8e9c98bbfca8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:58.647077 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e3e9f-55ed-4137-87d4-8e9c98bbfca8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:58.648686 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e3e9f-55ed-4137-87d4-8e9c98bbfca8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:58.654243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 464/916] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Jun 2 13:23:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:58.660130 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770599a-911d-4e07-bfe0-e2c248157c37 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:58.745358 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:58.768935 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770599a-911d-4e07-bfe0-e2c248157c37 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:58.805199 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276aab41-b35d-4181-ad1c-e416ca6ff96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:58.806369 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276aab41-b35d-4181-ad1c-e416ca6ff96f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:58.806653 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276aab41-b35d-4181-ad1c-e416ca6ff96f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:58.806929 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276aab41-b35d-4181-ad1c-e416ca6ff96f None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:58.807638 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276aab41-b35d-4181-ad1c-e416ca6ff96f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:58.807949 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276aab41-b35d-4181-ad1c-e416ca6ff96f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:58.809496 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276aab41-b35d-4181-ad1c-e416ca6ff96f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:58.814955 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 453/917] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Jun 2 13:23:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:58.820802 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e3e9f-55ed-4137-87d4-8e9c98bbfca8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:58.866563 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:58.929335 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e3e9f-55ed-4137-87d4-8e9c98bbfca8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:58.965239 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a2c9e-e875-467a-9a6c-7a2cb9ea696f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:58.965902 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a2c9e-e875-467a-9a6c-7a2cb9ea696f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:58.966188 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a2c9e-e875-467a-9a6c-7a2cb9ea696f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:58.966472 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a2c9e-e875-467a-9a6c-7a2cb9ea696f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:58.967276 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a2c9e-e875-467a-9a6c-7a2cb9ea696f None admin] RBAC: Adding query filter params (interface=public, service_id=3c101db5fa0441ce947c2097902bf13b, region_id=RegionOne) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:58.967595 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a2c9e-e875-467a-9a6c-7a2cb9ea696f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:58.969008 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a2c9e-e875-467a-9a6c-7a2cb9ea696f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:58.977502 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 465/918] 10.222.0.32 () {56 vars in 1251 bytes} [Thu Jun 2 13:23:58 2022] GET /identity/v3/endpoints?service_id=3c101db5fa0441ce947c2097902bf13b&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:58.983032 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276aab41-b35d-4181-ad1c-e416ca6ff96f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:59.106111 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276aab41-b35d-4181-ad1c-e416ca6ff96f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:59.140361 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c0258-3dec-4f88-839e-1e7776e4df55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:59.141034 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c0258-3dec-4f88-839e-1e7776e4df55 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:59.141321 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c0258-3dec-4f88-839e-1e7776e4df55 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:59.141599 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c0258-3dec-4f88-839e-1e7776e4df55 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:59.142285 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c0258-3dec-4f88-839e-1e7776e4df55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:59.143660 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c0258-3dec-4f88-839e-1e7776e4df55 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:59.150592 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 454/919] 10.222.0.32 () {56 vars in 1087 bytes} [Thu Jun 2 13:23:58 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:23:59.271899 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34190a33-c80b-42f2-841f-0281148ee3aa None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:59.272429 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34190a33-c80b-42f2-841f-0281148ee3aa None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:59.272626 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34190a33-c80b-42f2-841f-0281148ee3aa None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:59.275077 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 466/920] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:23:59.281144 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f998f-1161-4ce9-8779-8eed8fe14996 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:59.282094 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f998f-1161-4ce9-8779-8eed8fe14996 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:59.282591 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f998f-1161-4ce9-8779-8eed8fe14996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:59.289263 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:59.301990 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2b7f998f-1161-4ce9-8779-8eed8fe14996 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:59.303210 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2b7f998f-1161-4ce9-8779-8eed8fe14996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:59.378724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 455/921] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:23:59.402810 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34190a33-c80b-42f2-841f-0281148ee3aa None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:59.411784 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82358c-9a0a-4928-83b2-ade525d8dd53 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:59.412065 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82358c-9a0a-4928-83b2-ade525d8dd53 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:59.412551 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82358c-9a0a-4928-83b2-ade525d8dd53 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:59.414336 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 456/922] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:23:59.420038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357693a-fdd8-4b45-836d-ee4e635eb8e6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:59.420513 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357693a-fdd8-4b45-836d-ee4e635eb8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:59.420956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357693a-fdd8-4b45-836d-ee4e635eb8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:59.438740 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c357693a-fdd8-4b45-836d-ee4e635eb8e6 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:23:59.440147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c357693a-fdd8-4b45-836d-ee4e635eb8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:23:59.529598 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34190a33-c80b-42f2-841f-0281148ee3aa None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:59.540382 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 457/923] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:23:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:23:59.541354 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:59.565227 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357693a-fdd8-4b45-836d-ee4e635eb8e6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:59.575725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90ab92-97c6-4a0c-aa2d-49db2e0b46a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:59.576827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90ab92-97c6-4a0c-aa2d-49db2e0b46a6 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:59.577358 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90ab92-97c6-4a0c-aa2d-49db2e0b46a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:59.577848 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90ab92-97c6-4a0c-aa2d-49db2e0b46a6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:59.578828 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90ab92-97c6-4a0c-aa2d-49db2e0b46a6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:59.580451 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90ab92-97c6-4a0c-aa2d-49db2e0b46a6 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:59.594758 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-df90ab92-97c6-4a0c-aa2d-49db2e0b46a6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:23:59.594758 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:59.594758 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:23:59.594758 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:23:59.594758 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:23:59.594758 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:23:59.594758 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:23:59.594758 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:23:59.594758 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:23:59.594758 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:59.594758 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:23:59.594758 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:59.594758 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:59.594758 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:59.594758 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:59.594758 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:59.594758 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:59.595981 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:59.595981 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:59.595981 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:59.595981 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:59.595981 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:59.595981 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:59.595981 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:23:59.595981 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:23:59.595981 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:23:59.595981 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:23:59.595981 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:59.595981 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:59.595981 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:59.595981 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:59.595981 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:59.595981 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:59.597128 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:59.597128 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:59.597128 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:59.597128 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:59.597128 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:59.597128 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:59.597128 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:59.597128 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:59.597128 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:59.597128 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:59.597128 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:23:59.597128 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:23:59.597128 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:23:59.597128 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:23:59.599785 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 467/924] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Jun 2 13:23:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:23:59.605837 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90ab92-97c6-4a0c-aa2d-49db2e0b46a6 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:59.640207 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:59.690510 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357693a-fdd8-4b45-836d-ee4e635eb8e6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:59.722765 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90ab92-97c6-4a0c-aa2d-49db2e0b46a6 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:59.727653 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5ac5e-a1d4-4c56-8318-9566d5e88f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:59.728531 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5ac5e-a1d4-4c56-8318-9566d5e88f42 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:59.728817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5ac5e-a1d4-4c56-8318-9566d5e88f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:59.729096 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5ac5e-a1d4-4c56-8318-9566d5e88f42 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:59.729751 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5ac5e-a1d4-4c56-8318-9566d5e88f42 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:59.731130 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5ac5e-a1d4-4c56-8318-9566d5e88f42 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:59.743734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-70b5ac5e-a1d4-4c56-8318-9566d5e88f42 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:23:59.743734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:59.743734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:23:59.743734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:23:59.743734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:23:59.743734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:23:59.743734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:23:59.743734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:23:59.743734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:23:59.743734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:59.743734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:23:59.743734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:59.743734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:23:59.743734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:23:59.743734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:23:59.743734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:23:59.744764 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:23:59.744764 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:23:59.744764 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:23:59.744764 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:23:59.744764 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:23:59.744764 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:23:59.744764 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:23:59.744764 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:23:59.744764 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:23:59.744764 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:23:59.744764 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:23:59.744764 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:23:59.744764 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:23:59.744764 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:23:59.744764 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:23:59.744764 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:23:59.745608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:23:59.745608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:23:59.745608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:23:59.745608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:23:59.745608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:23:59.745608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:23:59.745608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:23:59.745608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:23:59.745608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:23:59.745608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:23:59.745608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:23:59.745608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:23:59.745608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:23:59.745608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:23:59.745608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:23:59.750078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 458/925] 10.222.0.32 () {56 vars in 1132 bytes} [Thu Jun 2 13:23:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:23:59.750956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5ac5e-a1d4-4c56-8318-9566d5e88f42 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:59.766694 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b16ca-8455-4536-8437-137b7c8efb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:59.767813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b16ca-8455-4536-8437-137b7c8efb0c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:59.768291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b16ca-8455-4536-8437-137b7c8efb0c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:59.768795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b16ca-8455-4536-8437-137b7c8efb0c None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:59.769701 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b16ca-8455-4536-8437-137b7c8efb0c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:59.770360 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b16ca-8455-4536-8437-137b7c8efb0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:59.772092 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b16ca-8455-4536-8437-137b7c8efb0c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:59.778981 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 468/926] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Jun 2 13:23:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:23:59.785900 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b16ca-8455-4536-8437-137b7c8efb0c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:59.835043 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:59.868760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5ac5e-a1d4-4c56-8318-9566d5e88f42 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:59.898304 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:23:59.907283 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d6157-ee8c-4198-ad1d-9d6d9a82bc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:59.908016 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d6157-ee8c-4198-ad1d-9d6d9a82bc63 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:59.908537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d6157-ee8c-4198-ad1d-9d6d9a82bc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:59.908952 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d6157-ee8c-4198-ad1d-9d6d9a82bc63 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:59.909817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d6157-ee8c-4198-ad1d-9d6d9a82bc63 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:59.910224 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d6157-ee8c-4198-ad1d-9d6d9a82bc63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:59.911827 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d6157-ee8c-4198-ad1d-9d6d9a82bc63 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:59.922173 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 459/927] 10.222.0.32 () {56 vars in 1126 bytes} [Thu Jun 2 13:23:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:59.923447 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d6157-ee8c-4198-ad1d-9d6d9a82bc63 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:23:59.925658 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b16ca-8455-4536-8437-137b7c8efb0c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:23:59.968708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42766938-d716-4684-af68-d4a4a8297891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:23:59.969520 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42766938-d716-4684-af68-d4a4a8297891 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:23:59.969810 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42766938-d716-4684-af68-d4a4a8297891 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:23:59.970127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42766938-d716-4684-af68-d4a4a8297891 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:23:59.971657 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42766938-d716-4684-af68-d4a4a8297891 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:23:59.971988 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42766938-d716-4684-af68-d4a4a8297891 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:23:59.973542 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42766938-d716-4684-af68-d4a4a8297891 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:23:59.979785 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 469/928] 10.222.0.32 () {56 vars in 1114 bytes} [Thu Jun 2 13:23:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:23:59.985124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42766938-d716-4684-af68-d4a4a8297891 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:00.066271 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d6157-ee8c-4198-ad1d-9d6d9a82bc63 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:00.101834 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644f947-eb99-4d2b-908e-4728281aa4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:00.102662 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644f947-eb99-4d2b-908e-4728281aa4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:00.103043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644f947-eb99-4d2b-908e-4728281aa4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:00.103435 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644f947-eb99-4d2b-908e-4728281aa4b2 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:00.104234 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644f947-eb99-4d2b-908e-4728281aa4b2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:00.104722 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644f947-eb99-4d2b-908e-4728281aa4b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:00.106116 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644f947-eb99-4d2b-908e-4728281aa4b2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:00.110194 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:00.116582 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 460/929] 10.222.0.32 () {56 vars in 1126 bytes} [Thu Jun 2 13:23:59 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:00.118831 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644f947-eb99-4d2b-908e-4728281aa4b2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:00.121787 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42766938-d716-4684-af68-d4a4a8297891 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:00.169578 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a91d4d-2e3d-417a-82a1-8bb645c9541b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:00.170534 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a91d4d-2e3d-417a-82a1-8bb645c9541b None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:00.171026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a91d4d-2e3d-417a-82a1-8bb645c9541b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:00.171479 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a91d4d-2e3d-417a-82a1-8bb645c9541b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:00.172420 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a91d4d-2e3d-417a-82a1-8bb645c9541b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:00.174014 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a91d4d-2e3d-417a-82a1-8bb645c9541b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:00.189586 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:00.201218 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 470/930] 10.222.0.32 () {60 vars in 1144 bytes} [Thu Jun 2 13:23:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:24:00.248444 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644f947-eb99-4d2b-908e-4728281aa4b2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:00.297543 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c829c18-d96a-4ecd-8ce9-c061fa01c4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:00.298345 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c829c18-d96a-4ecd-8ce9-c061fa01c4d2 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:00.298513 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c829c18-d96a-4ecd-8ce9-c061fa01c4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:00.298753 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c829c18-d96a-4ecd-8ce9-c061fa01c4d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:00.299506 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c829c18-d96a-4ecd-8ce9-c061fa01c4d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:00.301115 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c829c18-d96a-4ecd-8ce9-c061fa01c4d2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:00.324120 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 461/931] 10.222.0.32 () {60 vars in 1144 bytes} [Thu Jun 2 13:24:00 2022] POST /identity/v3/endpoints => generated 347 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:24:00.338224 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a59a2-688d-425b-a658-e9ab545d494d None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:00.338783 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a59a2-688d-425b-a658-e9ab545d494d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:00.338783 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a59a2-688d-425b-a658-e9ab545d494d None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:00.340701 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 471/932] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:00.346946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a833d-a662-42b3-95a0-4af96d032780 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:00.347271 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a833d-a662-42b3-95a0-4af96d032780 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:00.347522 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a833d-a662-42b3-95a0-4af96d032780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:00.368869 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-705a833d-a662-42b3-95a0-4af96d032780 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:00.370198 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-705a833d-a662-42b3-95a0-4af96d032780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:00.455713 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 462/933] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:24:00.479503 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a59a2-688d-425b-a658-e9ab545d494d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:00.599223 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a59a2-688d-425b-a658-e9ab545d494d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:00.634456 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34199c-80b0-43df-a027-d80fbc086cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:00.635326 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34199c-80b0-43df-a027-d80fbc086cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:00.635609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34199c-80b0-43df-a027-d80fbc086cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:00.635887 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34199c-80b0-43df-a027-d80fbc086cb0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:00.647957 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34199c-80b0-43df-a027-d80fbc086cb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:24:00.657003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-5b34199c-80b0-43df-a027-d80fbc086cb0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:24:00.657003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:00.657003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:00.657003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:00.657003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:00.657003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:00.657003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:00.657003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:00.657003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:00.657003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:00.657003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:00.657003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:00.657003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:24:00.657003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:24:00.657003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:24:00.657003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:24:00.657911 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:24:00.657911 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:24:00.657911 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:24:00.657911 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:24:00.657911 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:00.657911 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:00.657911 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:00.657911 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:00.657911 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:00.657911 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:00.657911 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:00.657911 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:00.657911 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:00.657911 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:00.657911 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:00.657911 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:00.658767 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:00.658767 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:00.658767 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:00.658767 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:00.658767 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:24:00.658767 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:24:00.658767 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:24:00.658767 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:24:00.658767 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:24:00.658767 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:24:00.658767 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:24:00.658767 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:00.658767 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 472/934] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Jun 2 13:24:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:00.664233 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a833d-a662-42b3-95a0-4af96d032780 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:00.705666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:00.779539 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a833d-a662-42b3-95a0-4af96d032780 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:00.817470 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b344602-252c-4fb2-b1eb-8ec921cc1546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:00.818152 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b344602-252c-4fb2-b1eb-8ec921cc1546 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:00.818481 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b344602-252c-4fb2-b1eb-8ec921cc1546 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:00.818758 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b344602-252c-4fb2-b1eb-8ec921cc1546 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:00.819554 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b344602-252c-4fb2-b1eb-8ec921cc1546 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:00.819864 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b344602-252c-4fb2-b1eb-8ec921cc1546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:00.821838 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b344602-252c-4fb2-b1eb-8ec921cc1546 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:00.830594 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 463/935] 10.222.0.32 () {56 vars in 1115 bytes} [Thu Jun 2 13:24:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:00.836614 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34199c-80b0-43df-a027-d80fbc086cb0 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:00.852957 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:00.944985 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34199c-80b0-43df-a027-d80fbc086cb0 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:00.985697 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674aab7-74f2-4ef7-8161-5b68c9330aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:00.986497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674aab7-74f2-4ef7-8161-5b68c9330aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:00.986784 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674aab7-74f2-4ef7-8161-5b68c9330aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:00.987064 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674aab7-74f2-4ef7-8161-5b68c9330aa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:00.998083 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674aab7-74f2-4ef7-8161-5b68c9330aa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:00.999558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674aab7-74f2-4ef7-8161-5b68c9330aa5 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:01.019413 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-4674aab7-74f2-4ef7-8161-5b68c9330aa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:24:01.019413 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:01.019413 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:01.019413 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:01.019413 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:01.019413 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:01.019413 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:01.019413 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:01.019413 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:01.019413 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:01.019413 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:01.019413 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:01.019413 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:24:01.019413 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:24:01.019413 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:24:01.020444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:24:01.020444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:01.020444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:01.020444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:01.020444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:01.020444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:01.020444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:01.020444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:01.020444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:01.020444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:01.020444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:01.020444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:01.020444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:01.020444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:01.020444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:01.020444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:01.020444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:01.021338 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:24:01.021338 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:24:01.021338 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:24:01.021338 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:01.021338 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 473/936] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:01.026692 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b344602-252c-4fb2-b1eb-8ec921cc1546 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:01.129693 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:01.136071 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b344602-252c-4fb2-b1eb-8ec921cc1546 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:01.170934 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7ecdd-fa98-4b2e-b6bd-c80645a9d798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:01.171623 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7ecdd-fa98-4b2e-b6bd-c80645a9d798 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:01.171902 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7ecdd-fa98-4b2e-b6bd-c80645a9d798 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:01.172282 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7ecdd-fa98-4b2e-b6bd-c80645a9d798 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:01.173049 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7ecdd-fa98-4b2e-b6bd-c80645a9d798 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:01.173357 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7ecdd-fa98-4b2e-b6bd-c80645a9d798 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:01.174792 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7ecdd-fa98-4b2e-b6bd-c80645a9d798 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:01.189647 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 464/937] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:01.195178 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674aab7-74f2-4ef7-8161-5b68c9330aa5 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:01.269397 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:01.307036 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674aab7-74f2-4ef7-8161-5b68c9330aa5 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:01.342633 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd917f6-4dfa-4ae7-872f-81618b6bd76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:01.343441 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd917f6-4dfa-4ae7-872f-81618b6bd76e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:01.343728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd917f6-4dfa-4ae7-872f-81618b6bd76e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:01.344006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd917f6-4dfa-4ae7-872f-81618b6bd76e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:01.351846 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd917f6-4dfa-4ae7-872f-81618b6bd76e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:01.353875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd917f6-4dfa-4ae7-872f-81618b6bd76e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:01.368892 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-ddd917f6-4dfa-4ae7-872f-81618b6bd76e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:24:01.368892 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:01.368892 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:01.368892 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:01.368892 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:01.368892 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:01.368892 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:01.368892 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:01.368892 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:01.368892 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:01.368892 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:01.368892 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:01.368892 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:24:01.368892 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:24:01.368892 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:24:01.368892 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:24:01.371011 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:01.371011 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:01.371011 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:24:01.371011 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:24:01.371011 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:24:01.371011 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:24:01.371011 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:01.371011 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:01.371011 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:01.371011 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:01.371011 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:01.371011 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:01.371011 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:01.371011 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:01.371011 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:01.371011 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:01.371011 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:01.371011 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:01.373283 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:01.373283 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:01.373283 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:24:01.373283 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:24:01.373283 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:24:01.373283 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:24:01.373283 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:24:01.373283 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:24:01.373283 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:24:01.373283 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:01.373283 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 474/938] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Jun 2 13:24:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:01.376885 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7ecdd-fa98-4b2e-b6bd-c80645a9d798 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:01.481765 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7ecdd-fa98-4b2e-b6bd-c80645a9d798 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:01.516610 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0989d-9b4e-45f9-bb5a-88b780b11cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:01.517278 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0989d-9b4e-45f9-bb5a-88b780b11cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:01.517557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0989d-9b4e-45f9-bb5a-88b780b11cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:01.517832 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0989d-9b4e-45f9-bb5a-88b780b11cc4 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:01.518666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0989d-9b4e-45f9-bb5a-88b780b11cc4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:01.518972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0989d-9b4e-45f9-bb5a-88b780b11cc4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:01.520528 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0989d-9b4e-45f9-bb5a-88b780b11cc4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:01.521292 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd70408-4b05-4d8b-a1cb-1c11a7d8259b None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:01.521590 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd70408-4b05-4d8b-a1cb-1c11a7d8259b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:01.521882 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd70408-4b05-4d8b-a1cb-1c11a7d8259b None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:01.523470 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 475/939] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:01.529256 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985da99-626b-44fd-b443-786183c41e75 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:01.529543 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985da99-626b-44fd-b443-786183c41e75 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:01.529821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985da99-626b-44fd-b443-786183c41e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:01.540269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 465/940] 10.222.0.32 () {56 vars in 1149 bytes} [Thu Jun 2 13:24:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:01.546826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b985da99-626b-44fd-b443-786183c41e75 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:01.548036 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b985da99-626b-44fd-b443-786183c41e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:01.549288 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0989d-9b4e-45f9-bb5a-88b780b11cc4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:01.567838 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:01.634242 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 476/941] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:24:01.658922 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985da99-626b-44fd-b443-786183c41e75 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:01.682276 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0989d-9b4e-45f9-bb5a-88b780b11cc4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:01.727670 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:01.728774 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc77f2-85f4-4f92-83a6-7bac9743b67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:01.729969 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc77f2-85f4-4f92-83a6-7bac9743b67e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:01.730356 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc77f2-85f4-4f92-83a6-7bac9743b67e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:01.730644 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc77f2-85f4-4f92-83a6-7bac9743b67e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:01.746922 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc77f2-85f4-4f92-83a6-7bac9743b67e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:01.748347 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc77f2-85f4-4f92-83a6-7bac9743b67e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:01.769099 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-36bc77f2-85f4-4f92-83a6-7bac9743b67e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:24:01.769099 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:01.769099 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:01.769099 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:01.769099 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:01.769099 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:01.769099 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:01.769099 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:01.769099 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:01.769099 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:01.769099 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:01.769099 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:01.769099 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:24:01.769099 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:24:01.769099 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:24:01.770062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:24:01.770062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:01.770062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:01.770062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:01.770062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:01.770062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:01.770062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:01.770062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:01.770062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:01.770062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:01.770062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:01.770062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:01.770062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:01.770062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:01.770062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:01.770062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:01.770062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:01.770971 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:24:01.770971 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:24:01.770971 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:24:01.770971 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:24:01.770971 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 466/942] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:24:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:01.777422 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc77f2-85f4-4f92-83a6-7bac9743b67e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:01.783043 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985da99-626b-44fd-b443-786183c41e75 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:01.823908 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcdcd3-c6f7-4131-873b-0eede7a88019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:01.824879 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcdcd3-c6f7-4131-873b-0eede7a88019 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:01.825258 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcdcd3-c6f7-4131-873b-0eede7a88019 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:01.825624 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcdcd3-c6f7-4131-873b-0eede7a88019 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:01.826373 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcdcd3-c6f7-4131-873b-0eede7a88019 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:01.827994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcdcd3-c6f7-4131-873b-0eede7a88019 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:01.840647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-36bcdcd3-c6f7-4131-873b-0eede7a88019 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:24:01.840647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:01.840647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:24:01.840647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:24:01.840647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:24:01.840647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:24:01.840647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:24:01.840647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:24:01.840647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:24:01.840647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:01.840647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:24:01.840647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:01.840647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:01.840647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:01.840647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:01.840647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:01.840647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:01.842611 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:01.842611 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:01.842611 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:01.842611 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:01.842611 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:01.842611 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:01.842611 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:24:01.842611 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:24:01.842611 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:24:01.842611 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:24:01.842611 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:01.842611 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:01.842611 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:01.842611 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:01.842611 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:01.842611 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:01.843927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:01.843927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:01.843927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:01.843927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:01.843927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:01.843927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:01.843927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:01.843927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:01.843927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:01.843927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:01.843927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:24:01.843927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:24:01.843927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:24:01.843927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:01.843927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 477/943] 10.222.0.32 () {56 vars in 1126 bytes} [Thu Jun 2 13:24:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:24:01.850836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcdcd3-c6f7-4131-873b-0eede7a88019 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:01.857096 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:01.902486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc77f2-85f4-4f92-83a6-7bac9743b67e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:01.946583 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a108a-7401-4098-9938-f5e455da67a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:01.947256 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a108a-7401-4098-9938-f5e455da67a4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:01.947545 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a108a-7401-4098-9938-f5e455da67a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:01.947828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a108a-7401-4098-9938-f5e455da67a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:01.948861 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a108a-7401-4098-9938-f5e455da67a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:01.949174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a108a-7401-4098-9938-f5e455da67a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:01.950737 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a108a-7401-4098-9938-f5e455da67a4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:01.959911 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcdcd3-c6f7-4131-873b-0eede7a88019 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:01.968371 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 467/944] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:01.971197 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a108a-7401-4098-9938-f5e455da67a4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:01.987133 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:02.005829 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f185e51-ab3d-4ad1-a460-c069e27c12f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:02.006434 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f185e51-ab3d-4ad1-a460-c069e27c12f8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:02.006722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f185e51-ab3d-4ad1-a460-c069e27c12f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:02.007004 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f185e51-ab3d-4ad1-a460-c069e27c12f8 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:02.007743 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f185e51-ab3d-4ad1-a460-c069e27c12f8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:02.008220 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f185e51-ab3d-4ad1-a460-c069e27c12f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:02.010290 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f185e51-ab3d-4ad1-a460-c069e27c12f8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:02.020954 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 478/945] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Jun 2 13:24:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:02.024129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f185e51-ab3d-4ad1-a460-c069e27c12f8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:02.087824 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a108a-7401-4098-9938-f5e455da67a4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:02.114777 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:02.123815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb92faa-644c-4448-97f2-0f776bf06676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:02.124664 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb92faa-644c-4448-97f2-0f776bf06676 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:02.124953 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb92faa-644c-4448-97f2-0f776bf06676 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:02.125233 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb92faa-644c-4448-97f2-0f776bf06676 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:02.132523 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb92faa-644c-4448-97f2-0f776bf06676 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:02.134046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb92faa-644c-4448-97f2-0f776bf06676 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:02.141765 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f185e51-ab3d-4ad1-a460-c069e27c12f8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:02.149342 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-3fb92faa-644c-4448-97f2-0f776bf06676 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:24:02.149342 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:02.149342 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:02.149342 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:02.149342 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:02.149342 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:02.149342 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:02.149342 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:02.149342 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:02.149342 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:02.149342 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:02.149342 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:02.149342 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:24:02.149342 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:24:02.149342 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:24:02.150243 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:24:02.150243 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:02.150243 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:02.150243 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:02.150243 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:02.150243 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:02.150243 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:02.150243 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:02.150243 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:02.150243 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:02.150243 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:02.150243 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:02.150243 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:02.150243 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:02.150243 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:02.150243 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:02.150243 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:02.151135 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:24:02.151135 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:24:02.151135 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:24:02.151135 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:24:02.151135 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:24:02.151135 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:24:02.151135 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:24:02.151135 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:24:02.155339 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 468/946] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:24:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:02.156228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb92faa-644c-4448-97f2-0f776bf06676 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:02.183481 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50d23d-c1dd-4ad2-b2a5-fe85da352d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:02.184568 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50d23d-c1dd-4ad2-b2a5-fe85da352d26 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:02.185111 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50d23d-c1dd-4ad2-b2a5-fe85da352d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:02.185694 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50d23d-c1dd-4ad2-b2a5-fe85da352d26 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:02.186615 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50d23d-c1dd-4ad2-b2a5-fe85da352d26 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:02.187129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50d23d-c1dd-4ad2-b2a5-fe85da352d26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:02.188986 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50d23d-c1dd-4ad2-b2a5-fe85da352d26 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:02.199364 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 479/947] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Jun 2 13:24:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:02.200620 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50d23d-c1dd-4ad2-b2a5-fe85da352d26 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:02.256661 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:02.264723 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb92faa-644c-4448-97f2-0f776bf06676 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:02.303114 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8dbbe-0e38-4dbd-970f-fee7a31bd6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:02.303783 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8dbbe-0e38-4dbd-970f-fee7a31bd6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:02.304074 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8dbbe-0e38-4dbd-970f-fee7a31bd6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:02.304384 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8dbbe-0e38-4dbd-970f-fee7a31bd6b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:02.305211 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8dbbe-0e38-4dbd-970f-fee7a31bd6b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:02.305528 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8dbbe-0e38-4dbd-970f-fee7a31bd6b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:02.306998 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8dbbe-0e38-4dbd-970f-fee7a31bd6b8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:02.319722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50d23d-c1dd-4ad2-b2a5-fe85da352d26 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:02.323968 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 469/948] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:24:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:02.325103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8dbbe-0e38-4dbd-970f-fee7a31bd6b8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:02.358748 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd2600-632d-4153-b702-3adf8cc21a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:02.360226 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd2600-632d-4153-b702-3adf8cc21a91 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:02.360769 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd2600-632d-4153-b702-3adf8cc21a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:02.361297 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd2600-632d-4153-b702-3adf8cc21a91 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:02.362347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd2600-632d-4153-b702-3adf8cc21a91 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:02.364053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd2600-632d-4153-b702-3adf8cc21a91 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:02.375926 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:02.392437 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 480/949] 10.222.0.32 () {60 vars in 1144 bytes} [Thu Jun 2 13:24:02 2022] POST /identity/v3/endpoints => generated 349 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:24:02.437356 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8dbbe-0e38-4dbd-970f-fee7a31bd6b8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:02.491035 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26351e2d-5609-4835-bb6c-a807ebc7cd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:02.492415 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26351e2d-5609-4835-bb6c-a807ebc7cd6d None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:02.492979 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26351e2d-5609-4835-bb6c-a807ebc7cd6d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:02.493500 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26351e2d-5609-4835-bb6c-a807ebc7cd6d None admin] PATH_INFO: `/v3/projects/a9007447059e4862972078c032a5d67b/users/bbcd5ba866b84d099d183fe19ba61a4f/roles/f1346f1c619e4ab48ac6d21faa94c720` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:02.496259 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26351e2d-5609-4835-bb6c-a807ebc7cd6d None admin] RBAC: Authorizing `identity:create_grant(project_id=a9007447059e4862972078c032a5d67b, user_id=bbcd5ba866b84d099d183fe19ba61a4f, role_id=f1346f1c619e4ab48ac6d21faa94c720)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:02.498097 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26351e2d-5609-4835-bb6c-a807ebc7cd6d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:02.515567 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 470/950] 10.222.0.32 () {58 vars in 1439 bytes} [Thu Jun 2 13:24:02 2022] PUT /identity/v3/projects/a9007447059e4862972078c032a5d67b/users/bbcd5ba866b84d099d183fe19ba61a4f/roles/f1346f1c619e4ab48ac6d21faa94c720 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:24:02.599938 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be25fb-51a2-4975-b6cb-1e9048d43a02 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:02.600326 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be25fb-51a2-4975-b6cb-1e9048d43a02 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:02.600531 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be25fb-51a2-4975-b6cb-1e9048d43a02 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:02.603189 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 481/951] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:02.609949 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d25a9-f221-461e-807b-5f94b1765122 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:02.610381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d25a9-f221-461e-807b-5f94b1765122 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:02.610773 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d25a9-f221-461e-807b-5f94b1765122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:02.629873 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5e4d25a9-f221-461e-807b-5f94b1765122 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:02.631127 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5e4d25a9-f221-461e-807b-5f94b1765122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:02.711028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 471/952] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:24:02.736422 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be25fb-51a2-4975-b6cb-1e9048d43a02 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:02.817976 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5d1a7-3dbc-4119-a07a-b6ee8b3b125f None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:02.818302 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5d1a7-3dbc-4119-a07a-b6ee8b3b125f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:02.818540 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5d1a7-3dbc-4119-a07a-b6ee8b3b125f None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:02.820053 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 472/953] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:02.826259 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba34def-6798-4685-b6d9-7b78fdbf3623 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:02.826901 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba34def-6798-4685-b6d9-7b78fdbf3623 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:02.827376 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba34def-6798-4685-b6d9-7b78fdbf3623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:02.845986 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7ba34def-6798-4685-b6d9-7b78fdbf3623 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:02.847569 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7ba34def-6798-4685-b6d9-7b78fdbf3623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:02.849219 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be25fb-51a2-4975-b6cb-1e9048d43a02 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:02.852833 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:02.881061 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:02.891616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca449c0-fb0a-4e64-af01-f87a40e2aa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:02.892497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca449c0-fb0a-4e64-af01-f87a40e2aa22 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:02.892876 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca449c0-fb0a-4e64-af01-f87a40e2aa22 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:02.893276 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca449c0-fb0a-4e64-af01-f87a40e2aa22 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:02.894117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca449c0-fb0a-4e64-af01-f87a40e2aa22 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:02.895626 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca449c0-fb0a-4e64-af01-f87a40e2aa22 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:02.897302 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: WARNING keystone.server.flask.common [None req-3ca449c0-fb0a-4e64-af01-f87a40e2aa22 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 02 13:24:02.916705 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.sql.core [None req-3ca449c0-fb0a-4e64-af01-f87a40e2aa22 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 13:24:02.916705 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 02 13:24:02.916705 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [parameters: {'id': '5f28e4469ecc4e5190f4475c6bd2dcc1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 02 13:24:02.916705 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80182) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 13:24:02.925824 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-3ca449c0-fb0a-4e64-af01-f87a40e2aa22 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5f28e4469ecc4e5190f4475c6bd2dcc1.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5f28e4469ecc4e5190f4475c6bd2dcc1. Jun 02 13:24:02.925824 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:02.925824 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 13:24:02.925824 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 13:24:02.925824 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 13:24:02.925824 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 13:24:02.925824 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 13:24:02.925824 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 13:24:02.925824 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 13:24:02.925824 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application conn.query(q) Jun 02 13:24:02.925824 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 13:24:02.925824 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 13:24:02.925824 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 13:24:02.926775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application result.read() Jun 02 13:24:02.926775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 13:24:02.926775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 13:24:02.926775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 13:24:02.926775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 13:24:02.926775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 13:24:02.926775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 13:24:02.926775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 13:24:02.926775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 13:24:02.926775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 13:24:02.926775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:02.926775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 13:24:02.926775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:02.926775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:02.926775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 13:24:02.926775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 13:24:02.926775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 02 13:24:02.926775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 02 13:24:02.927732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 13:24:02.927732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application next(self.gen) Jun 02 13:24:02.927732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 13:24:02.927732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application yield resource Jun 02 13:24:02.927732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 13:24:02.927732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application next(self.gen) Jun 02 13:24:02.927732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 13:24:02.927732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 13:24:02.927732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 13:24:02.927732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 13:24:02.927732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 13:24:02.927732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise self.value Jun 02 13:24:02.927732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 13:24:02.927732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 13:24:02.927732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 13:24:02.927732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application session.commit() Jun 02 13:24:02.927732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 13:24:02.928667 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 13:24:02.928667 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 13:24:02.928667 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 13:24:02.928667 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 13:24:02.928667 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self.session.flush() Jun 02 13:24:02.928667 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 13:24:02.928667 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 13:24:02.928667 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 13:24:02.928667 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 13:24:02.928667 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 13:24:02.928667 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application compat.raise_( Jun 02 13:24:02.928667 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 13:24:02.928667 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception Jun 02 13:24:02.928667 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 13:24:02.928667 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 13:24:02.928667 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 13:24:02.928667 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 13:24:02.929581 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 13:24:02.929581 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 13:24:02.929581 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 13:24:02.929581 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 13:24:02.929581 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 02 13:24:02.929581 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 02 13:24:02.929581 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 13:24:02.929581 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 13:24:02.929581 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 13:24:02.929581 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 13:24:02.929581 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 13:24:02.929581 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 13:24:02.929581 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 13:24:02.929581 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 13:24:02.929581 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 13:24:02.930948 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 13:24:02.930948 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 13:24:02.930948 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception Jun 02 13:24:02.930948 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 13:24:02.930948 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 13:24:02.930948 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 13:24:02.930948 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 13:24:02.930948 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 13:24:02.930948 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 13:24:02.930948 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 13:24:02.930948 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application conn.query(q) Jun 02 13:24:02.930948 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 13:24:02.930948 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 13:24:02.930948 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 13:24:02.930948 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application result.read() Jun 02 13:24:02.930948 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 13:24:02.930948 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 13:24:02.931827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 13:24:02.931827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 13:24:02.931827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 13:24:02.931827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 13:24:02.931827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 13:24:02.931827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 13:24:02.931827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 13:24:02.931827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 02 13:24:02.931827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [parameters: {'id': '5f28e4469ecc4e5190f4475c6bd2dcc1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 02 13:24:02.931827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 13:24:02.931827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:02.931827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:24:02.931827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:02.931827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:02.931827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 02 13:24:02.932830 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 02 13:24:02.932830 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 13:24:02.932830 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 13:24:02.932830 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 02 13:24:02.932830 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:02.932830 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:24:02.932830 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:02.932830 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:02.932830 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:02.932830 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:02.932830 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:02.932830 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:02.932830 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:02.932830 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:02.932830 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:02.932830 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:02.932830 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:02.933793 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:02.933793 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 02 13:24:02.933793 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 02 13:24:02.933793 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:02.933793 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:02.933793 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 02 13:24:02.933793 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 02 13:24:02.933793 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5f28e4469ecc4e5190f4475c6bd2dcc1. Jun 02 13:24:02.933793 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:02.933793 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 482/954] 10.222.0.32 () {60 vars in 1140 bytes} [Thu Jun 2 13:24:02 2022] POST /identity/v3/projects => generated 262 bytes in 192 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:02.936770 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca449c0-fb0a-4e64-af01-f87a40e2aa22 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:02.946459 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 473/955] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:24:02.969420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba34def-6798-4685-b6d9-7b78fdbf3623 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:03.048512 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca449c0-fb0a-4e64-af01-f87a40e2aa22 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:03.088169 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914bf78-86d2-465f-9077-076bf61819ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:03.088896 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914bf78-86d2-465f-9077-076bf61819ce None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:03.089179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914bf78-86d2-465f-9077-076bf61819ce None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:03.089473 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914bf78-86d2-465f-9077-076bf61819ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:03.096783 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914bf78-86d2-465f-9077-076bf61819ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:03.098526 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914bf78-86d2-465f-9077-076bf61819ce None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:03.100230 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba34def-6798-4685-b6d9-7b78fdbf3623 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:03.113602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-6914bf78-86d2-465f-9077-076bf61819ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:24:03.113602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:03.113602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:03.113602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:03.113602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:03.113602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:03.113602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:03.113602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:03.113602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:03.113602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:03.113602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:03.113602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:03.113602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:24:03.113602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:24:03.113602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:24:03.114543 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:24:03.114543 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:03.114543 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:03.114543 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:03.114543 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:03.114543 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:03.114543 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:03.114543 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:03.114543 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:03.114543 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:03.114543 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:03.114543 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:03.114543 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:03.114543 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:03.114543 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:03.114543 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:03.114543 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:03.115582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:24:03.115582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:24:03.115582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:24:03.115582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:24:03.115582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:24:03.115582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:24:03.115582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:24:03.115582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:03.115582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 483/956] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:24:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:03.121458 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914bf78-86d2-465f-9077-076bf61819ce None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:03.142157 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d337c7-d8ff-4eb0-abc0-625e03456eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:03.143336 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d337c7-d8ff-4eb0-abc0-625e03456eaa None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:03.143623 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d337c7-d8ff-4eb0-abc0-625e03456eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:03.143902 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d337c7-d8ff-4eb0-abc0-625e03456eaa None admin] PATH_INFO: `/v3/services/compute` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:03.144610 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d337c7-d8ff-4eb0-abc0-625e03456eaa None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:03.146276 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:03.148149 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d337c7-d8ff-4eb0-abc0-625e03456eaa None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:03.166062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-74d337c7-d8ff-4eb0-abc0-625e03456eaa None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:24:03.166062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:03.166062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:24:03.166062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:24:03.166062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:24:03.166062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:24:03.166062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:24:03.166062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:24:03.166062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:24:03.166062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:24:03.166062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:24:03.166062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:24:03.166062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:03.166062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:03.166062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:03.166062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:03.166062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:03.167352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:03.167352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:03.167352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:03.167352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:03.167352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:03.167352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:03.167352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:24:03.167352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:24:03.167352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:24:03.167352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:24:03.167352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:03.167352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:03.167352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:03.167352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:03.167352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:03.167352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:03.168451 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:03.168451 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:03.168451 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:03.168451 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:03.168451 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:03.168451 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:03.168451 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:03.168451 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:03.168451 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:03.168451 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:03.168451 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:24:03.168451 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:24:03.168451 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:24:03.168451 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:24:03.171802 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 474/957] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:24:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:03.177508 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d337c7-d8ff-4eb0-abc0-625e03456eaa None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:03.210037 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:03.252466 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914bf78-86d2-465f-9077-076bf61819ce None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:03.293203 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d9ac6-0069-4a1c-b329-a2c4de0866b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:03.293943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d9ac6-0069-4a1c-b329-a2c4de0866b2 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:03.294150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d9ac6-0069-4a1c-b329-a2c4de0866b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:03.294461 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d9ac6-0069-4a1c-b329-a2c4de0866b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:03.295194 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d9ac6-0069-4a1c-b329-a2c4de0866b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:03.295503 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d9ac6-0069-4a1c-b329-a2c4de0866b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:03.296837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d337c7-d8ff-4eb0-abc0-625e03456eaa None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:03.297033 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d9ac6-0069-4a1c-b329-a2c4de0866b2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:03.324736 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 484/958] 10.222.0.32 () {56 vars in 1112 bytes} [Thu Jun 2 13:24:03 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:03.335767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82528f9-7bbe-486d-a956-b8d60ce945e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:03.337312 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82528f9-7bbe-486d-a956-b8d60ce945e7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:03.337747 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82528f9-7bbe-486d-a956-b8d60ce945e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:03.338240 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82528f9-7bbe-486d-a956-b8d60ce945e7 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:03.339160 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82528f9-7bbe-486d-a956-b8d60ce945e7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:03.339626 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82528f9-7bbe-486d-a956-b8d60ce945e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:03.341255 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82528f9-7bbe-486d-a956-b8d60ce945e7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:03.347477 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 475/959] 10.222.0.32 () {56 vars in 1112 bytes} [Thu Jun 2 13:24:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:03.353749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d9ac6-0069-4a1c-b329-a2c4de0866b2 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:03.459248 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:03.483282 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d9ac6-0069-4a1c-b329-a2c4de0866b2 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:03.521341 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b536f-127c-4146-94c2-f335fde37928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:03.522024 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b536f-127c-4146-94c2-f335fde37928 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:03.522314 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b536f-127c-4146-94c2-f335fde37928 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:03.522591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b536f-127c-4146-94c2-f335fde37928 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:03.523432 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b536f-127c-4146-94c2-f335fde37928 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:03.523807 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b536f-127c-4146-94c2-f335fde37928 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:03.525736 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b536f-127c-4146-94c2-f335fde37928 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:03.532605 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 485/960] 10.222.0.32 () {56 vars in 1112 bytes} [Thu Jun 2 13:24:03 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:04.760106 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbb8d3-8edf-4922-8396-9902503bed20 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:04.760669 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbb8d3-8edf-4922-8396-9902503bed20 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:04.760669 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbb8d3-8edf-4922-8396-9902503bed20 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:04.762294 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 476/961] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:04.767881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d5791-705c-4e6a-a91c-63385e76c59a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:04.768333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d5791-705c-4e6a-a91c-63385e76c59a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:04.768511 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d5791-705c-4e6a-a91c-63385e76c59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:04.786094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-627d5791-705c-4e6a-a91c-63385e76c59a None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:04.787628 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-627d5791-705c-4e6a-a91c-63385e76c59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:04.848112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c32317-bbf4-4fda-9fa9-d7aaeb1738fd None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:04.848479 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c32317-bbf4-4fda-9fa9-d7aaeb1738fd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:04.848719 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c32317-bbf4-4fda-9fa9-d7aaeb1738fd None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:04.850411 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 477/962] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:04.855230 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634be4cf-183b-4a6a-9c17-499c085ea87b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:04.855580 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634be4cf-183b-4a6a-9c17-499c085ea87b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:04.855803 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634be4cf-183b-4a6a-9c17-499c085ea87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:04.859077 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 486/963] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:24:04.872906 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-634be4cf-183b-4a6a-9c17-499c085ea87b None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:04.874095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-634be4cf-183b-4a6a-9c17-499c085ea87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:04.882977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d5791-705c-4e6a-a91c-63385e76c59a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:04.964330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 478/964] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:24:04.968172 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:04.985184 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634be4cf-183b-4a6a-9c17-499c085ea87b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:04.995520 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d5791-705c-4e6a-a91c-63385e76c59a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:05.020121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:05.042739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800174fb-6ec0-43fd-bc58-e62db113be6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:05.043865 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800174fb-6ec0-43fd-bc58-e62db113be6a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:05.044443 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800174fb-6ec0-43fd-bc58-e62db113be6a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:05.044993 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800174fb-6ec0-43fd-bc58-e62db113be6a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:05.045965 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800174fb-6ec0-43fd-bc58-e62db113be6a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:05.047556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800174fb-6ec0-43fd-bc58-e62db113be6a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:05.061327 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-800174fb-6ec0-43fd-bc58-e62db113be6a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:24:05.061327 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:05.061327 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:24:05.061327 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:24:05.061327 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:24:05.061327 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:24:05.061327 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:24:05.061327 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:24:05.061327 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:24:05.061327 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:05.061327 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:24:05.061327 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:05.061327 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:05.061327 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:05.061327 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:05.061327 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:05.061327 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:05.062391 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:05.062391 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:05.062391 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:05.062391 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:05.062391 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:05.062391 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:05.062391 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:24:05.062391 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:24:05.062391 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:24:05.062391 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:24:05.062391 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:05.062391 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:05.062391 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:05.062391 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:05.062391 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:05.062391 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:05.063245 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:05.063245 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:05.063245 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:05.063245 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:05.063245 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:05.063245 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:05.063245 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:05.063245 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:05.063245 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:05.063245 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:05.063245 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:24:05.063245 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:24:05.063245 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:24:05.063245 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:05.071165 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 487/965] 10.222.0.32 () {56 vars in 1126 bytes} [Thu Jun 2 13:24:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:24:05.072386 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800174fb-6ec0-43fd-bc58-e62db113be6a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:05.112824 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634be4cf-183b-4a6a-9c17-499c085ea87b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:05.157690 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6dc442-358f-4f32-9869-5245af90fb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:05.158511 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6dc442-358f-4f32-9869-5245af90fb74 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:05.158796 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6dc442-358f-4f32-9869-5245af90fb74 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:05.159073 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6dc442-358f-4f32-9869-5245af90fb74 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:05.173200 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6dc442-358f-4f32-9869-5245af90fb74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:24:05.185910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-5d6dc442-358f-4f32-9869-5245af90fb74 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:24:05.185910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:05.185910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:05.185910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:05.185910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:05.185910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:05.185910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:05.185910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:05.185910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:05.185910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:05.185910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:05.185910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:05.185910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:24:05.185910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:24:05.185910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:24:05.185910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:24:05.186879 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:24:05.186879 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:24:05.186879 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:24:05.186879 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:24:05.186879 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:05.186879 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:05.186879 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:05.186879 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:05.186879 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:05.186879 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:05.186879 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:05.186879 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:05.186879 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:05.186879 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:05.186879 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:05.186879 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:05.187725 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:05.187725 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:05.187725 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:05.187725 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:05.187725 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:24:05.187725 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:24:05.187725 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:24:05.187725 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:24:05.187725 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:24:05.187725 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:24:05.187725 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:24:05.187725 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:24:05.190513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800174fb-6ec0-43fd-bc58-e62db113be6a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:05.192061 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 479/966] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Jun 2 13:24:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:24:05.193161 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6dc442-358f-4f32-9869-5245af90fb74 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:05.231592 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4fed8-456b-4eb4-91e3-daa6a06ba2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:05.232657 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4fed8-456b-4eb4-91e3-daa6a06ba2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:05.233177 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4fed8-456b-4eb4-91e3-daa6a06ba2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:05.233751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4fed8-456b-4eb4-91e3-daa6a06ba2e6 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:05.234786 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4fed8-456b-4eb4-91e3-daa6a06ba2e6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:05.235322 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4fed8-456b-4eb4-91e3-daa6a06ba2e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:05.236940 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4fed8-456b-4eb4-91e3-daa6a06ba2e6 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:05.248539 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 488/967] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Jun 2 13:24:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:05.249725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4fed8-456b-4eb4-91e3-daa6a06ba2e6 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:05.253123 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:05.295460 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:05.319418 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6dc442-358f-4f32-9869-5245af90fb74 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:05.361632 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd0740-ee5b-4308-abbe-b25054891887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:05.362706 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd0740-ee5b-4308-abbe-b25054891887 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:05.363219 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd0740-ee5b-4308-abbe-b25054891887 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:05.363704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd0740-ee5b-4308-abbe-b25054891887 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:05.364707 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd0740-ee5b-4308-abbe-b25054891887 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:05.365329 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd0740-ee5b-4308-abbe-b25054891887 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:05.366927 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd0740-ee5b-4308-abbe-b25054891887 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:05.377271 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 480/968] 10.222.0.32 () {56 vars in 1115 bytes} [Thu Jun 2 13:24:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:05.383245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd0740-ee5b-4308-abbe-b25054891887 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:05.385756 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4fed8-456b-4eb4-91e3-daa6a06ba2e6 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:05.425489 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e579c87-a31d-4f60-8ca3-8a986718a5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:05.426649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e579c87-a31d-4f60-8ca3-8a986718a5ca None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:05.427143 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e579c87-a31d-4f60-8ca3-8a986718a5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:05.427623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e579c87-a31d-4f60-8ca3-8a986718a5ca None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:05.428698 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e579c87-a31d-4f60-8ca3-8a986718a5ca None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:05.429227 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e579c87-a31d-4f60-8ca3-8a986718a5ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:05.430967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e579c87-a31d-4f60-8ca3-8a986718a5ca None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:05.441698 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 489/969] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Jun 2 13:24:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:05.442977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e579c87-a31d-4f60-8ca3-8a986718a5ca None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:05.490776 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd0740-ee5b-4308-abbe-b25054891887 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:05.528812 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:05.539012 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1687a-8fdc-4daa-bf2e-eb843b531b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:05.540365 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1687a-8fdc-4daa-bf2e-eb843b531b19 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:05.540651 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1687a-8fdc-4daa-bf2e-eb843b531b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:05.540927 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1687a-8fdc-4daa-bf2e-eb843b531b19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:05.553735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1687a-8fdc-4daa-bf2e-eb843b531b19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:05.555215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1687a-8fdc-4daa-bf2e-eb843b531b19 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:05.557553 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:05.575235 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e579c87-a31d-4f60-8ca3-8a986718a5ca None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:05.576235 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-fec1687a-8fdc-4daa-bf2e-eb843b531b19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:24:05.576235 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:05.576235 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:05.576235 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:05.576235 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:05.576235 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:05.576235 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:05.576235 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:05.576235 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:05.576235 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:05.576235 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:05.576235 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:05.576235 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:24:05.576235 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:24:05.576235 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:24:05.577120 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:24:05.577120 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:05.577120 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:05.577120 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:05.577120 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:05.577120 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:05.577120 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:05.577120 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:05.577120 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:05.577120 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:05.577120 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:05.577120 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:05.577120 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:05.577120 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:05.577120 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:05.577120 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:05.577120 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:05.578042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:24:05.578042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:24:05.578042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:24:05.578042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:24:05.582248 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 481/970] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:24:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:05.583270 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1687a-8fdc-4daa-bf2e-eb843b531b19 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:05.617922 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8622b9-920c-4f47-9bd3-bdc1ee8f24bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:05.618955 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8622b9-920c-4f47-9bd3-bdc1ee8f24bd None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:05.619384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8622b9-920c-4f47-9bd3-bdc1ee8f24bd None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:05.620118 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8622b9-920c-4f47-9bd3-bdc1ee8f24bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:05.621788 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8622b9-920c-4f47-9bd3-bdc1ee8f24bd None admin] RBAC: Adding query filter params (interface=admin, service_id=3c101db5fa0441ce947c2097902bf13b, region_id=RegionOne) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:05.622545 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8622b9-920c-4f47-9bd3-bdc1ee8f24bd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:05.624947 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8622b9-920c-4f47-9bd3-bdc1ee8f24bd None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:05.631031 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 490/971] 10.222.0.32 () {56 vars in 1249 bytes} [Thu Jun 2 13:24:05 2022] GET /identity/v3/endpoints?service_id=3c101db5fa0441ce947c2097902bf13b&interface=admin®ion_id=RegionOne => generated 193 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:05.638269 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8622b9-920c-4f47-9bd3-bdc1ee8f24bd None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:05.688435 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1687a-8fdc-4daa-bf2e-eb843b531b19 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:05.723263 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc0c1a-fe3a-4240-996d-0eee917898e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:05.723927 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc0c1a-fe3a-4240-996d-0eee917898e8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:05.724213 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc0c1a-fe3a-4240-996d-0eee917898e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:05.724525 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc0c1a-fe3a-4240-996d-0eee917898e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:05.725245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc0c1a-fe3a-4240-996d-0eee917898e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:05.725552 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc0c1a-fe3a-4240-996d-0eee917898e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:05.727049 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc0c1a-fe3a-4240-996d-0eee917898e8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:05.739102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 482/972] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:05.740384 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f524d0-df4f-4a1d-9050-362a801bfa9b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:05.740673 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f524d0-df4f-4a1d-9050-362a801bfa9b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:05.740952 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f524d0-df4f-4a1d-9050-362a801bfa9b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:05.742347 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 483/973] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:05.745096 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f524d0-df4f-4a1d-9050-362a801bfa9b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:05.757405 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8622b9-920c-4f47-9bd3-bdc1ee8f24bd None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:05.789021 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:05.796979 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b0130-c1ae-4ec1-8e68-513fbbc0106b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:05.797634 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b0130-c1ae-4ec1-8e68-513fbbc0106b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:05.797915 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b0130-c1ae-4ec1-8e68-513fbbc0106b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:05.798190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b0130-c1ae-4ec1-8e68-513fbbc0106b None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:05.798870 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b0130-c1ae-4ec1-8e68-513fbbc0106b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:05.800221 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b0130-c1ae-4ec1-8e68-513fbbc0106b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:05.807977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 491/974] 10.222.0.32 () {56 vars in 1087 bytes} [Thu Jun 2 13:24:05 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:24:05.809436 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafc511-9b95-480b-901a-6977f2ad2e8e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:05.809725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafc511-9b95-480b-901a-6977f2ad2e8e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:05.809999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafc511-9b95-480b-901a-6977f2ad2e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:05.823753 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:05.829074 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-0aafc511-9b95-480b-901a-6977f2ad2e8e None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:05.830555 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0aafc511-9b95-480b-901a-6977f2ad2e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:05.883736 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f524d0-df4f-4a1d-9050-362a801bfa9b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:05.906164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 492/975] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:24:05.907612 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9700b-4428-48a5-9fb8-e68a63503581 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:05.907904 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9700b-4428-48a5-9fb8-e68a63503581 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:05.908381 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9700b-4428-48a5-9fb8-e68a63503581 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:05.910002 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 493/976] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:05.915863 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa5058-d5a7-403a-9ddf-ee931f7c1c83 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:05.916190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa5058-d5a7-403a-9ddf-ee931f7c1c83 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:05.917295 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa5058-d5a7-403a-9ddf-ee931f7c1c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:05.936902 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-abfa5058-d5a7-403a-9ddf-ee931f7c1c83 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:05.938118 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-abfa5058-d5a7-403a-9ddf-ee931f7c1c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:05.938815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de60f5-b5b8-4b41-92d2-8462db2991b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:05.939753 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de60f5-b5b8-4b41-92d2-8462db2991b5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:05.940323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de60f5-b5b8-4b41-92d2-8462db2991b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:05.940479 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de60f5-b5b8-4b41-92d2-8462db2991b5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:05.949307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de60f5-b5b8-4b41-92d2-8462db2991b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:05.950896 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de60f5-b5b8-4b41-92d2-8462db2991b5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:05.967514 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b8de60f5-b5b8-4b41-92d2-8462db2991b5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:24:05.967514 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:05.967514 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:05.967514 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:05.967514 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:05.967514 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:05.967514 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:05.967514 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:05.967514 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:05.967514 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:05.967514 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:05.967514 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:05.967514 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:24:05.967514 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:24:05.967514 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:24:05.967514 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:24:05.968595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:05.968595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:05.968595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:24:05.968595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:24:05.968595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:24:05.968595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:24:05.968595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:05.968595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:05.968595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:05.968595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:05.968595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:05.968595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:05.968595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:05.968595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:05.968595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:05.968595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:05.968595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:05.968595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:05.969557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:05.969557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:05.969557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:24:05.969557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:24:05.969557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:24:05.969557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:24:05.969557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:24:05.969557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:24:05.969557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:24:05.969557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:24:05.969557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 484/977] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Jun 2 13:24:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:05.970182 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de60f5-b5b8-4b41-92d2-8462db2991b5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:06.036354 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 494/978] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:24:06.036354 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa5058-d5a7-403a-9ddf-ee931f7c1c83 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:06.087782 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de60f5-b5b8-4b41-92d2-8462db2991b5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:06.100256 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:06.103913 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:06.129846 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47a894-0a4a-44e6-9127-e86f4dd0f170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:06.130522 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47a894-0a4a-44e6-9127-e86f4dd0f170 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:06.130805 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47a894-0a4a-44e6-9127-e86f4dd0f170 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:06.131085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47a894-0a4a-44e6-9127-e86f4dd0f170 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:06.131786 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47a894-0a4a-44e6-9127-e86f4dd0f170 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:06.133842 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47a894-0a4a-44e6-9127-e86f4dd0f170 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:06.135150 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: WARNING keystone.server.flask.common [None req-ff47a894-0a4a-44e6-9127-e86f4dd0f170 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 02 13:24:06.147048 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.sql.core [None req-ff47a894-0a4a-44e6-9127-e86f4dd0f170 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 13:24:06.147048 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 02 13:24:06.147048 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [parameters: {'user_id': 'c5502a9d9c824364ab32ac80e932b4f2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 02 13:24:06.147048 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80181) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 13:24:06.150478 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa5058-d5a7-403a-9ddf-ee931f7c1c83 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:06.163631 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ff47a894-0a4a-44e6-9127-e86f4dd0f170 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 02 13:24:06.163631 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:06.163631 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 13:24:06.163631 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 13:24:06.163631 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 13:24:06.163631 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 13:24:06.163631 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 13:24:06.163631 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 13:24:06.163631 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 13:24:06.163631 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application conn.query(q) Jun 02 13:24:06.163631 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 13:24:06.163631 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 13:24:06.163631 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 13:24:06.163631 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application result.read() Jun 02 13:24:06.163631 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 13:24:06.164685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 13:24:06.164685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 13:24:06.164685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 13:24:06.164685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 13:24:06.164685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 13:24:06.164685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 13:24:06.164685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 13:24:06.164685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 13:24:06.164685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:24:06.164685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 13:24:06.164685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:24:06.164685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:06.164685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 13:24:06.164685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 13:24:06.164685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 02 13:24:06.164685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 02 13:24:06.164685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 13:24:06.164685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application next(self.gen) Jun 02 13:24:06.165702 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 13:24:06.165702 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application yield resource Jun 02 13:24:06.165702 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 13:24:06.165702 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application next(self.gen) Jun 02 13:24:06.165702 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 13:24:06.165702 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 13:24:06.165702 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 13:24:06.165702 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 13:24:06.165702 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 13:24:06.165702 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise self.value Jun 02 13:24:06.165702 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 13:24:06.165702 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 13:24:06.165702 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 13:24:06.165702 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application session.commit() Jun 02 13:24:06.165702 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 13:24:06.165702 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 13:24:06.165702 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 13:24:06.167229 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 13:24:06.167229 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 13:24:06.167229 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.session.flush() Jun 02 13:24:06.167229 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 13:24:06.167229 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 13:24:06.167229 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 13:24:06.167229 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 13:24:06.167229 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 13:24:06.167229 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application compat.raise_( Jun 02 13:24:06.167229 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 13:24:06.167229 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception Jun 02 13:24:06.167229 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 13:24:06.167229 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 13:24:06.167229 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 13:24:06.167229 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 13:24:06.167229 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 13:24:06.167229 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 13:24:06.168452 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 13:24:06.168452 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 13:24:06.168452 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 02 13:24:06.168452 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 02 13:24:06.168452 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 13:24:06.168452 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 13:24:06.168452 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 13:24:06.168452 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 13:24:06.168452 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 13:24:06.168452 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 13:24:06.168452 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 13:24:06.168452 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 13:24:06.168452 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 13:24:06.168452 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 13:24:06.168452 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 13:24:06.168452 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception Jun 02 13:24:06.169331 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 13:24:06.169331 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 13:24:06.169331 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 13:24:06.169331 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 13:24:06.169331 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 13:24:06.169331 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 13:24:06.169331 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 13:24:06.169331 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application conn.query(q) Jun 02 13:24:06.169331 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 13:24:06.169331 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 13:24:06.169331 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 13:24:06.169331 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application result.read() Jun 02 13:24:06.169331 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 13:24:06.169331 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 13:24:06.169331 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 13:24:06.169331 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 13:24:06.172102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 13:24:06.172102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 13:24:06.172102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 13:24:06.172102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 13:24:06.172102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 13:24:06.172102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 02 13:24:06.172102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c5502a9d9c824364ab32ac80e932b4f2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 02 13:24:06.172102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 13:24:06.172102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:24:06.172102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:24:06.172102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:24:06.172102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:06.172102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:06.172102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:06.172102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:06.174225 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:06.174225 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:06.174225 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:06.174225 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:06.174225 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:06.174225 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:06.174225 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:06.174225 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 02 13:24:06.174225 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 02 13:24:06.174225 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:06.174225 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:06.174225 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:24:06.174225 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:24:06.174225 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:24:06.174225 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:24:06.174225 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 02 13:24:06.174225 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 02 13:24:06.176787 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 02 13:24:06.176787 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 02 13:24:06.176787 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 13:24:06.176787 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 13:24:06.176787 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 02 13:24:06.176787 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:24:06.176787 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 485/979] 10.222.0.32 () {60 vars in 1131 bytes} [Thu Jun 2 13:24:05 2022] POST /identity/v3/users => generated 160 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:06.176787 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47a894-0a4a-44e6-9127-e86f4dd0f170 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:06.196469 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1e988-64ae-4014-ae42-4c0531bd43da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:06.197224 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1e988-64ae-4014-ae42-4c0531bd43da None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:06.197575 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1e988-64ae-4014-ae42-4c0531bd43da None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:06.197908 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1e988-64ae-4014-ae42-4c0531bd43da None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:06.198817 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1e988-64ae-4014-ae42-4c0531bd43da None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:06.199191 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1e988-64ae-4014-ae42-4c0531bd43da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:06.200715 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1e988-64ae-4014-ae42-4c0531bd43da None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:06.219224 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 495/980] 10.222.0.32 () {56 vars in 1149 bytes} [Thu Jun 2 13:24:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:06.224611 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1e988-64ae-4014-ae42-4c0531bd43da None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:06.279888 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47a894-0a4a-44e6-9127-e86f4dd0f170 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:06.319856 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06aac7-dbaa-4040-bed3-a7e3ee186928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:06.320822 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06aac7-dbaa-4040-bed3-a7e3ee186928 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:06.321432 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06aac7-dbaa-4040-bed3-a7e3ee186928 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:06.321888 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06aac7-dbaa-4040-bed3-a7e3ee186928 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:06.322835 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd06aac7-dbaa-4040-bed3-a7e3ee186928 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:06.324625 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd06aac7-dbaa-4040-bed3-a7e3ee186928 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:06.324898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1e988-64ae-4014-ae42-4c0531bd43da None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:06.340320 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:06.345073 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 486/981] 10.222.0.32 () {60 vars in 1141 bytes} [Thu Jun 2 13:24:06 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:24:06.346113 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06aac7-dbaa-4040-bed3-a7e3ee186928 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:06.379863 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3393ea-593b-4e3d-9e44-10397546e72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:06.381214 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3393ea-593b-4e3d-9e44-10397546e72b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:06.381544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3393ea-593b-4e3d-9e44-10397546e72b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:06.381825 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3393ea-593b-4e3d-9e44-10397546e72b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:06.393143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:06.394080 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3393ea-593b-4e3d-9e44-10397546e72b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:06.395565 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3393ea-593b-4e3d-9e44-10397546e72b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:06.418761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-3c3393ea-593b-4e3d-9e44-10397546e72b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:24:06.418761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:06.418761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:06.418761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:06.418761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:06.418761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:06.418761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:06.418761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:06.418761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:06.418761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:06.418761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:06.418761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:06.418761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:24:06.418761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:24:06.418761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:24:06.418761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:24:06.419995 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:06.419995 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:06.419995 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:24:06.419995 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:24:06.419995 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:24:06.419995 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:24:06.419995 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:06.419995 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:06.419995 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:06.419995 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:06.419995 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:06.419995 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:06.419995 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:06.419995 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:06.419995 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:06.419995 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:06.419995 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:06.419995 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:06.421314 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:06.421314 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:06.421314 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:24:06.421314 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:24:06.421314 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:24:06.421314 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:24:06.421314 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:24:06.421314 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:24:06.421314 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:24:06.421314 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:06.424609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 496/982] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:24:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:06.426070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3393ea-593b-4e3d-9e44-10397546e72b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:06.484927 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06aac7-dbaa-4040-bed3-a7e3ee186928 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:06.524941 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583f738-b2d9-4135-bdbe-5322667e29f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:06.525943 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583f738-b2d9-4135-bdbe-5322667e29f0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:06.526448 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583f738-b2d9-4135-bdbe-5322667e29f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:06.526880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583f738-b2d9-4135-bdbe-5322667e29f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:06.544846 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3393ea-593b-4e3d-9e44-10397546e72b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:06.594960 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a90c2-a5ce-42bd-8599-894996a8ee75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:06.595663 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a90c2-a5ce-42bd-8599-894996a8ee75 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:06.596011 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a90c2-a5ce-42bd-8599-894996a8ee75 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:06.597413 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a90c2-a5ce-42bd-8599-894996a8ee75 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:06.597413 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a90c2-a5ce-42bd-8599-894996a8ee75 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:06.597586 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a90c2-a5ce-42bd-8599-894996a8ee75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:06.598998 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a90c2-a5ce-42bd-8599-894996a8ee75 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:06.619463 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b583f738-b2d9-4135-bdbe-5322667e29f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:06.620974 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b583f738-b2d9-4135-bdbe-5322667e29f0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:06.638823 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 497/983] 10.222.0.32 () {56 vars in 1101 bytes} [Thu Jun 2 13:24:06 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:24:06.663131 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:06.748436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 487/984] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:24:06 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:24:06.751084 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a90c2-a5ce-42bd-8599-894996a8ee75 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:06.785076 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:06.862865 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a90c2-a5ce-42bd-8599-894996a8ee75 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:06.902437 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be77c5-cd7f-4e85-bfb8-edec1433779d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:06.903238 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be77c5-cd7f-4e85-bfb8-edec1433779d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:06.903523 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be77c5-cd7f-4e85-bfb8-edec1433779d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:06.903803 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be77c5-cd7f-4e85-bfb8-edec1433779d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:06.915264 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be77c5-cd7f-4e85-bfb8-edec1433779d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:06.916790 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be77c5-cd7f-4e85-bfb8-edec1433779d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:06.935375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-65be77c5-cd7f-4e85-bfb8-edec1433779d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:24:06.935375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:06.935375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:06.935375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:06.935375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:06.935375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:06.935375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:06.935375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:06.935375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:06.935375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:06.935375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:06.935375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:06.935375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:24:06.935375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:24:06.935375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:24:06.936384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:24:06.936384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:06.936384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:06.936384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:06.936384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:06.936384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:06.936384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:06.936384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:06.936384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:06.936384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:06.936384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:06.936384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:06.936384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:06.936384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:06.936384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:06.936384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:06.936384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:06.937559 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:24:06.937559 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:24:06.937559 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:24:06.937559 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:06.937559 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 498/985] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:06.944154 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583f738-b2d9-4135-bdbe-5322667e29f0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:07.054579 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583f738-b2d9-4135-bdbe-5322667e29f0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:07.090447 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576993a-c3ad-4c0e-b68c-d89ff668d442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:07.091109 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576993a-c3ad-4c0e-b68c-d89ff668d442 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:07.091389 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576993a-c3ad-4c0e-b68c-d89ff668d442 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:07.091658 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576993a-c3ad-4c0e-b68c-d89ff668d442 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:07.092426 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576993a-c3ad-4c0e-b68c-d89ff668d442 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:07.092700 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576993a-c3ad-4c0e-b68c-d89ff668d442 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:07.094058 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576993a-c3ad-4c0e-b68c-d89ff668d442 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:07.096917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:07.111357 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 488/986] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:07.113124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be77c5-cd7f-4e85-bfb8-edec1433779d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:07.192931 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:07.217019 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be77c5-cd7f-4e85-bfb8-edec1433779d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:07.250118 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d5bc2-8426-4870-b3a8-5b88ccf1d7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:07.250899 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d5bc2-8426-4870-b3a8-5b88ccf1d7fe None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:07.251188 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d5bc2-8426-4870-b3a8-5b88ccf1d7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:07.251468 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d5bc2-8426-4870-b3a8-5b88ccf1d7fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:07.258644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d5bc2-8426-4870-b3a8-5b88ccf1d7fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:07.260093 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d5bc2-8426-4870-b3a8-5b88ccf1d7fe None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:07.273574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-807d5bc2-8426-4870-b3a8-5b88ccf1d7fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:24:07.273574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:07.273574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:07.273574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:07.273574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:07.273574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:07.273574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:07.273574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:07.273574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:07.273574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:07.273574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:07.273574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:07.273574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:24:07.273574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:24:07.273574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:24:07.275067 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:24:07.275067 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:07.275067 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:07.275067 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:07.275067 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:07.275067 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:07.275067 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:07.275067 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:07.275067 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:07.275067 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:07.275067 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:07.275067 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:07.275067 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:07.275067 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:07.275067 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:07.275067 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:07.275067 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:07.275955 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:24:07.275955 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:24:07.275955 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:24:07.275955 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:24:07.275955 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:24:07.275955 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:24:07.275955 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:24:07.275955 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:07.280141 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 499/987] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:24:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:24:07.281376 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576993a-c3ad-4c0e-b68c-d89ff668d442 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:07.382238 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576993a-c3ad-4c0e-b68c-d89ff668d442 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:07.414988 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccd27e-582a-463b-9dc3-f098c3b41794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:07.415640 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccd27e-582a-463b-9dc3-f098c3b41794 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:07.415922 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccd27e-582a-463b-9dc3-f098c3b41794 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:07.416197 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccd27e-582a-463b-9dc3-f098c3b41794 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:07.416998 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccd27e-582a-463b-9dc3-f098c3b41794 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:07.417306 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccd27e-582a-463b-9dc3-f098c3b41794 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:07.418732 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccd27e-582a-463b-9dc3-f098c3b41794 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:07.431349 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 489/988] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:24:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:07.437170 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d5bc2-8426-4870-b3a8-5b88ccf1d7fe None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:07.538318 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d5bc2-8426-4870-b3a8-5b88ccf1d7fe None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:07.572532 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61d8e6-a61e-4eb4-a952-f1c98b7ed8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:07.573183 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61d8e6-a61e-4eb4-a952-f1c98b7ed8cd None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:07.573464 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61d8e6-a61e-4eb4-a952-f1c98b7ed8cd None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:07.573739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61d8e6-a61e-4eb4-a952-f1c98b7ed8cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:07.574575 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61d8e6-a61e-4eb4-a952-f1c98b7ed8cd None admin] RBAC: Adding query filter params (role.id=f1346f1c619e4ab48ac6d21faa94c720, scope.project.id=a9007447059e4862972078c032a5d67b, user.id=bbcd5ba866b84d099d183fe19ba61a4f) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:07.574888 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61d8e6-a61e-4eb4-a952-f1c98b7ed8cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:07.576323 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61d8e6-a61e-4eb4-a952-f1c98b7ed8cd None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:07.588611 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 500/989] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:24:07 2022] GET /identity/v3/role_assignments?user.id=bbcd5ba866b84d099d183fe19ba61a4f&scope.project.id=a9007447059e4862972078c032a5d67b&role.id=f1346f1c619e4ab48ac6d21faa94c720 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:08.077051 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da114b-2330-4c69-a74d-6216958bb43a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:08.077597 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da114b-2330-4c69-a74d-6216958bb43a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:08.077597 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da114b-2330-4c69-a74d-6216958bb43a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:08.079146 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 490/990] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:08.084144 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccac974-800c-4d94-8af3-a9499d4960f1 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:08.084575 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccac974-800c-4d94-8af3-a9499d4960f1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:08.084745 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccac974-800c-4d94-8af3-a9499d4960f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:08.090605 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:08.103216 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6ccac974-800c-4d94-8af3-a9499d4960f1 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:08.104438 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6ccac974-800c-4d94-8af3-a9499d4960f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:08.171866 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 501/991] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:24:08.194097 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da114b-2330-4c69-a74d-6216958bb43a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:08.252377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:08.298501 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da114b-2330-4c69-a74d-6216958bb43a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:08.332476 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826c552-63d1-4e65-9330-d928df473736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:08.333319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826c552-63d1-4e65-9330-d928df473736 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:08.333600 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826c552-63d1-4e65-9330-d928df473736 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:08.333870 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826c552-63d1-4e65-9330-d928df473736 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:08.334521 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826c552-63d1-4e65-9330-d928df473736 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:08.336724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826c552-63d1-4e65-9330-d928df473736 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:08.348870 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-a826c552-63d1-4e65-9330-d928df473736 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:24:08.348870 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:08.348870 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:24:08.348870 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:24:08.348870 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:24:08.348870 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:24:08.348870 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:24:08.348870 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:24:08.348870 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:24:08.348870 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:24:08.348870 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:24:08.348870 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:24:08.348870 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:08.348870 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:08.348870 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:08.348870 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:08.348870 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:08.349883 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:08.349883 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:08.349883 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:08.349883 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:08.349883 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:08.349883 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:08.349883 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:24:08.349883 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:24:08.349883 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:24:08.349883 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:24:08.349883 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:08.349883 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:08.349883 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:08.349883 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:08.349883 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:08.349883 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:08.350726 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:08.350726 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:08.350726 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:08.350726 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:08.350726 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:08.350726 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:08.350726 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:08.350726 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:08.350726 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:08.350726 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:08.350726 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:24:08.350726 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:24:08.350726 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:24:08.350726 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:24:08.352690 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 491/992] 10.222.0.32 () {56 vars in 1126 bytes} [Thu Jun 2 13:24:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:08.356725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccac974-800c-4d94-8af3-a9499d4960f1 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:08.459601 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccac974-800c-4d94-8af3-a9499d4960f1 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:08.488917 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:08.494895 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04196fa-a4d4-41e2-bb9d-5c28512955ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:08.495558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04196fa-a4d4-41e2-bb9d-5c28512955ed None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:08.495840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04196fa-a4d4-41e2-bb9d-5c28512955ed None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:08.496119 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04196fa-a4d4-41e2-bb9d-5c28512955ed None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:08.497087 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04196fa-a4d4-41e2-bb9d-5c28512955ed None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:08.497396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04196fa-a4d4-41e2-bb9d-5c28512955ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:08.498755 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04196fa-a4d4-41e2-bb9d-5c28512955ed None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:08.508541 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 502/993] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Jun 2 13:24:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:24:08.510133 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826c552-63d1-4e65-9330-d928df473736 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:08.610383 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826c552-63d1-4e65-9330-d928df473736 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:08.629759 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:08.645568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec041ad-4a90-4241-8ea2-c988093b0091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:08.646225 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec041ad-4a90-4241-8ea2-c988093b0091 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:08.646504 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec041ad-4a90-4241-8ea2-c988093b0091 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:08.646777 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec041ad-4a90-4241-8ea2-c988093b0091 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:08.647475 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec041ad-4a90-4241-8ea2-c988093b0091 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:08.647779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec041ad-4a90-4241-8ea2-c988093b0091 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:08.649741 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec041ad-4a90-4241-8ea2-c988093b0091 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:08.654840 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 492/994] 10.222.0.32 () {56 vars in 1122 bytes} [Thu Jun 2 13:24:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:08.660233 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04196fa-a4d4-41e2-bb9d-5c28512955ed None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:08.731055 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8739764-f2fa-437f-83d3-52bd3ee53c8e None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:08.731378 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8739764-f2fa-437f-83d3-52bd3ee53c8e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:08.731608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8739764-f2fa-437f-83d3-52bd3ee53c8e None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:08.733130 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 493/995] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:24:08.737904 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7521970-91d2-42fd-99bb-274fa5f284ae None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:08.738196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7521970-91d2-42fd-99bb-274fa5f284ae None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:08.738476 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7521970-91d2-42fd-99bb-274fa5f284ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:08.757239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d7521970-91d2-42fd-99bb-274fa5f284ae None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:08.759633 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d7521970-91d2-42fd-99bb-274fa5f284ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:08.761948 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04196fa-a4d4-41e2-bb9d-5c28512955ed None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:08.798223 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca873f-6df3-407b-87a0-e3d2af420ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:08.798872 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca873f-6df3-407b-87a0-e3d2af420ec0 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:08.799159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca873f-6df3-407b-87a0-e3d2af420ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:08.799433 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca873f-6df3-407b-87a0-e3d2af420ec0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:08.800186 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca873f-6df3-407b-87a0-e3d2af420ec0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:08.801579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca873f-6df3-407b-87a0-e3d2af420ec0 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:08.819573 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 503/996] 10.222.0.32 () {60 vars in 1144 bytes} [Thu Jun 2 13:24:08 2022] POST /identity/v3/endpoints => generated 325 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:24:08.850392 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 494/997] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:08 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:24:08.873962 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca873f-6df3-407b-87a0-e3d2af420ec0 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:08.937088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:08.986697 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca873f-6df3-407b-87a0-e3d2af420ec0 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:09.029789 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c71751-5f01-48fa-b1bd-cded4f08f3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:09.030798 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c71751-5f01-48fa-b1bd-cded4f08f3a8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:09.031244 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c71751-5f01-48fa-b1bd-cded4f08f3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:09.031522 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c71751-5f01-48fa-b1bd-cded4f08f3a8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:09.032184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c71751-5f01-48fa-b1bd-cded4f08f3a8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:09.033739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c71751-5f01-48fa-b1bd-cded4f08f3a8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:09.046204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-a7c71751-5f01-48fa-b1bd-cded4f08f3a8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:24:09.046204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:09.046204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:24:09.046204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:24:09.046204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:24:09.046204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:24:09.046204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:24:09.046204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:24:09.046204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:24:09.046204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:09.046204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:24:09.046204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:09.046204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:09.046204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:09.046204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:09.046204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:09.046204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:09.047431 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:09.047431 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:09.047431 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:09.047431 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:09.047431 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:09.047431 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:09.047431 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:24:09.047431 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:24:09.047431 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:24:09.047431 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:24:09.047431 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:09.047431 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:09.047431 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:09.047431 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:09.047431 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:09.047431 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:09.048475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:09.048475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:09.048475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:09.048475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:09.048475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:09.048475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:09.048475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:09.048475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:09.048475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:09.048475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:09.048475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:24:09.048475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:24:09.048475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:24:09.048475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:09.048475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 504/998] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:24:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:09.054308 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7521970-91d2-42fd-99bb-274fa5f284ae None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:09.155932 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7521970-91d2-42fd-99bb-274fa5f284ae None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:09.167252 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:09.192181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31bc34-ad50-44c3-8d91-c718a7759b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:09.192881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31bc34-ad50-44c3-8d91-c718a7759b37 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:09.193166 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31bc34-ad50-44c3-8d91-c718a7759b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:09.193444 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31bc34-ad50-44c3-8d91-c718a7759b37 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:09.194151 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31bc34-ad50-44c3-8d91-c718a7759b37 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:09.194458 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31bc34-ad50-44c3-8d91-c718a7759b37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:09.196359 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31bc34-ad50-44c3-8d91-c718a7759b37 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:09.201548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 495/999] 10.222.0.32 () {56 vars in 1112 bytes} [Thu Jun 2 13:24:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:09.207378 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c71751-5f01-48fa-b1bd-cded4f08f3a8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:09.308491 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c71751-5f01-48fa-b1bd-cded4f08f3a8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:09.328484 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:09.344496 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220ea86-ee40-4938-ae42-8f942148e107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:09.345159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220ea86-ee40-4938-ae42-8f942148e107 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:09.345442 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220ea86-ee40-4938-ae42-8f942148e107 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:09.345717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220ea86-ee40-4938-ae42-8f942148e107 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:09.346428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7220ea86-ee40-4938-ae42-8f942148e107 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:09.346735 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7220ea86-ee40-4938-ae42-8f942148e107 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:09.348106 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7220ea86-ee40-4938-ae42-8f942148e107 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:09.353446 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 505/1000] 10.222.0.32 () {56 vars in 1112 bytes} [Thu Jun 2 13:24:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:24:09.359364 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31bc34-ad50-44c3-8d91-c718a7759b37 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:09.460409 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31bc34-ad50-44c3-8d91-c718a7759b37 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:09.494347 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ade5a1-d8b3-44e2-a37c-7746afb6296c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:09.495002 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ade5a1-d8b3-44e2-a37c-7746afb6296c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:09.495286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ade5a1-d8b3-44e2-a37c-7746afb6296c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:09.495560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ade5a1-d8b3-44e2-a37c-7746afb6296c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:09.496368 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ade5a1-d8b3-44e2-a37c-7746afb6296c None admin] RBAC: Adding query filter params (interface=public, service_id=65637c036c264c8a806fdda9ed17801a, region_id=RegionOne) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:09.496683 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ade5a1-d8b3-44e2-a37c-7746afb6296c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:09.498054 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ade5a1-d8b3-44e2-a37c-7746afb6296c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:09.507702 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 496/1001] 10.222.0.32 () {56 vars in 1251 bytes} [Thu Jun 2 13:24:09 2022] GET /identity/v3/endpoints?service_id=65637c036c264c8a806fdda9ed17801a&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:09.509626 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220ea86-ee40-4938-ae42-8f942148e107 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:09.615911 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220ea86-ee40-4938-ae42-8f942148e107 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:09.649489 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3025fa7-5265-4da5-81f9-24bfb0a021d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:09.650146 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3025fa7-5265-4da5-81f9-24bfb0a021d0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:09.650429 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3025fa7-5265-4da5-81f9-24bfb0a021d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:09.650699 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3025fa7-5265-4da5-81f9-24bfb0a021d0 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:09.651378 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3025fa7-5265-4da5-81f9-24bfb0a021d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:09.652779 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3025fa7-5265-4da5-81f9-24bfb0a021d0 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:09.668331 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 506/1002] 10.222.0.32 () {56 vars in 1087 bytes} [Thu Jun 2 13:24:09 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:24:09.899636 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d71ae3-8e20-422a-a797-be5a906068bb None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:09.899971 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d71ae3-8e20-422a-a797-be5a906068bb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:09.900206 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d71ae3-8e20-422a-a797-be5a906068bb None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:09.901757 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 497/1003] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:09.906789 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba0e48-81cc-43dc-a07d-6f9e3454b3b2 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:09.907091 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba0e48-81cc-43dc-a07d-6f9e3454b3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:09.907380 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba0e48-81cc-43dc-a07d-6f9e3454b3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:09.923979 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-17ba0e48-81cc-43dc-a07d-6f9e3454b3b2 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:09.925213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-17ba0e48-81cc-43dc-a07d-6f9e3454b3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:09.972207 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:09.997952 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 507/1004] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:09 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:24:10.020042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d71ae3-8e20-422a-a797-be5a906068bb None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:10.063114 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:10.127700 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d71ae3-8e20-422a-a797-be5a906068bb None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:10.163110 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f889e-f49d-4e74-8644-003bffce5c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:10.163882 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f889e-f49d-4e74-8644-003bffce5c52 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:10.164180 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f889e-f49d-4e74-8644-003bffce5c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:10.165021 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f889e-f49d-4e74-8644-003bffce5c52 None admin] PATH_INFO: `/v3/services/image` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:10.165679 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f889e-f49d-4e74-8644-003bffce5c52 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:10.167064 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f889e-f49d-4e74-8644-003bffce5c52 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:10.178615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b98f889e-f49d-4e74-8644-003bffce5c52 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:24:10.178615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:10.178615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:24:10.178615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:24:10.178615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:24:10.178615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:24:10.178615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:24:10.178615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:24:10.178615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:24:10.178615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:24:10.178615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:24:10.178615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:24:10.178615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:10.178615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:10.178615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:10.178615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:10.178615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:10.179742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:10.179742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:10.179742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:10.179742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:10.179742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:10.179742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:10.179742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:24:10.179742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:24:10.179742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:24:10.179742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:24:10.179742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:10.179742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:10.179742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:10.179742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:10.179742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:10.179742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:10.181520 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:10.181520 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:10.181520 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:10.181520 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:10.181520 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:10.181520 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:10.181520 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:10.181520 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:10.181520 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:10.181520 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:10.181520 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:24:10.181520 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:24:10.181520 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:24:10.181520 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:24:10.184386 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 498/1005] 10.222.0.32 () {56 vars in 1105 bytes} [Thu Jun 2 13:24:10 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:10.185889 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba0e48-81cc-43dc-a07d-6f9e3454b3b2 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:10.288399 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba0e48-81cc-43dc-a07d-6f9e3454b3b2 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:10.322591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c3dcb-3854-46af-a728-abb8e917e186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:10.323394 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c3dcb-3854-46af-a728-abb8e917e186 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:10.323784 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c3dcb-3854-46af-a728-abb8e917e186 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:10.324163 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c3dcb-3854-46af-a728-abb8e917e186 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:10.325009 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c3dcb-3854-46af-a728-abb8e917e186 None admin] RBAC: Adding query filter params (name=image) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:10.325422 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c3dcb-3854-46af-a728-abb8e917e186 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:10.326881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c3dcb-3854-46af-a728-abb8e917e186 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:10.337087 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 508/1006] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:24:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:10.338354 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f889e-f49d-4e74-8644-003bffce5c52 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:10.440444 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f889e-f49d-4e74-8644-003bffce5c52 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:10.442018 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:10.476280 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f561a4-1ec5-4c1b-a209-42b55d55b915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:10.477126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f561a4-1ec5-4c1b-a209-42b55d55b915 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:10.477480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f561a4-1ec5-4c1b-a209-42b55d55b915 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:10.477829 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f561a4-1ec5-4c1b-a209-42b55d55b915 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:10.478603 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f561a4-1ec5-4c1b-a209-42b55d55b915 None admin] RBAC: Adding query filter params (type=image) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:10.478980 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f561a4-1ec5-4c1b-a209-42b55d55b915 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:10.480456 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f561a4-1ec5-4c1b-a209-42b55d55b915 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:10.492881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 499/1007] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:24:10 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:11.100654 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388bb3f-3245-4394-a665-a9739fecf583 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:11.101007 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388bb3f-3245-4394-a665-a9739fecf583 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:11.105244 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388bb3f-3245-4394-a665-a9739fecf583 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:11.105244 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 509/1008] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:11.109188 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb477c64-a8ec-4959-8617-af13f0c79b8e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:11.109481 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb477c64-a8ec-4959-8617-af13f0c79b8e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:11.109759 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb477c64-a8ec-4959-8617-af13f0c79b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:11.127104 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-bb477c64-a8ec-4959-8617-af13f0c79b8e None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:11.128281 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bb477c64-a8ec-4959-8617-af13f0c79b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:11.199167 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 500/1009] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:11 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:24:11.222529 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388bb3f-3245-4394-a665-a9739fecf583 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:11.267206 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:11.327457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388bb3f-3245-4394-a665-a9739fecf583 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:11.362705 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700048c8-2dbe-47c2-8998-3e6ff6e62974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:11.363536 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700048c8-2dbe-47c2-8998-3e6ff6e62974 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:11.363821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700048c8-2dbe-47c2-8998-3e6ff6e62974 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:11.364096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700048c8-2dbe-47c2-8998-3e6ff6e62974 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:11.365268 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700048c8-2dbe-47c2-8998-3e6ff6e62974 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:11.366694 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700048c8-2dbe-47c2-8998-3e6ff6e62974 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:11.369060 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 510/1010] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:24:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:11.374449 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb477c64-a8ec-4959-8617-af13f0c79b8e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:11.467664 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:11.474784 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb477c64-a8ec-4959-8617-af13f0c79b8e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:11.509006 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885da63e-5b85-41a6-bd67-aff17acc11ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:11.509666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885da63e-5b85-41a6-bd67-aff17acc11ef None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:11.509945 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885da63e-5b85-41a6-bd67-aff17acc11ef None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:11.510214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885da63e-5b85-41a6-bd67-aff17acc11ef None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:11.510926 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885da63e-5b85-41a6-bd67-aff17acc11ef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:11.512389 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885da63e-5b85-41a6-bd67-aff17acc11ef None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:11.539151 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 501/1011] 10.222.0.32 () {60 vars in 1141 bytes} [Thu Jun 2 13:24:11 2022] POST /identity/v3/projects => generated 311 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:24:11.922219 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3e02b-b8da-412c-8ce8-0f8c7cfa21dd None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:11.922609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3e02b-b8da-412c-8ce8-0f8c7cfa21dd None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:11.922818 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3e02b-b8da-412c-8ce8-0f8c7cfa21dd None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:11.924281 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 511/1012] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:11.929287 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6512f4-aace-46c2-9437-7d704384a8b1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:11.929583 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6512f4-aace-46c2-9437-7d704384a8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:11.929918 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6512f4-aace-46c2-9437-7d704384a8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:11.946673 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5b6512f4-aace-46c2-9437-7d704384a8b1 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:11.947860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5b6512f4-aace-46c2-9437-7d704384a8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:12.024448 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 502/1013] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:11 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:24:12.047308 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3e02b-b8da-412c-8ce8-0f8c7cfa21dd None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:12.149359 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3e02b-b8da-412c-8ce8-0f8c7cfa21dd None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:12.160147 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:12.184919 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916564a3-0fb1-4df3-b157-8bce53e27e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:12.185637 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916564a3-0fb1-4df3-b157-8bce53e27e85 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:12.185924 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916564a3-0fb1-4df3-b157-8bce53e27e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:12.186202 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916564a3-0fb1-4df3-b157-8bce53e27e85 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:12.186867 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916564a3-0fb1-4df3-b157-8bce53e27e85 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:12.188236 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916564a3-0fb1-4df3-b157-8bce53e27e85 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:12.200053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-916564a3-0fb1-4df3-b157-8bce53e27e85 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:24:12.200053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:12.200053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:24:12.200053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:24:12.200053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:24:12.200053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:24:12.200053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:24:12.200053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:24:12.200053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:24:12.200053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:12.200053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:24:12.200053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:12.200053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:12.200053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:12.200053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:12.200053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:12.200053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:12.202101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:12.202101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:12.202101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:12.202101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:12.202101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:12.202101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:12.202101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:24:12.202101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:24:12.202101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:24:12.202101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:24:12.202101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:12.202101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:12.202101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:12.202101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:12.202101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:12.202101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:12.204204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:12.204204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:12.204204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:12.204204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:12.204204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:12.204204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:12.204204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:12.204204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:12.204204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:12.204204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:12.204204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:24:12.204204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:24:12.204204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:24:12.204204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:12.206495 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 512/1014] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:24:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:12.207507 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6512f4-aace-46c2-9437-7d704384a8b1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:12.287546 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:12.311913 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6512f4-aace-46c2-9437-7d704384a8b1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:12.345831 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff7985-8e68-4f00-8921-59833d72da2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:12.346503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff7985-8e68-4f00-8921-59833d72da2f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:12.346789 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff7985-8e68-4f00-8921-59833d72da2f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:12.347066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff7985-8e68-4f00-8921-59833d72da2f None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:12.347778 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff7985-8e68-4f00-8921-59833d72da2f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:12.348085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff7985-8e68-4f00-8921-59833d72da2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:12.349498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff7985-8e68-4f00-8921-59833d72da2f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:12.359591 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 503/1015] 10.222.0.32 () {56 vars in 1112 bytes} [Thu Jun 2 13:24:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:24:12.360869 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916564a3-0fb1-4df3-b157-8bce53e27e85 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:12.470200 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916564a3-0fb1-4df3-b157-8bce53e27e85 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:12.504439 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791e6d9-a56f-4f34-ab16-1301eff11aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:12.505096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791e6d9-a56f-4f34-ab16-1301eff11aba None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:12.505374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791e6d9-a56f-4f34-ab16-1301eff11aba None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:12.505647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791e6d9-a56f-4f34-ab16-1301eff11aba None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:12.506347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791e6d9-a56f-4f34-ab16-1301eff11aba None admin] RBAC: Adding query filter params (type=compute) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:12.506652 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791e6d9-a56f-4f34-ab16-1301eff11aba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:12.508552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791e6d9-a56f-4f34-ab16-1301eff11aba None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:12.518105 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 513/1016] 10.222.0.32 () {56 vars in 1112 bytes} [Thu Jun 2 13:24:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:12.519340 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff7985-8e68-4f00-8921-59833d72da2f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:12.620941 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff7985-8e68-4f00-8921-59833d72da2f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:12.654908 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2386c-04c3-4418-a096-079ffc54c1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:12.655567 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2386c-04c3-4418-a096-079ffc54c1d9 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:12.655852 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2386c-04c3-4418-a096-079ffc54c1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:12.656132 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2386c-04c3-4418-a096-079ffc54c1d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:12.656974 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2386c-04c3-4418-a096-079ffc54c1d9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:12.658352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2386c-04c3-4418-a096-079ffc54c1d9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:12.670948 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:12.679248 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 504/1017] 10.222.0.32 () {60 vars in 1144 bytes} [Thu Jun 2 13:24:12 2022] POST /identity/v3/endpoints => generated 334 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:24:12.754318 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc080a-3e8b-4084-8296-8fd85553dca2 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:12.754503 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc080a-3e8b-4084-8296-8fd85553dca2 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:12.754790 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc080a-3e8b-4084-8296-8fd85553dca2 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:12.756364 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 514/1018] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:12.762991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836eed16-4396-4fa6-804b-c27874602282 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:12.763314 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836eed16-4396-4fa6-804b-c27874602282 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:12.763564 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836eed16-4396-4fa6-804b-c27874602282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:12.781535 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-836eed16-4396-4fa6-804b-c27874602282 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:12.782774 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-836eed16-4396-4fa6-804b-c27874602282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:12.863389 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 505/1019] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:12 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:24:12.886344 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc080a-3e8b-4084-8296-8fd85553dca2 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:12.931424 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:12.995276 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc080a-3e8b-4084-8296-8fd85553dca2 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:13.035487 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef44382-2892-48b2-8416-d5e1708506a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:13.036480 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef44382-2892-48b2-8416-d5e1708506a8 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:13.036940 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef44382-2892-48b2-8416-d5e1708506a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:13.037402 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef44382-2892-48b2-8416-d5e1708506a8 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:13.038292 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef44382-2892-48b2-8416-d5e1708506a8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:13.040385 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef44382-2892-48b2-8416-d5e1708506a8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:13.054820 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 515/1020] 10.222.0.32 () {60 vars in 1141 bytes} [Thu Jun 2 13:24:12 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:24:13.893551 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0962403-bd36-4d0e-8799-7da9e4445465 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:13.894143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0962403-bd36-4d0e-8799-7da9e4445465 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:13.894143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0962403-bd36-4d0e-8799-7da9e4445465 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:13.895526 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 506/1021] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:13.900821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ba77a-fe82-421d-ba68-7f22ae1b5e3e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:13.901219 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ba77a-fe82-421d-ba68-7f22ae1b5e3e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:13.901414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ba77a-fe82-421d-ba68-7f22ae1b5e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:13.919981 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-941ba77a-fe82-421d-ba68-7f22ae1b5e3e None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:13.921249 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-941ba77a-fe82-421d-ba68-7f22ae1b5e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:13.994661 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 516/1022] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:24:14.019568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0962403-bd36-4d0e-8799-7da9e4445465 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:14.125048 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0962403-bd36-4d0e-8799-7da9e4445465 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:14.149620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:14.161203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f48a1-907a-40aa-968c-3e543aecd7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:14.162000 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f48a1-907a-40aa-968c-3e543aecd7ed None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:14.162285 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f48a1-907a-40aa-968c-3e543aecd7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:14.162560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f48a1-907a-40aa-968c-3e543aecd7ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:14.163734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f48a1-907a-40aa-968c-3e543aecd7ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:14.165762 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f48a1-907a-40aa-968c-3e543aecd7ed None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:14.172191 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 507/1023] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:24:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:14.173520 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ba77a-fe82-421d-ba68-7f22ae1b5e3e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:14.200218 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:14.278062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ba77a-fe82-421d-ba68-7f22ae1b5e3e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:14.313666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5f3fc-bea7-4275-9dc3-709b96f50b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:14.314337 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5f3fc-bea7-4275-9dc3-709b96f50b6a None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:14.314623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5f3fc-bea7-4275-9dc3-709b96f50b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:14.314900 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5f3fc-bea7-4275-9dc3-709b96f50b6a None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:14.315610 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c5f3fc-bea7-4275-9dc3-709b96f50b6a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:14.317065 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c5f3fc-bea7-4275-9dc3-709b96f50b6a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:14.339403 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 517/1024] 10.222.0.32 () {60 vars in 1132 bytes} [Thu Jun 2 13:24:14 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:24:15.074048 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c2dbc-c100-4a36-8644-9b0f70239f4a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:15.074566 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c2dbc-c100-4a36-8644-9b0f70239f4a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:15.074643 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c2dbc-c100-4a36-8644-9b0f70239f4a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:15.076012 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 508/1025] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:15.081338 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f6566-2c9d-4733-9e6f-027081e23480 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:15.081764 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f6566-2c9d-4733-9e6f-027081e23480 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:15.081963 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f6566-2c9d-4733-9e6f-027081e23480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:15.099879 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b94f6566-2c9d-4733-9e6f-027081e23480 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:15.101080 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b94f6566-2c9d-4733-9e6f-027081e23480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:15.171162 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 518/1026] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:24:15.194547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c2dbc-c100-4a36-8644-9b0f70239f4a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:15.298048 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c2dbc-c100-4a36-8644-9b0f70239f4a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:15.331733 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98e95d-a0e2-4fa8-bd7b-8bdc7447c398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:15.332579 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98e95d-a0e2-4fa8-bd7b-8bdc7447c398 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:15.332952 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98e95d-a0e2-4fa8-bd7b-8bdc7447c398 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:15.333231 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98e95d-a0e2-4fa8-bd7b-8bdc7447c398 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:15.339893 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d05674-f011-414a-9196-e1deff6d7f31 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:15.340184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d05674-f011-414a-9196-e1deff6d7f31 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:15.340490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d05674-f011-414a-9196-e1deff6d7f31 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:15.341865 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 519/1027] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:15.344568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98e95d-a0e2-4fa8-bd7b-8bdc7447c398 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:24:15.346634 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b054d3a-da10-4c64-bc98-9561f620d103 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:15.346925 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b054d3a-da10-4c64-bc98-9561f620d103 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:15.347207 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b054d3a-da10-4c64-bc98-9561f620d103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:15.352735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ad98e95d-a0e2-4fa8-bd7b-8bdc7447c398 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:24:15.352735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:15.352735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:15.352735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:15.352735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:15.352735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:15.352735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:15.352735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:15.352735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:15.352735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:15.352735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:15.352735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:15.352735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:24:15.352735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:24:15.352735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:24:15.352735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:24:15.353654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:24:15.353654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:24:15.353654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:24:15.353654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:24:15.353654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:15.353654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:15.353654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:15.353654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:15.353654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:15.353654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:15.353654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:15.353654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:15.353654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:15.353654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:15.353654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:15.353654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:15.354517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:15.354517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:15.354517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:15.354517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:15.354517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:24:15.354517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:24:15.354517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:24:15.354517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:24:15.354517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:24:15.354517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:24:15.354517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:24:15.354517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:24:15.354517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 509/1028] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Jun 2 13:24:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:15.359547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98e95d-a0e2-4fa8-bd7b-8bdc7447c398 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:15.366846 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-8b054d3a-da10-4c64-bc98-9561f620d103 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:15.368067 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8b054d3a-da10-4c64-bc98-9561f620d103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:15.370920 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:15.417544 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:15.448835 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 520/1029] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:24:15.468823 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98e95d-a0e2-4fa8-bd7b-8bdc7447c398 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:15.472404 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b054d3a-da10-4c64-bc98-9561f620d103 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:15.516450 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50522811-0d1f-480a-a577-af84a312fe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:15.517151 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50522811-0d1f-480a-a577-af84a312fe77 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:15.517435 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50522811-0d1f-480a-a577-af84a312fe77 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:15.517715 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50522811-0d1f-480a-a577-af84a312fe77 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:15.518491 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50522811-0d1f-480a-a577-af84a312fe77 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:15.518800 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50522811-0d1f-480a-a577-af84a312fe77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:15.520392 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50522811-0d1f-480a-a577-af84a312fe77 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:15.535594 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 510/1030] 10.222.0.32 () {56 vars in 1115 bytes} [Thu Jun 2 13:24:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:24:15.537540 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50522811-0d1f-480a-a577-af84a312fe77 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:15.592065 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b054d3a-da10-4c64-bc98-9561f620d103 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:15.629786 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902992e-0ba1-456b-9550-ebffb7bccf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:15.630580 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902992e-0ba1-456b-9550-ebffb7bccf0e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:15.630869 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902992e-0ba1-456b-9550-ebffb7bccf0e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:15.631151 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902992e-0ba1-456b-9550-ebffb7bccf0e None admin] PATH_INFO: `/v3/services/image` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:15.631819 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902992e-0ba1-456b-9550-ebffb7bccf0e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:15.633290 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902992e-0ba1-456b-9550-ebffb7bccf0e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:15.645639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-a902992e-0ba1-456b-9550-ebffb7bccf0e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:24:15.645639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:15.645639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:24:15.645639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:24:15.645639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:24:15.645639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:24:15.645639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:24:15.645639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:24:15.645639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:24:15.645639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:15.645639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:24:15.645639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:15.645639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:15.645639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:15.645639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:15.645639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:15.645639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:15.646645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:15.646645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:15.646645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:15.646645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:15.646645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:15.646645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:15.646645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:24:15.646645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:24:15.646645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:24:15.646645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:24:15.646645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:15.646645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:15.646645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:15.646645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:15.646645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:15.646645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:15.647485 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:15.647485 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:15.647485 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:15.647485 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:15.647485 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:15.647485 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:15.647485 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:15.647485 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:15.647485 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:15.647485 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:15.647485 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:24:15.647485 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:24:15.647485 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:24:15.647485 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:15.647485 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 521/1031] 10.222.0.32 () {56 vars in 1105 bytes} [Thu Jun 2 13:24:15 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:24:15.653249 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902992e-0ba1-456b-9550-ebffb7bccf0e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:15.655551 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50522811-0d1f-480a-a577-af84a312fe77 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:15.657798 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:15.672504 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:15.695183 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e1c70-cf9b-481b-9c37-c5fba5cd02df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:15.696582 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e1c70-cf9b-481b-9c37-c5fba5cd02df None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:15.696866 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e1c70-cf9b-481b-9c37-c5fba5cd02df None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:15.697141 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e1c70-cf9b-481b-9c37-c5fba5cd02df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:15.708559 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e1c70-cf9b-481b-9c37-c5fba5cd02df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:15.710155 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e1c70-cf9b-481b-9c37-c5fba5cd02df None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:15.727621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-091e1c70-cf9b-481b-9c37-c5fba5cd02df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:24:15.727621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:15.727621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:15.727621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:15.727621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:15.727621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:15.727621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:15.727621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:15.727621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:15.727621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:15.727621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:15.727621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:15.727621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:24:15.727621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:24:15.727621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:24:15.728563 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:24:15.728563 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:15.728563 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:15.728563 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:15.728563 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:15.728563 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:15.728563 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:15.728563 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:15.728563 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:15.728563 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:15.728563 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:15.728563 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:15.728563 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:15.728563 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:15.728563 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:15.728563 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:15.728563 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:15.729482 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:24:15.729482 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:24:15.729482 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:24:15.729482 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:24:15.729482 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 511/1032] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:24:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:15.737212 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e1c70-cf9b-481b-9c37-c5fba5cd02df None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:15.763030 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902992e-0ba1-456b-9550-ebffb7bccf0e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:15.798026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad091e1d-d91e-468d-93ee-8fd60ee1aa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:15.798696 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad091e1d-d91e-468d-93ee-8fd60ee1aa21 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:15.798980 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad091e1d-d91e-468d-93ee-8fd60ee1aa21 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:15.799262 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad091e1d-d91e-468d-93ee-8fd60ee1aa21 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:15.799971 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad091e1d-d91e-468d-93ee-8fd60ee1aa21 None admin] RBAC: Adding query filter params (name=image) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:15.800286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad091e1d-d91e-468d-93ee-8fd60ee1aa21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:15.801693 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad091e1d-d91e-468d-93ee-8fd60ee1aa21 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:15.806984 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 522/1033] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:24:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:24:15.812443 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad091e1d-d91e-468d-93ee-8fd60ee1aa21 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:15.855157 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e1c70-cf9b-481b-9c37-c5fba5cd02df None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:15.877726 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:15.891663 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a09f4-5a8a-4d2c-af89-735b09cdebde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:15.892346 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a09f4-5a8a-4d2c-af89-735b09cdebde None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:15.892781 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a09f4-5a8a-4d2c-af89-735b09cdebde None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:15.893147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a09f4-5a8a-4d2c-af89-735b09cdebde None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:15.893987 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a09f4-5a8a-4d2c-af89-735b09cdebde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:15.894297 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a09f4-5a8a-4d2c-af89-735b09cdebde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:15.895762 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a09f4-5a8a-4d2c-af89-735b09cdebde None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:15.913644 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 512/1034] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:15.914694 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a09f4-5a8a-4d2c-af89-735b09cdebde None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:15.917044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad091e1d-d91e-468d-93ee-8fd60ee1aa21 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:15.943201 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:15.954085 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf213c-bc2c-46d9-9c70-5b5d567e07cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:15.954809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf213c-bc2c-46d9-9c70-5b5d567e07cc None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:15.955093 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf213c-bc2c-46d9-9c70-5b5d567e07cc None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:15.955417 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf213c-bc2c-46d9-9c70-5b5d567e07cc None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:15.956139 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf213c-bc2c-46d9-9c70-5b5d567e07cc None admin] RBAC: Adding query filter params (type=image) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:15.956478 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf213c-bc2c-46d9-9c70-5b5d567e07cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:15.958256 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf213c-bc2c-46d9-9c70-5b5d567e07cc None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:15.964065 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 523/1035] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:24:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:24:15.969989 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf213c-bc2c-46d9-9c70-5b5d567e07cc None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:16.034544 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a09f4-5a8a-4d2c-af89-735b09cdebde None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:16.072546 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12dc120-baea-4d72-94b0-567e7a930f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:16.073399 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12dc120-baea-4d72-94b0-567e7a930f57 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:16.073623 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12dc120-baea-4d72-94b0-567e7a930f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:16.073890 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12dc120-baea-4d72-94b0-567e7a930f57 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:16.081104 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf213c-bc2c-46d9-9c70-5b5d567e07cc None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:16.081306 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12dc120-baea-4d72-94b0-567e7a930f57 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:16.082732 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12dc120-baea-4d72-94b0-567e7a930f57 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:16.097760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c12dc120-baea-4d72-94b0-567e7a930f57 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:24:16.097760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:16.097760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:16.097760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:16.097760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:16.097760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:16.097760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:16.097760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:16.097760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:16.097760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:16.097760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:16.097760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:16.097760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:24:16.097760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:24:16.097760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:24:16.097760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:24:16.099052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:16.099052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:16.099052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:24:16.099052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:24:16.099052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:24:16.099052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:24:16.099052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:16.099052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:16.099052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:16.099052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:16.099052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:16.099052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:16.099052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:16.099052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:16.099052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:16.099052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:16.099052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:16.099052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:16.100260 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:16.100260 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:16.100260 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:24:16.100260 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:24:16.100260 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:24:16.100260 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:24:16.100260 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:24:16.100260 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:24:16.100260 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:24:16.100260 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:24:16.104399 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 513/1036] 10.222.0.32 () {56 vars in 1093 bytes} [Thu Jun 2 13:24:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:16.105306 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12dc120-baea-4d72-94b0-567e7a930f57 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:16.115797 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:16.123346 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbc74d-db47-42e0-99dd-9432f2d235cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:16.124011 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbc74d-db47-42e0-99dd-9432f2d235cd None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:16.124317 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbc74d-db47-42e0-99dd-9432f2d235cd None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:16.124609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbc74d-db47-42e0-99dd-9432f2d235cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:16.125414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbc74d-db47-42e0-99dd-9432f2d235cd None admin] RBAC: Adding query filter params (interface=public, service_id=a2ef7ce114e9407ebe642a83ecad8e31, region_id=RegionOne) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:16.125731 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbc74d-db47-42e0-99dd-9432f2d235cd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:16.127108 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbc74d-db47-42e0-99dd-9432f2d235cd None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:16.132849 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 524/1037] 10.222.0.32 () {56 vars in 1251 bytes} [Thu Jun 2 13:24:15 2022] GET /identity/v3/endpoints?service_id=a2ef7ce114e9407ebe642a83ecad8e31&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:24:16.138254 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbc74d-db47-42e0-99dd-9432f2d235cd None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:16.201752 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:16.219083 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12dc120-baea-4d72-94b0-567e7a930f57 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:16.244616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbc74d-db47-42e0-99dd-9432f2d235cd None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:16.253756 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b44b9-66c5-43c8-acab-b61880c03add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:16.254429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b44b9-66c5-43c8-acab-b61880c03add None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:16.254711 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b44b9-66c5-43c8-acab-b61880c03add None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:16.254988 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b44b9-66c5-43c8-acab-b61880c03add None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:16.255821 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b44b9-66c5-43c8-acab-b61880c03add None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:16.256131 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b44b9-66c5-43c8-acab-b61880c03add None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:16.257704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b44b9-66c5-43c8-acab-b61880c03add None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:16.277417 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 514/1038] 10.222.0.32 () {56 vars in 1133 bytes} [Thu Jun 2 13:24:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:16.282616 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b44b9-66c5-43c8-acab-b61880c03add None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:16.285018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490ac87-f379-43cd-8151-a1535259e666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:16.285684 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490ac87-f379-43cd-8151-a1535259e666 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:16.285975 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490ac87-f379-43cd-8151-a1535259e666 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:16.286312 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490ac87-f379-43cd-8151-a1535259e666 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:16.287006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490ac87-f379-43cd-8151-a1535259e666 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:16.288448 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490ac87-f379-43cd-8151-a1535259e666 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:16.304347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 525/1039] 10.222.0.32 () {56 vars in 1087 bytes} [Thu Jun 2 13:24:16 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:24:16.396914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b44b9-66c5-43c8-acab-b61880c03add None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:16.434110 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a0771-dcec-444c-b930-45c662d2401f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:16.434793 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a0771-dcec-444c-b930-45c662d2401f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:16.435078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a0771-dcec-444c-b930-45c662d2401f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:16.435357 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a0771-dcec-444c-b930-45c662d2401f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:16.452337 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:16.514907 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a0771-dcec-444c-b930-45c662d2401f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:16.516412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a0771-dcec-444c-b930-45c662d2401f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:16.623809 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 515/1040] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:24:16 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 13:24:16.625241 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490ac87-f379-43cd-8151-a1535259e666 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:16.669076 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a06c6-9e8c-46c1-859f-04dac208eef2 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:16.669367 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a06c6-9e8c-46c1-859f-04dac208eef2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:16.669580 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a06c6-9e8c-46c1-859f-04dac208eef2 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:16.671119 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 516/1041] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:24:16.675926 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d0627-3d06-4707-bc7b-a081c273ea0c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:16.676222 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d0627-3d06-4707-bc7b-a081c273ea0c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:16.676549 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d0627-3d06-4707-bc7b-a081c273ea0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:16.689300 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:16.693779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-408d0627-3d06-4707-bc7b-a081c273ea0c None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:16.695017 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-408d0627-3d06-4707-bc7b-a081c273ea0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:16.732590 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490ac87-f379-43cd-8151-a1535259e666 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:16.737880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:16.767555 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f14910-0c17-49ab-8eb3-de7b6973fbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:16.768374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f14910-0c17-49ab-8eb3-de7b6973fbfd None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:16.768666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f14910-0c17-49ab-8eb3-de7b6973fbfd None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:16.768947 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f14910-0c17-49ab-8eb3-de7b6973fbfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:16.770770 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 517/1042] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:24:16.781848 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f14910-0c17-49ab-8eb3-de7b6973fbfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:16.783378 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f14910-0c17-49ab-8eb3-de7b6973fbfd None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:16.795562 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d0627-3d06-4707-bc7b-a081c273ea0c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:16.801674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-a6f14910-0c17-49ab-8eb3-de7b6973fbfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:24:16.801674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:16.801674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:16.801674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:16.801674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:16.801674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:16.801674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:16.801674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:16.801674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:16.801674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:16.801674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:16.801674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:16.801674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:24:16.801674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:24:16.801674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:24:16.802556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:24:16.802556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:16.802556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:16.802556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:16.802556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:16.802556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:16.802556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:16.802556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:16.802556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:16.802556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:16.802556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:16.802556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:16.802556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:16.802556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:16.802556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:16.802556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:16.802556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:16.803474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:24:16.803474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:24:16.803474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:24:16.803474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:16.804612 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 526/1043] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:24:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:24:16.809744 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f14910-0c17-49ab-8eb3-de7b6973fbfd None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:16.899387 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d0627-3d06-4707-bc7b-a081c273ea0c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:16.917721 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f14910-0c17-49ab-8eb3-de7b6973fbfd None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:16.932328 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:16.935502 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226e6af-a808-4beb-ba3e-98b8a8ff1397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:16.936509 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226e6af-a808-4beb-ba3e-98b8a8ff1397 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:16.936803 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226e6af-a808-4beb-ba3e-98b8a8ff1397 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:16.937072 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226e6af-a808-4beb-ba3e-98b8a8ff1397 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:16.947792 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226e6af-a808-4beb-ba3e-98b8a8ff1397 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:24:16.954751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879165af-9d70-46b6-bb12-ef9a49cde4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:16.955372 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c226e6af-a808-4beb-ba3e-98b8a8ff1397 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:24:16.955372 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:16.955372 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:16.955372 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:16.955372 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:16.955372 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:16.955372 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:16.955372 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:16.955372 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:16.955372 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:16.955372 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:16.955372 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:16.955372 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:24:16.955372 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:24:16.955372 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:24:16.955372 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:24:16.956498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:24:16.956498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:24:16.956498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:24:16.956498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:24:16.956498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:16.956498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:16.956498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:16.956498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:16.956498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:16.956498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:16.956498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:16.956498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:16.956498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:16.956498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:16.956498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:16.956498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:16.957630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:16.957630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:16.957630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:16.957630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:16.957630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:24:16.957630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:24:16.957630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:24:16.957630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:24:16.957630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:24:16.957630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:24:16.957630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:24:16.957630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:24:16.957630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 518/1044] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:24:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:24:16.958773 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879165af-9d70-46b6-bb12-ef9a49cde4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:16.959199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879165af-9d70-46b6-bb12-ef9a49cde4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:16.959614 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879165af-9d70-46b6-bb12-ef9a49cde4c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:16.960519 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879165af-9d70-46b6-bb12-ef9a49cde4c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:16.961243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879165af-9d70-46b6-bb12-ef9a49cde4c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:16.962707 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226e6af-a808-4beb-ba3e-98b8a8ff1397 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:16.963061 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879165af-9d70-46b6-bb12-ef9a49cde4c0 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:16.977487 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 527/1045] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:24:16.982720 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879165af-9d70-46b6-bb12-ef9a49cde4c0 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:17.001856 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:17.078023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226e6af-a808-4beb-ba3e-98b8a8ff1397 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:17.090067 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879165af-9d70-46b6-bb12-ef9a49cde4c0 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:17.113867 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033f0b1-8c77-4489-b77b-9378b72f53ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:17.114858 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033f0b1-8c77-4489-b77b-9378b72f53ab None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:17.114858 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033f0b1-8c77-4489-b77b-9378b72f53ab None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:17.115136 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033f0b1-8c77-4489-b77b-9378b72f53ab None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:17.115843 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033f0b1-8c77-4489-b77b-9378b72f53ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:17.116160 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033f0b1-8c77-4489-b77b-9378b72f53ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:17.117614 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033f0b1-8c77-4489-b77b-9378b72f53ab None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:17.128332 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 519/1046] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:24:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:24:17.131547 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa8dc4-cc41-4d36-aff5-47ff99d13a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:17.132021 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033f0b1-8c77-4489-b77b-9378b72f53ab None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:17.132382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa8dc4-cc41-4d36-aff5-47ff99d13a5c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:17.132673 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa8dc4-cc41-4d36-aff5-47ff99d13a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:17.132984 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa8dc4-cc41-4d36-aff5-47ff99d13a5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:17.141250 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa8dc4-cc41-4d36-aff5-47ff99d13a5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:17.142536 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa8dc4-cc41-4d36-aff5-47ff99d13a5c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:17.156823 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-4cfa8dc4-cc41-4d36-aff5-47ff99d13a5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:24:17.156823 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:17.156823 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:17.156823 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:17.156823 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:17.156823 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:17.156823 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:17.156823 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:17.156823 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:17.156823 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:17.156823 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:17.156823 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:17.156823 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:24:17.156823 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:24:17.156823 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:24:17.157800 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:24:17.157800 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:17.157800 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:17.157800 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:17.157800 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:17.157800 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:17.157800 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:17.157800 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:17.157800 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:17.157800 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:17.157800 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:17.157800 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:17.157800 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:17.157800 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:17.157800 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:17.157800 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:17.157800 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:17.158708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:24:17.158708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:24:17.158708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:24:17.158708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:24:17.158708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:24:17.158708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:24:17.158708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:24:17.158708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:17.158708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 528/1047] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:24:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:24:17.163671 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa8dc4-cc41-4d36-aff5-47ff99d13a5c None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:17.197803 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:17.233015 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:17.239487 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033f0b1-8c77-4489-b77b-9378b72f53ab None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:17.271898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa8dc4-cc41-4d36-aff5-47ff99d13a5c None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:17.274191 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3591b-7e29-4ab0-9362-2c4663559ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:17.275142 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3591b-7e29-4ab0-9362-2c4663559ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:17.275428 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3591b-7e29-4ab0-9362-2c4663559ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:17.275705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3591b-7e29-4ab0-9362-2c4663559ce3 None admin] PATH_INFO: `/v3/users/da54e771b0b34fec8c294d03d8bcb2cf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:17.290695 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3591b-7e29-4ab0-9362-2c4663559ce3 None admin] RBAC: Authorizing `identity:get_user(user_id=da54e771b0b34fec8c294d03d8bcb2cf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:17.292182 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3591b-7e29-4ab0-9362-2c4663559ce3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:17.298926 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 520/1048] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:24:17 2022] GET /identity/v3/users/da54e771b0b34fec8c294d03d8bcb2cf => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:17.299990 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3591b-7e29-4ab0-9362-2c4663559ce3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:17.313543 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a18d9-0c9f-4e13-867d-1378ac1e906d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:17.314194 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a18d9-0c9f-4e13-867d-1378ac1e906d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:17.314476 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a18d9-0c9f-4e13-867d-1378ac1e906d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:17.314754 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a18d9-0c9f-4e13-867d-1378ac1e906d None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:17.315544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a18d9-0c9f-4e13-867d-1378ac1e906d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:17.315954 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a18d9-0c9f-4e13-867d-1378ac1e906d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:17.317289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a18d9-0c9f-4e13-867d-1378ac1e906d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:17.334129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 529/1049] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:24:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:24:17.335174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a18d9-0c9f-4e13-867d-1378ac1e906d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:17.409003 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3591b-7e29-4ab0-9362-2c4663559ce3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:17.432666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:17.442236 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a18d9-0c9f-4e13-867d-1378ac1e906d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:17.449375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75da010-f02b-413c-aad8-ec215908afa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:17.449967 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75da010-f02b-413c-aad8-ec215908afa5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:17.450657 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75da010-f02b-413c-aad8-ec215908afa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:17.450941 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75da010-f02b-413c-aad8-ec215908afa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:17.478029 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:17.480443 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b622f1-6735-483f-90f1-317f76e65fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:17.481299 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b622f1-6735-483f-90f1-317f76e65fbc None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:17.481728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b622f1-6735-483f-90f1-317f76e65fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:17.482165 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b622f1-6735-483f-90f1-317f76e65fbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:17.483153 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b622f1-6735-483f-90f1-317f76e65fbc None admin] RBAC: Adding query filter params (role.id=f1346f1c619e4ab48ac6d21faa94c720, scope.project.id=a9007447059e4862972078c032a5d67b, user.id=b2e5d9f3c4e04ca3bf52b28b67d2a4d6) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:17.483722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b622f1-6735-483f-90f1-317f76e65fbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:17.485193 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b622f1-6735-483f-90f1-317f76e65fbc None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:17.491174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 530/1050] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:24:17 2022] GET /identity/v3/role_assignments?user.id=b2e5d9f3c4e04ca3bf52b28b67d2a4d6&scope.project.id=a9007447059e4862972078c032a5d67b&role.id=f1346f1c619e4ab48ac6d21faa94c720 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:17.530074 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75da010-f02b-413c-aad8-ec215908afa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:17.531580 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75da010-f02b-413c-aad8-ec215908afa5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:17.652875 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 521/1051] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:24:17 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:24:17.654411 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b622f1-6735-483f-90f1-317f76e65fbc None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:17.759805 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b622f1-6735-483f-90f1-317f76e65fbc None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:17.793736 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70adc0c-67bc-490d-85e2-a1ac4d830ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:17.794599 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70adc0c-67bc-490d-85e2-a1ac4d830ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:17.794888 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70adc0c-67bc-490d-85e2-a1ac4d830ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:17.795167 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70adc0c-67bc-490d-85e2-a1ac4d830ac3 None admin] PATH_INFO: `/v3/projects/2fdc08396e714139b76cdc871034dc16` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:17.796419 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70adc0c-67bc-490d-85e2-a1ac4d830ac3 None admin] RBAC: Authorizing `identity:get_project(project_id=2fdc08396e714139b76cdc871034dc16)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:17.797843 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70adc0c-67bc-490d-85e2-a1ac4d830ac3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:17.804337 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 531/1052] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:24:17 2022] GET /identity/v3/projects/2fdc08396e714139b76cdc871034dc16 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:24:17.806365 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75da010-f02b-413c-aad8-ec215908afa5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:17.865858 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:17.912564 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75da010-f02b-413c-aad8-ec215908afa5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:17.947506 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f470b8a-527a-4945-8105-62d8329ff1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:17.948163 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f470b8a-527a-4945-8105-62d8329ff1bc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:17.948479 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f470b8a-527a-4945-8105-62d8329ff1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:17.948759 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f470b8a-527a-4945-8105-62d8329ff1bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:17.949586 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f470b8a-527a-4945-8105-62d8329ff1bc None admin] RBAC: Adding query filter params (role.id=128feb04d1e042ac844f9ad70b89bb02, scope.project.id=2fdc08396e714139b76cdc871034dc16, user.id=da54e771b0b34fec8c294d03d8bcb2cf) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:17.949898 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f470b8a-527a-4945-8105-62d8329ff1bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:17.951336 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f470b8a-527a-4945-8105-62d8329ff1bc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:17.964329 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 522/1053] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:24:17 2022] GET /identity/v3/role_assignments?user.id=da54e771b0b34fec8c294d03d8bcb2cf&scope.project.id=2fdc08396e714139b76cdc871034dc16&role.id=128feb04d1e042ac844f9ad70b89bb02 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:18.560907 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892ffac-e2fc-423f-9058-7138cf4d249c None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:18.561444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892ffac-e2fc-423f-9058-7138cf4d249c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:18.561444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892ffac-e2fc-423f-9058-7138cf4d249c None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:18.562943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 532/1054] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:18.567963 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ba410-a834-4035-aaf7-7d1053c5da53 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:18.568384 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ba410-a834-4035-aaf7-7d1053c5da53 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:18.568551 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ba410-a834-4035-aaf7-7d1053c5da53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:18.585997 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d82ba410-a834-4035-aaf7-7d1053c5da53 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:18.587197 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d82ba410-a834-4035-aaf7-7d1053c5da53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:18.664401 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 523/1055] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:24:18.679079 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892ffac-e2fc-423f-9058-7138cf4d249c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:18.706265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:18.785462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892ffac-e2fc-423f-9058-7138cf4d249c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:18.819152 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ac526-ee9e-4b13-ad1c-5e14b9c5d143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:18.819860 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ac526-ee9e-4b13-ad1c-5e14b9c5d143 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:18.820143 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ac526-ee9e-4b13-ad1c-5e14b9c5d143 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:18.820974 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ac526-ee9e-4b13-ad1c-5e14b9c5d143 None admin] PATH_INFO: `/v3/services/image` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:18.821629 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ac526-ee9e-4b13-ad1c-5e14b9c5d143 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:18.822985 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ac526-ee9e-4b13-ad1c-5e14b9c5d143 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:18.834184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-213ac526-ee9e-4b13-ad1c-5e14b9c5d143 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:24:18.834184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:18.834184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:24:18.834184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:24:18.834184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:24:18.834184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:24:18.834184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:24:18.834184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:24:18.834184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:24:18.834184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:18.834184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:24:18.834184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:18.834184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:18.834184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:18.834184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:18.834184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:18.834184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:18.835174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:18.835174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:18.835174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:18.835174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:18.835174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:18.835174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:18.835174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:24:18.835174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:24:18.835174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:24:18.835174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:24:18.835174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:18.835174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:18.835174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:18.835174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:18.835174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:18.835174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:18.836291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:18.836291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:18.836291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:18.836291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:18.836291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:18.836291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:18.836291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:18.836291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:18.836291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:18.836291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:18.836291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:24:18.836291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:24:18.836291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:24:18.836291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:18.840368 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 533/1056] 10.222.0.32 () {56 vars in 1105 bytes} [Thu Jun 2 13:24:18 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:18.841910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ba410-a834-4035-aaf7-7d1053c5da53 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:18.891710 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:18.942754 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ba410-a834-4035-aaf7-7d1053c5da53 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:18.976993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8ab62-7253-45f5-9453-86da2e6c9e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:18.977656 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8ab62-7253-45f5-9453-86da2e6c9e41 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:18.977940 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8ab62-7253-45f5-9453-86da2e6c9e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:18.978215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8ab62-7253-45f5-9453-86da2e6c9e41 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:18.978922 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8ab62-7253-45f5-9453-86da2e6c9e41 None admin] RBAC: Adding query filter params (name=image) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:18.979230 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8ab62-7253-45f5-9453-86da2e6c9e41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:18.980618 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8ab62-7253-45f5-9453-86da2e6c9e41 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:18.990143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 524/1057] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:24:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:18.991730 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ac526-ee9e-4b13-ad1c-5e14b9c5d143 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:19.086904 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:19.104506 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ac526-ee9e-4b13-ad1c-5e14b9c5d143 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:19.138138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b53c5-ff95-405c-af04-40938828c057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:19.138799 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b53c5-ff95-405c-af04-40938828c057 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:19.139079 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b53c5-ff95-405c-af04-40938828c057 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:19.139350 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b53c5-ff95-405c-af04-40938828c057 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:19.140053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b53c5-ff95-405c-af04-40938828c057 None admin] RBAC: Adding query filter params (type=image) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:19.140381 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b53c5-ff95-405c-af04-40938828c057 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:19.141743 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b53c5-ff95-405c-af04-40938828c057 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:19.151486 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 534/1058] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:24:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:19.154273 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8ab62-7253-45f5-9453-86da2e6c9e41 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:19.262366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8ab62-7253-45f5-9453-86da2e6c9e41 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:19.275516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:19.298600 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76af81-5181-489e-acdc-86ba1a446f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:19.299254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76af81-5181-489e-acdc-86ba1a446f80 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:19.299535 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76af81-5181-489e-acdc-86ba1a446f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:19.299817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76af81-5181-489e-acdc-86ba1a446f80 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:19.300685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76af81-5181-489e-acdc-86ba1a446f80 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:19.302127 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76af81-5181-489e-acdc-86ba1a446f80 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:19.321258 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 525/1059] 10.222.0.32 () {60 vars in 1144 bytes} [Thu Jun 2 13:24:19 2022] POST /identity/v3/endpoints => generated 327 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:24:19.740699 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29d0a1-7f47-41ab-aa94-1184f1b1487c None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:19.741228 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29d0a1-7f47-41ab-aa94-1184f1b1487c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:19.741228 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29d0a1-7f47-41ab-aa94-1184f1b1487c None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:19.742777 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 535/1060] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:19.747888 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d0219-6017-42ed-8f6b-f1ff430b63f9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:19.748288 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d0219-6017-42ed-8f6b-f1ff430b63f9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:19.748507 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d0219-6017-42ed-8f6b-f1ff430b63f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:19.765729 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-307d0219-6017-42ed-8f6b-f1ff430b63f9 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:19.766904 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-307d0219-6017-42ed-8f6b-f1ff430b63f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:19.841691 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 526/1061] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:24:19.865075 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29d0a1-7f47-41ab-aa94-1184f1b1487c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:19.968481 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29d0a1-7f47-41ab-aa94-1184f1b1487c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:20.000794 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87281d47-366c-4aea-8dd3-434dd58d305f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:20.001528 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87281d47-366c-4aea-8dd3-434dd58d305f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:20.001808 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87281d47-366c-4aea-8dd3-434dd58d305f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:20.002080 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87281d47-366c-4aea-8dd3-434dd58d305f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:20.018832 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87281d47-366c-4aea-8dd3-434dd58d305f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:24:20.027596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-87281d47-366c-4aea-8dd3-434dd58d305f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:24:20.027596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:20.027596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:20.027596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:20.027596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:20.027596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:20.027596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:20.027596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:20.027596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:20.027596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:20.027596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:20.027596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:20.027596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:24:20.027596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:24:20.027596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:24:20.027596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:24:20.028806 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:24:20.028806 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:24:20.028806 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:24:20.028806 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:24:20.028806 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:20.028806 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:20.028806 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:20.028806 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:20.028806 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:20.028806 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:20.028806 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:20.028806 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:20.028806 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:20.028806 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:20.028806 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:20.028806 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:20.029660 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:20.029660 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:20.029660 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:20.029660 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:20.029660 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:24:20.029660 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:24:20.029660 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:24:20.029660 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:24:20.029660 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:24:20.029660 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:24:20.029660 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:24:20.029660 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:20.030688 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 536/1062] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Jun 2 13:24:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:20.035175 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d0219-6017-42ed-8f6b-f1ff430b63f9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:20.131220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:20.141010 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d0219-6017-42ed-8f6b-f1ff430b63f9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:20.175673 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc0e73-8221-4231-9ccc-7c4424f88a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:20.176388 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc0e73-8221-4231-9ccc-7c4424f88a5d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:20.176678 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc0e73-8221-4231-9ccc-7c4424f88a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:20.176955 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc0e73-8221-4231-9ccc-7c4424f88a5d None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:20.177711 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc0e73-8221-4231-9ccc-7c4424f88a5d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:20.178022 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc0e73-8221-4231-9ccc-7c4424f88a5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:20.179408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc0e73-8221-4231-9ccc-7c4424f88a5d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:20.186550 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e2a84-27c6-4eb4-80ae-091cc874f0dd None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:20.186845 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e2a84-27c6-4eb4-80ae-091cc874f0dd None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:20.187128 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e2a84-27c6-4eb4-80ae-091cc874f0dd None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:20.192010 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 537/1063] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:24:20.192162 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 527/1064] 10.222.0.32 () {56 vars in 1115 bytes} [Thu Jun 2 13:24:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:24:20.193675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9808072-6238-4776-a3a1-4ab6748cd61e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:20.193793 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9808072-6238-4776-a3a1-4ab6748cd61e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:20.194044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9808072-6238-4776-a3a1-4ab6748cd61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:20.195052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc0e73-8221-4231-9ccc-7c4424f88a5d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:20.211420 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f9808072-6238-4776-a3a1-4ab6748cd61e None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:20.212593 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f9808072-6238-4776-a3a1-4ab6748cd61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:20.219936 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:20.283312 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 538/1065] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:24:20.301822 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc0e73-8221-4231-9ccc-7c4424f88a5d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:20.305819 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9808072-6238-4776-a3a1-4ab6748cd61e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:20.338870 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e57b8-6435-4308-850e-053c8f7cc6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:20.339668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e57b8-6435-4308-850e-053c8f7cc6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:20.339980 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e57b8-6435-4308-850e-053c8f7cc6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:20.340260 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e57b8-6435-4308-850e-053c8f7cc6b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:20.352029 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e57b8-6435-4308-850e-053c8f7cc6b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:20.353524 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e57b8-6435-4308-850e-053c8f7cc6b4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:20.370598 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-015e57b8-6435-4308-850e-053c8f7cc6b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:24:20.370598 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:20.370598 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:20.370598 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:20.370598 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:20.370598 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:20.370598 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:20.370598 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:20.370598 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:20.370598 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:20.370598 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:20.370598 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:20.370598 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:24:20.370598 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:24:20.370598 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:24:20.371486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:24:20.371486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:20.371486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:20.371486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:20.371486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:20.371486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:20.371486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:20.371486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:20.371486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:20.371486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:20.371486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:20.371486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:20.371486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:20.371486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:20.371486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:20.371486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:20.371486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:20.372429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:24:20.372429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:24:20.372429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:24:20.372429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:24:20.376714 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 528/1066] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:24:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:20.377546 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e57b8-6435-4308-850e-053c8f7cc6b4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:20.389297 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:20.414252 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9808072-6238-4776-a3a1-4ab6748cd61e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:20.451764 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7ad28-4317-429d-b98b-f93570d7fcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:20.452613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7ad28-4317-429d-b98b-f93570d7fcca None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:20.452901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7ad28-4317-429d-b98b-f93570d7fcca None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:20.453178 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7ad28-4317-429d-b98b-f93570d7fcca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:20.464193 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7ad28-4317-429d-b98b-f93570d7fcca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:24:20.471813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-27b7ad28-4317-429d-b98b-f93570d7fcca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:24:20.471813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:20.471813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:20.471813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:20.471813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:20.471813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:20.471813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:20.471813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:20.471813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:20.471813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:20.471813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:20.471813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:20.471813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:24:20.471813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:24:20.471813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:24:20.471813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:24:20.472809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:24:20.472809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:24:20.472809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:24:20.472809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:24:20.472809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:20.472809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:20.472809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:20.472809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:20.472809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:20.472809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:20.472809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:20.472809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:20.472809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:20.472809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:20.472809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:20.472809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:20.474512 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:20.474512 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:20.474512 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:20.474512 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:20.474512 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:24:20.474512 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:24:20.474512 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:24:20.474512 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:24:20.474512 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:24:20.474512 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:24:20.474512 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:24:20.474512 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:20.474512 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 539/1067] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:24:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:24:20.479383 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7ad28-4317-429d-b98b-f93570d7fcca None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:20.482630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:20.488070 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e57b8-6435-4308-850e-053c8f7cc6b4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:20.525557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435855ee-3f98-4e76-98c0-87b499f933cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:20.526230 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435855ee-3f98-4e76-98c0-87b499f933cc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:20.526516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435855ee-3f98-4e76-98c0-87b499f933cc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:20.526797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435855ee-3f98-4e76-98c0-87b499f933cc None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:20.527515 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435855ee-3f98-4e76-98c0-87b499f933cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:20.527829 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435855ee-3f98-4e76-98c0-87b499f933cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:20.529237 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435855ee-3f98-4e76-98c0-87b499f933cc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:20.546679 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 529/1068] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:24:20.548788 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435855ee-3f98-4e76-98c0-87b499f933cc None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:20.592993 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7ad28-4317-429d-b98b-f93570d7fcca None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:20.628081 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148dbaa-f9ed-4ba3-8eb8-c53604e91c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:20.628924 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148dbaa-f9ed-4ba3-8eb8-c53604e91c1b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:20.629055 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148dbaa-f9ed-4ba3-8eb8-c53604e91c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:20.629338 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148dbaa-f9ed-4ba3-8eb8-c53604e91c1b None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:20.629741 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:20.630096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148dbaa-f9ed-4ba3-8eb8-c53604e91c1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:20.630409 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148dbaa-f9ed-4ba3-8eb8-c53604e91c1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:20.631788 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148dbaa-f9ed-4ba3-8eb8-c53604e91c1b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:20.645541 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 540/1069] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:24:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:24:20.646912 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148dbaa-f9ed-4ba3-8eb8-c53604e91c1b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:20.670035 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435855ee-3f98-4e76-98c0-87b499f933cc None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:20.704020 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb488f-e409-4984-8295-f775992419f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:20.704831 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb488f-e409-4984-8295-f775992419f5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:20.705111 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb488f-e409-4984-8295-f775992419f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:20.705383 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb488f-e409-4984-8295-f775992419f5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:20.713028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb488f-e409-4984-8295-f775992419f5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:20.714473 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb488f-e409-4984-8295-f775992419f5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:20.715166 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:20.730416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-6ecb488f-e409-4984-8295-f775992419f5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:24:20.730416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:20.730416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:20.730416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:20.730416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:20.730416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:20.730416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:20.730416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:20.730416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:20.730416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:20.730416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:20.730416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:20.730416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:24:20.730416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:24:20.730416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:24:20.730416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:24:20.731443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:20.731443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:20.731443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:24:20.731443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:24:20.731443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:24:20.731443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:24:20.731443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:20.731443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:20.731443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:20.731443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:20.731443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:20.731443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:20.731443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:20.731443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:20.731443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:20.731443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:20.731443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:20.731443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:20.732800 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:20.732800 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:20.732800 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:24:20.732800 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:24:20.732800 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:24:20.732800 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:24:20.732800 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:24:20.732800 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:24:20.732800 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:24:20.732800 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:24:20.736374 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 530/1070] 10.222.0.32 () {56 vars in 1093 bytes} [Thu Jun 2 13:24:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:24:20.737195 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb488f-e409-4984-8295-f775992419f5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:20.758371 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148dbaa-f9ed-4ba3-8eb8-c53604e91c1b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:20.794648 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271de7bf-9d51-4212-9e67-e7fdcec048d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:20.795513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271de7bf-9d51-4212-9e67-e7fdcec048d8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:20.795800 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271de7bf-9d51-4212-9e67-e7fdcec048d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:20.796080 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271de7bf-9d51-4212-9e67-e7fdcec048d8 None admin] PATH_INFO: `/v3/users/da54e771b0b34fec8c294d03d8bcb2cf` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:20.797380 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271de7bf-9d51-4212-9e67-e7fdcec048d8 None admin] RBAC: Authorizing `identity:get_user(user_id=da54e771b0b34fec8c294d03d8bcb2cf)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:20.798751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271de7bf-9d51-4212-9e67-e7fdcec048d8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:20.800566 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 541/1071] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:24:20 2022] GET /identity/v3/users/da54e771b0b34fec8c294d03d8bcb2cf => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:24:20.806470 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271de7bf-9d51-4212-9e67-e7fdcec048d8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:20.849091 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb488f-e409-4984-8295-f775992419f5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:20.877821 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:20.887513 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f54d8-d238-4baf-8f92-8d1f56497704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:20.888920 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f54d8-d238-4baf-8f92-8d1f56497704 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:20.889376 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f54d8-d238-4baf-8f92-8d1f56497704 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:20.890090 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f54d8-d238-4baf-8f92-8d1f56497704 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:20.891237 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f54d8-d238-4baf-8f92-8d1f56497704 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:20.891695 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f54d8-d238-4baf-8f92-8d1f56497704 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:20.893589 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f54d8-d238-4baf-8f92-8d1f56497704 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:20.907098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271de7bf-9d51-4212-9e67-e7fdcec048d8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:20.918201 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 531/1072] 10.222.0.32 () {56 vars in 1133 bytes} [Thu Jun 2 13:24:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:24:20.923985 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f54d8-d238-4baf-8f92-8d1f56497704 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:20.936694 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:20.942496 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439ab3c-7e02-4710-adad-142b1a293b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:20.943362 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439ab3c-7e02-4710-adad-142b1a293b65 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:20.943649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439ab3c-7e02-4710-adad-142b1a293b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:20.943923 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439ab3c-7e02-4710-adad-142b1a293b65 None admin] PATH_INFO: `/v3/projects/2fdc08396e714139b76cdc871034dc16` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:20.945163 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439ab3c-7e02-4710-adad-142b1a293b65 None admin] RBAC: Authorizing `identity:get_project(project_id=2fdc08396e714139b76cdc871034dc16)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:20.946576 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439ab3c-7e02-4710-adad-142b1a293b65 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:20.948598 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 542/1073] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:24:20 2022] GET /identity/v3/projects/2fdc08396e714139b76cdc871034dc16 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:24:20.955125 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439ab3c-7e02-4710-adad-142b1a293b65 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:21.042713 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f54d8-d238-4baf-8f92-8d1f56497704 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:21.076517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd7822-d5eb-4fa0-b2ed-8be01d9de115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:21.077587 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd7822-d5eb-4fa0-b2ed-8be01d9de115 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:21.077874 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd7822-d5eb-4fa0-b2ed-8be01d9de115 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:21.078140 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd7822-d5eb-4fa0-b2ed-8be01d9de115 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:21.079985 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439ab3c-7e02-4710-adad-142b1a293b65 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:21.089318 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd7822-d5eb-4fa0-b2ed-8be01d9de115 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:21.090781 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd7822-d5eb-4fa0-b2ed-8be01d9de115 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:21.111043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-d7cd7822-d5eb-4fa0-b2ed-8be01d9de115 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:24:21.111043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:21.111043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:21.111043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:21.111043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:21.111043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:21.111043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:21.111043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:21.111043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:21.111043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:21.111043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:21.111043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:21.111043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:24:21.111043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:24:21.111043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:24:21.112179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:24:21.112179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:21.112179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:21.112179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:21.112179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:21.112179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:21.112179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:21.112179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:21.112179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:21.112179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:21.112179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:21.112179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:21.112179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:21.112179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:21.112179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:21.112179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:21.112179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:21.113281 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:24:21.113281 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:24:21.113281 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:24:21.113281 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:24:21.113281 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 532/1074] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:24:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:21.118762 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd7822-d5eb-4fa0-b2ed-8be01d9de115 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:21.122039 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558476e-7764-49b3-82ee-38fc8218df3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:21.122932 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558476e-7764-49b3-82ee-38fc8218df3d None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:21.123210 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558476e-7764-49b3-82ee-38fc8218df3d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:21.123483 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558476e-7764-49b3-82ee-38fc8218df3d None admin] PATH_INFO: `/v3/projects/2fdc08396e714139b76cdc871034dc16/users/da54e771b0b34fec8c294d03d8bcb2cf/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:21.125481 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558476e-7764-49b3-82ee-38fc8218df3d None admin] RBAC: Authorizing `identity:create_grant(project_id=2fdc08396e714139b76cdc871034dc16, user_id=da54e771b0b34fec8c294d03d8bcb2cf, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:21.126910 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558476e-7764-49b3-82ee-38fc8218df3d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:21.140785 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 543/1075] 10.222.0.32 () {58 vars in 1439 bytes} [Thu Jun 2 13:24:20 2022] PUT /identity/v3/projects/2fdc08396e714139b76cdc871034dc16/users/da54e771b0b34fec8c294d03d8bcb2cf/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:24:21.167288 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:21.239269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd7822-d5eb-4fa0-b2ed-8be01d9de115 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:21.277201 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a79836-45a9-4c22-8c52-a059b8af06eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:21.277891 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a79836-45a9-4c22-8c52-a059b8af06eb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:21.278183 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a79836-45a9-4c22-8c52-a059b8af06eb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:21.278672 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a79836-45a9-4c22-8c52-a059b8af06eb None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:21.279234 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a79836-45a9-4c22-8c52-a059b8af06eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:21.279547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a79836-45a9-4c22-8c52-a059b8af06eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:21.281007 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a79836-45a9-4c22-8c52-a059b8af06eb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:21.299489 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 533/1076] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:21.301496 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558476e-7764-49b3-82ee-38fc8218df3d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:21.368434 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:21.412089 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558476e-7764-49b3-82ee-38fc8218df3d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:21.444771 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0560f2-e7ff-4774-a64f-5678e12cff23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:21.446089 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0560f2-e7ff-4774-a64f-5678e12cff23 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:21.446377 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0560f2-e7ff-4774-a64f-5678e12cff23 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:21.446650 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0560f2-e7ff-4774-a64f-5678e12cff23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:21.453534 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0560f2-e7ff-4774-a64f-5678e12cff23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:21.454976 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0560f2-e7ff-4774-a64f-5678e12cff23 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:21.469906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-3c0560f2-e7ff-4774-a64f-5678e12cff23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:24:21.469906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:21.469906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:21.469906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:21.469906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:21.469906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:21.469906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:21.469906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:21.469906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:21.469906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:21.469906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:21.469906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:21.469906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:24:21.469906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:24:21.469906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:24:21.470809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:24:21.470809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:21.470809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:21.470809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:21.470809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:21.470809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:21.470809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:21.470809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:21.470809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:21.470809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:21.470809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:21.470809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:21.470809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:21.470809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:21.470809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:21.470809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:21.470809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:21.476699 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:24:21.476699 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:24:21.476699 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:24:21.476699 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:24:21.476699 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:24:21.476699 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:24:21.476699 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:24:21.476699 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:21.476699 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 544/1077] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:24:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:21.478600 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a79836-45a9-4c22-8c52-a059b8af06eb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:21.576370 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:21.581487 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a79836-45a9-4c22-8c52-a059b8af06eb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:21.614824 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596ba42-0a24-450b-bd6d-5ac6974fd45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:21.615477 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596ba42-0a24-450b-bd6d-5ac6974fd45f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:21.615767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596ba42-0a24-450b-bd6d-5ac6974fd45f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:21.616037 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596ba42-0a24-450b-bd6d-5ac6974fd45f None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:21.616845 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f596ba42-0a24-450b-bd6d-5ac6974fd45f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:21.617677 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f596ba42-0a24-450b-bd6d-5ac6974fd45f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:21.619165 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f596ba42-0a24-450b-bd6d-5ac6974fd45f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:21.636658 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 534/1078] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:24:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:21.638239 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0560f2-e7ff-4774-a64f-5678e12cff23 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:21.640164 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ab0a2-48d1-45bc-a2ec-4f74fd977c84 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:21.640494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ab0a2-48d1-45bc-a2ec-4f74fd977c84 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:21.640776 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ab0a2-48d1-45bc-a2ec-4f74fd977c84 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:21.642338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 535/1079] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:24:21.647623 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c0ab4-5a9c-4380-805e-38e7859511db None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:21.647904 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c0ab4-5a9c-4380-805e-38e7859511db None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:21.648180 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c0ab4-5a9c-4380-805e-38e7859511db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:21.665376 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2f4c0ab4-5a9c-4380-805e-38e7859511db None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:21.666562 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2f4c0ab4-5a9c-4380-805e-38e7859511db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:21.740607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 536/1080] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:24:21.745059 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0560f2-e7ff-4774-a64f-5678e12cff23 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:21.765124 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c0ab4-5a9c-4380-805e-38e7859511db None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:21.766696 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:21.782886 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bac97-9949-43f1-8785-1f245b15f1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:21.783767 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bac97-9949-43f1-8785-1f245b15f1bd None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:21.784054 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bac97-9949-43f1-8785-1f245b15f1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:21.784353 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bac97-9949-43f1-8785-1f245b15f1bd None admin] PATH_INFO: `/v3/projects/a9007447059e4862972078c032a5d67b/users/b2e5d9f3c4e04ca3bf52b28b67d2a4d6/roles/f1346f1c619e4ab48ac6d21faa94c720` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:21.786569 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656bac97-9949-43f1-8785-1f245b15f1bd None admin] RBAC: Authorizing `identity:create_grant(project_id=a9007447059e4862972078c032a5d67b, user_id=b2e5d9f3c4e04ca3bf52b28b67d2a4d6, role_id=f1346f1c619e4ab48ac6d21faa94c720)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:21.787998 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656bac97-9949-43f1-8785-1f245b15f1bd None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:21.804385 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 545/1081] 10.222.0.32 () {58 vars in 1439 bytes} [Thu Jun 2 13:24:21 2022] PUT /identity/v3/projects/a9007447059e4862972078c032a5d67b/users/b2e5d9f3c4e04ca3bf52b28b67d2a4d6/roles/f1346f1c619e4ab48ac6d21faa94c720 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:24:21.869356 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:21.885251 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c0ab4-5a9c-4380-805e-38e7859511db None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:21.922359 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476b0a6-1d05-4c12-9614-8e06f42cb6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:21.923032 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476b0a6-1d05-4c12-9614-8e06f42cb6fe None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:21.923318 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476b0a6-1d05-4c12-9614-8e06f42cb6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:21.923595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476b0a6-1d05-4c12-9614-8e06f42cb6fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:22.000444 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476b0a6-1d05-4c12-9614-8e06f42cb6fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:22.001846 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476b0a6-1d05-4c12-9614-8e06f42cb6fe None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:22.092725 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:22.107117 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 537/1082] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:24:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 13:24:22.113143 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bac97-9949-43f1-8785-1f245b15f1bd None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:22.212810 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bac97-9949-43f1-8785-1f245b15f1bd None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:22.247131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f67350-15a5-4ad7-90b7-560c595fa56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:22.247871 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f67350-15a5-4ad7-90b7-560c595fa56f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:22.248158 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f67350-15a5-4ad7-90b7-560c595fa56f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:22.248463 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f67350-15a5-4ad7-90b7-560c595fa56f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:22.258897 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f67350-15a5-4ad7-90b7-560c595fa56f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:22.260431 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f67350-15a5-4ad7-90b7-560c595fa56f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:22.280507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-88f67350-15a5-4ad7-90b7-560c595fa56f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:24:22.280507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:22.280507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:22.280507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:22.280507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:22.280507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:22.280507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:22.280507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:22.280507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:22.280507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:22.280507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:22.280507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:22.280507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:24:22.280507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:24:22.280507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:24:22.281568 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:24:22.281568 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:22.281568 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:22.281568 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:22.281568 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:22.281568 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:22.281568 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:22.281568 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:22.281568 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:22.281568 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:22.281568 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:22.281568 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:22.281568 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:22.281568 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:22.281568 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:22.281568 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:22.281568 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:22.282469 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:24:22.282469 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:24:22.282469 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:24:22.282469 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:22.282469 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 546/1083] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:24:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:24:22.288791 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476b0a6-1d05-4c12-9614-8e06f42cb6fe None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:22.390965 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476b0a6-1d05-4c12-9614-8e06f42cb6fe None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:22.425815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca35b7-cff8-478f-9db6-12578453cc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:22.426484 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca35b7-cff8-478f-9db6-12578453cc7b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:22.426771 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca35b7-cff8-478f-9db6-12578453cc7b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:22.427052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca35b7-cff8-478f-9db6-12578453cc7b None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:22.427772 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca35b7-cff8-478f-9db6-12578453cc7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:22.428080 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca35b7-cff8-478f-9db6-12578453cc7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:22.429538 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca35b7-cff8-478f-9db6-12578453cc7b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:22.448335 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 538/1084] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:23.380080 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a8b0d-1e11-4b55-8151-338509120581 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:23.380665 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a8b0d-1e11-4b55-8151-338509120581 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:23.380665 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a8b0d-1e11-4b55-8151-338509120581 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:23.382035 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 547/1085] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:23.387573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51813a-8067-4364-b987-f4d9f885657b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:23.387967 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51813a-8067-4364-b987-f4d9f885657b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:23.388276 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51813a-8067-4364-b987-f4d9f885657b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:23.405351 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5c51813a-8067-4364-b987-f4d9f885657b None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:23.406554 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5c51813a-8067-4364-b987-f4d9f885657b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:23.449511 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:23.473990 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 539/1086] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:24:23.497595 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a8b0d-1e11-4b55-8151-338509120581 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:23.528727 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:23.599288 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a8b0d-1e11-4b55-8151-338509120581 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:23.632345 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1534b-6d8c-482e-b60b-68a07dd94d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:23.633608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1534b-6d8c-482e-b60b-68a07dd94d74 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:23.633895 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1534b-6d8c-482e-b60b-68a07dd94d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:23.634174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1534b-6d8c-482e-b60b-68a07dd94d74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:23.644078 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf1534b-6d8c-482e-b60b-68a07dd94d74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:24:23.652229 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-cbf1534b-6d8c-482e-b60b-68a07dd94d74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:24:23.652229 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:23.652229 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:23.652229 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:23.652229 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:23.652229 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:23.652229 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:23.652229 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:23.652229 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:23.652229 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:23.652229 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:23.652229 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:23.652229 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:24:23.652229 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:24:23.652229 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:24:23.652229 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:24:23.653328 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:24:23.653328 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:24:23.653328 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:24:23.653328 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:24:23.653328 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:23.653328 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:23.653328 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:23.653328 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:23.653328 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:23.653328 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:23.653328 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:23.653328 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:23.653328 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:23.653328 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:23.653328 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:23.653328 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:23.654180 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:23.654180 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:23.654180 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:23.654180 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:23.654180 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:24:23.654180 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:24:23.654180 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:24:23.654180 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:24:23.654180 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:24:23.654180 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:24:23.654180 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:24:23.654180 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:23.654180 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 548/1087] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:24:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:23.659501 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51813a-8067-4364-b987-f4d9f885657b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:23.764184 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51813a-8067-4364-b987-f4d9f885657b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:23.796859 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b45fa-efef-44d6-ab77-04cd1057986f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:23.797516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b45fa-efef-44d6-ab77-04cd1057986f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:23.797798 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b45fa-efef-44d6-ab77-04cd1057986f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:23.798073 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b45fa-efef-44d6-ab77-04cd1057986f None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:23.798810 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b45fa-efef-44d6-ab77-04cd1057986f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:23.799117 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b45fa-efef-44d6-ab77-04cd1057986f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:23.800521 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b45fa-efef-44d6-ab77-04cd1057986f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:23.808977 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 540/1088] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:24:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:23.814799 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1534b-6d8c-482e-b60b-68a07dd94d74 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:23.905954 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:23.915433 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1534b-6d8c-482e-b60b-68a07dd94d74 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:23.947459 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff06160-0d8d-4930-8988-cb6afd8f0317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:23.948336 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff06160-0d8d-4930-8988-cb6afd8f0317 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:23.948623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff06160-0d8d-4930-8988-cb6afd8f0317 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:23.948898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff06160-0d8d-4930-8988-cb6afd8f0317 None admin] PATH_INFO: `/v3/users/da54e771b0b34fec8c294d03d8bcb2cf` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:23.950075 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff06160-0d8d-4930-8988-cb6afd8f0317 None admin] RBAC: Authorizing `identity:get_user(user_id=da54e771b0b34fec8c294d03d8bcb2cf)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:23.951500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff06160-0d8d-4930-8988-cb6afd8f0317 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:23.953167 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 549/1089] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:24:23 2022] GET /identity/v3/users/da54e771b0b34fec8c294d03d8bcb2cf => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:23.958969 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b45fa-efef-44d6-ab77-04cd1057986f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:24.003377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:24.051494 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e094f-45e3-4ee1-b3d6-d9995b85a893 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:24.051783 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e094f-45e3-4ee1-b3d6-d9995b85a893 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:24.052067 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e094f-45e3-4ee1-b3d6-d9995b85a893 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:24.053619 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 550/1090] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:24.058238 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d455afa-076a-4cb2-829b-c8030b1d36d6 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:24.058526 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d455afa-076a-4cb2-829b-c8030b1d36d6 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:24.058807 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d455afa-076a-4cb2-829b-c8030b1d36d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:24.066447 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b45fa-efef-44d6-ab77-04cd1057986f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:24.075148 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-9d455afa-076a-4cb2-829b-c8030b1d36d6 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:24.076376 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9d455afa-076a-4cb2-829b-c8030b1d36d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:24.099856 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95262ec9-c9e5-4539-830d-fba25ed771fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:24.100669 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95262ec9-c9e5-4539-830d-fba25ed771fd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:24.100954 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95262ec9-c9e5-4539-830d-fba25ed771fd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:24.101231 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95262ec9-c9e5-4539-830d-fba25ed771fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:24.144128 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 551/1091] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:24:24.168394 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d455afa-076a-4cb2-829b-c8030b1d36d6 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:24.172350 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95262ec9-c9e5-4539-830d-fba25ed771fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:24.173843 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95262ec9-c9e5-4539-830d-fba25ed771fd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:24.213992 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:24.256151 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:24.266638 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d455afa-076a-4cb2-829b-c8030b1d36d6 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:24.270350 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 541/1092] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:24:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 13:24:24.276772 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95262ec9-c9e5-4539-830d-fba25ed771fd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:24.301983 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbb87e-51a7-4f86-b6ae-8966a9385467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:24.302805 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbb87e-51a7-4f86-b6ae-8966a9385467 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:24.303099 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbb87e-51a7-4f86-b6ae-8966a9385467 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:24.303371 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbb87e-51a7-4f86-b6ae-8966a9385467 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:24.314675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cbb87e-51a7-4f86-b6ae-8966a9385467 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:24:24.323967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-96cbb87e-51a7-4f86-b6ae-8966a9385467 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:24:24.323967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:24.323967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:24.323967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:24.323967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:24.323967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:24.323967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:24.323967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:24.323967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:24.323967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:24.323967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:24.323967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:24.323967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:24:24.323967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:24:24.323967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:24:24.323967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:24:24.325213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:24:24.325213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:24:24.325213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:24:24.325213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:24:24.325213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:24.325213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:24.325213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:24.325213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:24.325213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:24.325213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:24.325213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:24.325213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:24.325213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:24.325213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:24.325213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:24.325213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:24.326335 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:24.326335 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:24.326335 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:24.326335 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:24.326335 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:24:24.326335 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:24:24.326335 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:24:24.326335 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:24:24.326335 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:24:24.326335 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:24:24.326335 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:24:24.326335 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:24.327253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 552/1093] 10.222.0.32 () {56 vars in 1120 bytes} [Thu Jun 2 13:24:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:24:24.331098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbb87e-51a7-4f86-b6ae-8966a9385467 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:24.373842 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95262ec9-c9e5-4539-830d-fba25ed771fd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:24.408457 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6f657-4d68-4511-8924-9f570d59fb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:24.409322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6f657-4d68-4511-8924-9f570d59fb25 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:24.409610 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6f657-4d68-4511-8924-9f570d59fb25 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:24.409889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6f657-4d68-4511-8924-9f570d59fb25 None admin] PATH_INFO: `/v3/projects/2fdc08396e714139b76cdc871034dc16` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:24.411081 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6f657-4d68-4511-8924-9f570d59fb25 None admin] RBAC: Authorizing `identity:get_project(project_id=2fdc08396e714139b76cdc871034dc16)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:24.412580 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6f657-4d68-4511-8924-9f570d59fb25 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:24.414326 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 542/1094] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:24:24 2022] GET /identity/v3/projects/2fdc08396e714139b76cdc871034dc16 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:24:24.420263 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6f657-4d68-4511-8924-9f570d59fb25 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:24.430366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:24.432733 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbb87e-51a7-4f86-b6ae-8966a9385467 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:24.466192 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af6738-18ad-4c06-8250-2297e1e515f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:24.466843 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af6738-18ad-4c06-8250-2297e1e515f7 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:24.467127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af6738-18ad-4c06-8250-2297e1e515f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:24.467402 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af6738-18ad-4c06-8250-2297e1e515f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:24.468217 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af6738-18ad-4c06-8250-2297e1e515f7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:24.468553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af6738-18ad-4c06-8250-2297e1e515f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:24.469910 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af6738-18ad-4c06-8250-2297e1e515f7 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:24.477613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 553/1095] 10.222.0.32 () {56 vars in 1115 bytes} [Thu Jun 2 13:24:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:24:24.483202 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af6738-18ad-4c06-8250-2297e1e515f7 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:24.497708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:24.519530 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6f657-4d68-4511-8924-9f570d59fb25 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:24.553371 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc8d89-6093-47c6-93f8-10cc6f884187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:24.554021 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc8d89-6093-47c6-93f8-10cc6f884187 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:24.554308 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc8d89-6093-47c6-93f8-10cc6f884187 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:24.555112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc8d89-6093-47c6-93f8-10cc6f884187 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:24.555940 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc8d89-6093-47c6-93f8-10cc6f884187 None admin] RBAC: Adding query filter params (role.id=128feb04d1e042ac844f9ad70b89bb02, scope.project.id=2fdc08396e714139b76cdc871034dc16, user.id=da54e771b0b34fec8c294d03d8bcb2cf) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:24.556256 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc8d89-6093-47c6-93f8-10cc6f884187 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:24.557726 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc8d89-6093-47c6-93f8-10cc6f884187 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:24.563444 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 543/1096] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:24:24 2022] GET /identity/v3/role_assignments?user.id=da54e771b0b34fec8c294d03d8bcb2cf&scope.project.id=2fdc08396e714139b76cdc871034dc16&role.id=128feb04d1e042ac844f9ad70b89bb02 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:24:24.583199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af6738-18ad-4c06-8250-2297e1e515f7 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:24.619838 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a80c3d-bc0e-4e5b-bb7d-d439194331f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:24.620678 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a80c3d-bc0e-4e5b-bb7d-d439194331f5 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:24.620965 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a80c3d-bc0e-4e5b-bb7d-d439194331f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:24.621242 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a80c3d-bc0e-4e5b-bb7d-d439194331f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:24.633302 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a80c3d-bc0e-4e5b-bb7d-d439194331f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:24.634788 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a80c3d-bc0e-4e5b-bb7d-d439194331f5 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:24.653382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-c7a80c3d-bc0e-4e5b-bb7d-d439194331f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:24:24.653382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:24.653382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:24.653382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:24.653382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:24.653382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:24.653382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:24.653382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:24.653382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:24.653382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:24.653382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:24.653382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:24.653382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:24:24.653382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:24:24.653382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:24:24.654513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:24:24.654513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:24.654513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:24.654513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:24.654513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:24.654513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:24.654513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:24.654513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:24.654513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:24.654513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:24.654513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:24.654513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:24.654513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:24.654513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:24.654513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:24.654513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:24.654513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:24.655417 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:24:24.655417 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:24:24.655417 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:24:24.655417 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:24.655417 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 554/1097] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:24:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:24:24.660614 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc8d89-6093-47c6-93f8-10cc6f884187 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:24.734721 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:24.765802 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc8d89-6093-47c6-93f8-10cc6f884187 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:24.801029 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a75c6-2dab-4afc-9326-05102e359c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:24.801688 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a75c6-2dab-4afc-9326-05102e359c93 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:24.801971 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a75c6-2dab-4afc-9326-05102e359c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:24.802248 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a75c6-2dab-4afc-9326-05102e359c93 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:24.802963 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a75c6-2dab-4afc-9326-05102e359c93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:24.803266 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a75c6-2dab-4afc-9326-05102e359c93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:24.804702 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a75c6-2dab-4afc-9326-05102e359c93 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:24.815948 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 544/1098] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:24.821785 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a80c3d-bc0e-4e5b-bb7d-d439194331f5 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:24.882408 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:24.920990 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a80c3d-bc0e-4e5b-bb7d-d439194331f5 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:24.953171 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f0a3b-d7b7-4d1e-8153-8a79327f0245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:24.953951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f0a3b-d7b7-4d1e-8153-8a79327f0245 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:24.954231 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f0a3b-d7b7-4d1e-8153-8a79327f0245 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:24.954502 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f0a3b-d7b7-4d1e-8153-8a79327f0245 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:24.962660 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f0a3b-d7b7-4d1e-8153-8a79327f0245 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:24.964091 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f0a3b-d7b7-4d1e-8153-8a79327f0245 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:24.977644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-cb0f0a3b-d7b7-4d1e-8153-8a79327f0245 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:24:24.977644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:24.977644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:24.977644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:24.977644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:24.977644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:24.977644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:24.977644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:24.977644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:24.977644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:24.977644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:24.977644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:24.977644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:24:24.977644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:24:24.977644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:24:24.977644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:24:24.978716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:24.978716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:24.978716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:24:24.978716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:24:24.978716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:24:24.978716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:24:24.978716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:24.978716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:24.978716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:24.978716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:24.978716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:24.978716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:24.978716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:24.978716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:24.978716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:24.978716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:24.978716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:24.978716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:24.979727 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:24.979727 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:24.979727 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:24:24.979727 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:24:24.979727 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:24:24.979727 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:24:24.979727 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:24:24.979727 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:24:24.979727 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:24:24.979727 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:24.979727 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 555/1099] 10.222.0.32 () {56 vars in 1093 bytes} [Thu Jun 2 13:24:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:24.984515 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a75c6-2dab-4afc-9326-05102e359c93 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:25.082759 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a75c6-2dab-4afc-9326-05102e359c93 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:25.111477 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:25.116871 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9142dd-d862-4e1d-bc53-66437b2d5d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:25.117564 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9142dd-d862-4e1d-bc53-66437b2d5d66 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:25.117846 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9142dd-d862-4e1d-bc53-66437b2d5d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:25.118121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9142dd-d862-4e1d-bc53-66437b2d5d66 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:25.118956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9142dd-d862-4e1d-bc53-66437b2d5d66 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:25.119271 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9142dd-d862-4e1d-bc53-66437b2d5d66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:25.120733 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9142dd-d862-4e1d-bc53-66437b2d5d66 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:25.138336 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 545/1100] 10.222.0.32 () {56 vars in 1133 bytes} [Thu Jun 2 13:24:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:25.143879 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f0a3b-d7b7-4d1e-8153-8a79327f0245 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:25.240588 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f0a3b-d7b7-4d1e-8153-8a79327f0245 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:25.263183 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:25.275034 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb50fbc-74b7-46fc-bb8a-922da93e8139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:25.275687 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb50fbc-74b7-46fc-bb8a-922da93e8139 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:25.275977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb50fbc-74b7-46fc-bb8a-922da93e8139 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:25.276256 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb50fbc-74b7-46fc-bb8a-922da93e8139 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:25.342376 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb50fbc-74b7-46fc-bb8a-922da93e8139 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:25.343830 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb50fbc-74b7-46fc-bb8a-922da93e8139 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:25.438958 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 556/1101] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:24:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 13:24:25.444598 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9142dd-d862-4e1d-bc53-66437b2d5d66 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:25.541731 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9142dd-d862-4e1d-bc53-66437b2d5d66 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:25.577493 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e93d69-29ff-458e-9d8d-05705baa76b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:25.578275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e93d69-29ff-458e-9d8d-05705baa76b1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:25.578557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e93d69-29ff-458e-9d8d-05705baa76b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:25.578829 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e93d69-29ff-458e-9d8d-05705baa76b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:25.588945 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e93d69-29ff-458e-9d8d-05705baa76b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:25.590399 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e93d69-29ff-458e-9d8d-05705baa76b1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:25.607268 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-68e93d69-29ff-458e-9d8d-05705baa76b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:24:25.607268 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:25.607268 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:25.607268 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:25.607268 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:25.607268 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:25.607268 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:25.607268 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:25.607268 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:25.607268 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:25.607268 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:25.607268 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:25.607268 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:24:25.607268 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:24:25.607268 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:24:25.608289 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:24:25.608289 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:25.608289 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:25.608289 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:25.608289 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:25.608289 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:25.608289 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:25.608289 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:25.608289 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:25.608289 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:25.608289 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:25.608289 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:25.608289 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:25.608289 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:25.608289 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:25.608289 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:25.608289 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:25.609284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:24:25.609284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:24:25.609284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:24:25.609284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:24:25.609284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 546/1102] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:24:25.614067 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb50fbc-74b7-46fc-bb8a-922da93e8139 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:25.638525 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:25.713279 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb50fbc-74b7-46fc-bb8a-922da93e8139 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:25.746927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0250d-1a9e-41cf-aa6b-85d78d7fc630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:25.747578 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0250d-1a9e-41cf-aa6b-85d78d7fc630 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:25.747859 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0250d-1a9e-41cf-aa6b-85d78d7fc630 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:25.748132 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0250d-1a9e-41cf-aa6b-85d78d7fc630 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:25.748880 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0250d-1a9e-41cf-aa6b-85d78d7fc630 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:25.749184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0250d-1a9e-41cf-aa6b-85d78d7fc630 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:25.750541 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0250d-1a9e-41cf-aa6b-85d78d7fc630 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:25.761500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 557/1103] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:25.766933 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e93d69-29ff-458e-9d8d-05705baa76b1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:25.810028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:25.865254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e93d69-29ff-458e-9d8d-05705baa76b1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:25.898181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f979b0-6577-415a-a6d7-3127372f6c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:25.898963 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f979b0-6577-415a-a6d7-3127372f6c69 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:25.899249 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f979b0-6577-415a-a6d7-3127372f6c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:25.899528 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f979b0-6577-415a-a6d7-3127372f6c69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:25.906150 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f979b0-6577-415a-a6d7-3127372f6c69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:25.907600 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f979b0-6577-415a-a6d7-3127372f6c69 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:25.921606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-91f979b0-6577-415a-a6d7-3127372f6c69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:24:25.921606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:25.921606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:25.921606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:25.921606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:25.921606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:25.921606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:25.921606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:25.921606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:25.921606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:25.921606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:25.921606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:25.921606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:24:25.921606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:24:25.921606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:24:25.922494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:24:25.922494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:25.922494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:25.922494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:25.922494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:25.922494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:25.922494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:25.922494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:25.922494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:25.922494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:25.922494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:25.922494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:25.922494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:25.922494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:25.922494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:25.922494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:25.922494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:25.923470 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:24:25.923470 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:24:25.923470 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:24:25.923470 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:24:25.923470 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:24:25.923470 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:24:25.923470 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:24:25.923470 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:24:25.923470 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 547/1104] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:24:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:25.928549 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0250d-1a9e-41cf-aa6b-85d78d7fc630 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:26.016320 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:26.031896 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0250d-1a9e-41cf-aa6b-85d78d7fc630 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:26.064910 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762825a-087c-4f61-9b0c-07a3f9ba466a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:26.065498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762825a-087c-4f61-9b0c-07a3f9ba466a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:26.065782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762825a-087c-4f61-9b0c-07a3f9ba466a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:26.066060 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762825a-087c-4f61-9b0c-07a3f9ba466a None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:26.066841 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762825a-087c-4f61-9b0c-07a3f9ba466a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:26.067151 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762825a-087c-4f61-9b0c-07a3f9ba466a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:26.068598 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762825a-087c-4f61-9b0c-07a3f9ba466a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:26.080049 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 558/1105] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:24:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:26.086467 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f979b0-6577-415a-a6d7-3127372f6c69 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:26.183720 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f979b0-6577-415a-a6d7-3127372f6c69 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:26.185286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:26.218130 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18bf659-89ba-4de2-8747-7dae6cd7fa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:26.218784 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bf659-89ba-4de2-8747-7dae6cd7fa41 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:26.219071 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bf659-89ba-4de2-8747-7dae6cd7fa41 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:26.219350 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bf659-89ba-4de2-8747-7dae6cd7fa41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:26.220185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bf659-89ba-4de2-8747-7dae6cd7fa41 None admin] RBAC: Adding query filter params (role.id=f1346f1c619e4ab48ac6d21faa94c720, scope.project.id=a9007447059e4862972078c032a5d67b, user.id=b2e5d9f3c4e04ca3bf52b28b67d2a4d6) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:26.220532 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bf659-89ba-4de2-8747-7dae6cd7fa41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:26.221976 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bf659-89ba-4de2-8747-7dae6cd7fa41 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:26.228363 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 548/1106] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:24:26 2022] GET /identity/v3/role_assignments?user.id=b2e5d9f3c4e04ca3bf52b28b67d2a4d6&scope.project.id=a9007447059e4862972078c032a5d67b&role.id=f1346f1c619e4ab48ac6d21faa94c720 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:26.831476 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67c9df-f122-4be6-b027-17a5cf0c0981 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:26.832019 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67c9df-f122-4be6-b027-17a5cf0c0981 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:26.832019 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67c9df-f122-4be6-b027-17a5cf0c0981 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:26.833440 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 559/1107] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:26.839524 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8be45-6f63-4270-bd9d-0c597cfc1cf3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:26.839926 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8be45-6f63-4270-bd9d-0c597cfc1cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:26.840094 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8be45-6f63-4270-bd9d-0c597cfc1cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:26.857581 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b5d8be45-6f63-4270-bd9d-0c597cfc1cf3 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:26.858767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b5d8be45-6f63-4270-bd9d-0c597cfc1cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:26.926544 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 549/1108] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:24:26.951014 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67c9df-f122-4be6-b027-17a5cf0c0981 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:27.060747 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67c9df-f122-4be6-b027-17a5cf0c0981 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:27.098930 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e7294-a246-4661-b60d-c1de8ec2df36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:27.099639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e7294-a246-4661-b60d-c1de8ec2df36 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:27.099919 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e7294-a246-4661-b60d-c1de8ec2df36 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:27.100188 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e7294-a246-4661-b60d-c1de8ec2df36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:27.101414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e7294-a246-4661-b60d-c1de8ec2df36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:27.102829 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e7294-a246-4661-b60d-c1de8ec2df36 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:27.104448 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 560/1109] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:24:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:27.110136 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8be45-6f63-4270-bd9d-0c597cfc1cf3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:27.200471 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:27.206488 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8be45-6f63-4270-bd9d-0c597cfc1cf3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:27.239395 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7fe36c-609f-46a2-979b-b6658d0c25ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:27.240043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fe36c-609f-46a2-979b-b6658d0c25ea None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:27.240344 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fe36c-609f-46a2-979b-b6658d0c25ea None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:27.240622 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fe36c-609f-46a2-979b-b6658d0c25ea None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:27.241328 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7fe36c-609f-46a2-979b-b6658d0c25ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:27.243317 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7fe36c-609f-46a2-979b-b6658d0c25ea None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:27.262386 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 550/1110] 10.222.0.32 () {60 vars in 1132 bytes} [Thu Jun 2 13:24:27 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:24:29.523464 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d43ad0-e64e-4bb3-a504-c5bbf4bef4af None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:29.523993 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d43ad0-e64e-4bb3-a504-c5bbf4bef4af None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:29.523993 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d43ad0-e64e-4bb3-a504-c5bbf4bef4af None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:29.525421 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 561/1111] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:29.530773 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f026376-707c-49c9-a2b3-2f4d203a66c7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:29.531207 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f026376-707c-49c9-a2b3-2f4d203a66c7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:29.531309 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f026376-707c-49c9-a2b3-2f4d203a66c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:29.548179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7f026376-707c-49c9-a2b3-2f4d203a66c7 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:29.549381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7f026376-707c-49c9-a2b3-2f4d203a66c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:29.612811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 551/1112] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:24:29.636614 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d43ad0-e64e-4bb3-a504-c5bbf4bef4af None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:29.650883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:29.734050 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d43ad0-e64e-4bb3-a504-c5bbf4bef4af None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:29.767219 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816e00f-b1e6-45dd-ad4e-08776a708f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:29.768059 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816e00f-b1e6-45dd-ad4e-08776a708f3d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:29.768367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816e00f-b1e6-45dd-ad4e-08776a708f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:29.768646 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816e00f-b1e6-45dd-ad4e-08776a708f3d None admin] PATH_INFO: `/v3/roles/5fe1cb1c673a407bb1025d500f111390` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:29.770105 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816e00f-b1e6-45dd-ad4e-08776a708f3d None admin] RBAC: Authorizing `identity:get_role(role_id=5fe1cb1c673a407bb1025d500f111390)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:29.771461 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816e00f-b1e6-45dd-ad4e-08776a708f3d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:29.772847 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 562/1113] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:24:29 2022] GET /identity/v3/roles/5fe1cb1c673a407bb1025d500f111390 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:29.778658 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f026376-707c-49c9-a2b3-2f4d203a66c7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:29.859890 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:29.877951 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f026376-707c-49c9-a2b3-2f4d203a66c7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:29.910779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0a2fc-18d2-45eb-af22-7b6cba6763fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:29.911630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0a2fc-18d2-45eb-af22-7b6cba6763fd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:29.911911 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0a2fc-18d2-45eb-af22-7b6cba6763fd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:29.912187 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0a2fc-18d2-45eb-af22-7b6cba6763fd None admin] PATH_INFO: `/v3/users/d60587dde681451caf41e42cc94597cc` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:29.925441 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0a2fc-18d2-45eb-af22-7b6cba6763fd None admin] RBAC: Authorizing `identity:get_user(user_id=d60587dde681451caf41e42cc94597cc)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:29.926909 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0a2fc-18d2-45eb-af22-7b6cba6763fd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:29.928555 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 552/1114] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:24:29 2022] GET /identity/v3/users/d60587dde681451caf41e42cc94597cc => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:29.934280 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816e00f-b1e6-45dd-ad4e-08776a708f3d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:30.011273 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:30.030515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816e00f-b1e6-45dd-ad4e-08776a708f3d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:30.063130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dbd19b-cc8d-4f93-8bae-963e31dd0aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:30.063766 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbd19b-cc8d-4f93-8bae-963e31dd0aee None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:30.064050 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbd19b-cc8d-4f93-8bae-963e31dd0aee None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:30.064342 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbd19b-cc8d-4f93-8bae-963e31dd0aee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:30.128243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dbd19b-cc8d-4f93-8bae-963e31dd0aee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:30.129706 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dbd19b-cc8d-4f93-8bae-963e31dd0aee None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:30.204679 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:30.224103 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 563/1115] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:24:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:24:30.229934 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0a2fc-18d2-45eb-af22-7b6cba6763fd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:30.324277 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0a2fc-18d2-45eb-af22-7b6cba6763fd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:30.357063 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d74bac-a235-4e4f-aa71-d1ac4f1778bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:30.357904 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d74bac-a235-4e4f-aa71-d1ac4f1778bb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:30.358191 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d74bac-a235-4e4f-aa71-d1ac4f1778bb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:30.358470 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d74bac-a235-4e4f-aa71-d1ac4f1778bb None admin] PATH_INFO: `/v3/projects/2fdc08396e714139b76cdc871034dc16` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:30.359660 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d74bac-a235-4e4f-aa71-d1ac4f1778bb None admin] RBAC: Authorizing `identity:get_project(project_id=2fdc08396e714139b76cdc871034dc16)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:30.361118 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d74bac-a235-4e4f-aa71-d1ac4f1778bb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:30.362785 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 553/1116] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:24:30 2022] GET /identity/v3/projects/2fdc08396e714139b76cdc871034dc16 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:30.368615 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dbd19b-cc8d-4f93-8bae-963e31dd0aee None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:30.463965 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dbd19b-cc8d-4f93-8bae-963e31dd0aee None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:30.495990 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c2d0e-5883-44a1-96bc-f4d19d83a32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:30.496650 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c2d0e-5883-44a1-96bc-f4d19d83a32c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:30.496942 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c2d0e-5883-44a1-96bc-f4d19d83a32c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:30.497219 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c2d0e-5883-44a1-96bc-f4d19d83a32c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:30.498042 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c2d0e-5883-44a1-96bc-f4d19d83a32c None admin] RBAC: Adding query filter params (role.id=5fe1cb1c673a407bb1025d500f111390, scope.project.id=2fdc08396e714139b76cdc871034dc16, user.id=d60587dde681451caf41e42cc94597cc) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:30.498354 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c2d0e-5883-44a1-96bc-f4d19d83a32c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:30.499773 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c2d0e-5883-44a1-96bc-f4d19d83a32c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:30.505041 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 564/1117] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:24:30 2022] GET /identity/v3/role_assignments?user.id=d60587dde681451caf41e42cc94597cc&scope.project.id=2fdc08396e714139b76cdc871034dc16&role.id=5fe1cb1c673a407bb1025d500f111390 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:32.677115 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f3513-54bd-4cfc-9b1e-a1d9e7f62b72 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:32.677663 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f3513-54bd-4cfc-9b1e-a1d9e7f62b72 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:32.677663 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f3513-54bd-4cfc-9b1e-a1d9e7f62b72 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:32.679020 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 554/1118] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:32.684170 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b23f7-a8f6-4355-8c58-b25b84ac0d23 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:32.684642 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b23f7-a8f6-4355-8c58-b25b84ac0d23 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:32.684748 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b23f7-a8f6-4355-8c58-b25b84ac0d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:32.701478 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e09b23f7-a8f6-4355-8c58-b25b84ac0d23 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:32.702650 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e09b23f7-a8f6-4355-8c58-b25b84ac0d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:32.740447 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:32.767142 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 565/1119] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:24:32.790191 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f3513-54bd-4cfc-9b1e-a1d9e7f62b72 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:32.800900 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:32.889752 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f3513-54bd-4cfc-9b1e-a1d9e7f62b72 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:32.921684 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55115712-a15e-4ed8-800c-00dec431ef25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:32.922517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55115712-a15e-4ed8-800c-00dec431ef25 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:32.922800 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55115712-a15e-4ed8-800c-00dec431ef25 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:32.923073 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55115712-a15e-4ed8-800c-00dec431ef25 None admin] PATH_INFO: `/v3/roles/5fe1cb1c673a407bb1025d500f111390` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:32.924550 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55115712-a15e-4ed8-800c-00dec431ef25 None admin] RBAC: Authorizing `identity:get_role(role_id=5fe1cb1c673a407bb1025d500f111390)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:32.925924 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55115712-a15e-4ed8-800c-00dec431ef25 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:32.927319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 555/1120] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:24:32 2022] GET /identity/v3/roles/5fe1cb1c673a407bb1025d500f111390 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:24:32.933399 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b23f7-a8f6-4355-8c58-b25b84ac0d23 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:33.027365 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b23f7-a8f6-4355-8c58-b25b84ac0d23 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:33.059503 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22245388-8428-4d4b-a322-ff11e6d2976f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:33.060391 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22245388-8428-4d4b-a322-ff11e6d2976f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:33.060674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22245388-8428-4d4b-a322-ff11e6d2976f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:33.060946 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22245388-8428-4d4b-a322-ff11e6d2976f None admin] PATH_INFO: `/v3/users/d60587dde681451caf41e42cc94597cc` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:33.062112 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22245388-8428-4d4b-a322-ff11e6d2976f None admin] RBAC: Authorizing `identity:get_user(user_id=d60587dde681451caf41e42cc94597cc)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:33.063548 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22245388-8428-4d4b-a322-ff11e6d2976f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:33.065184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 566/1121] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:24:32 2022] GET /identity/v3/users/d60587dde681451caf41e42cc94597cc => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:33.071008 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55115712-a15e-4ed8-800c-00dec431ef25 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:33.145998 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:33.168400 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55115712-a15e-4ed8-800c-00dec431ef25 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:33.202006 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c1de4-7cbe-4893-8606-3b82a828b678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:33.202796 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c1de4-7cbe-4893-8606-3b82a828b678 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:33.203080 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c1de4-7cbe-4893-8606-3b82a828b678 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:33.203357 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c1de4-7cbe-4893-8606-3b82a828b678 None admin] PATH_INFO: `/v3/projects/2fdc08396e714139b76cdc871034dc16` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:33.204550 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c1de4-7cbe-4893-8606-3b82a828b678 None admin] RBAC: Authorizing `identity:get_project(project_id=2fdc08396e714139b76cdc871034dc16)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:33.205993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c1de4-7cbe-4893-8606-3b82a828b678 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:33.207665 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 556/1122] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:24:33 2022] GET /identity/v3/projects/2fdc08396e714139b76cdc871034dc16 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:33.213733 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22245388-8428-4d4b-a322-ff11e6d2976f None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:33.255589 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:33.309073 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22245388-8428-4d4b-a322-ff11e6d2976f None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:33.340837 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb729e-5a4d-4d77-89fa-0927387d81a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:33.341696 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb729e-5a4d-4d77-89fa-0927387d81a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:33.341978 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb729e-5a4d-4d77-89fa-0927387d81a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:33.342253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb729e-5a4d-4d77-89fa-0927387d81a2 None admin] PATH_INFO: `/v3/projects/2fdc08396e714139b76cdc871034dc16/users/d60587dde681451caf41e42cc94597cc/roles/5fe1cb1c673a407bb1025d500f111390` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:33.344427 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb729e-5a4d-4d77-89fa-0927387d81a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=2fdc08396e714139b76cdc871034dc16, user_id=d60587dde681451caf41e42cc94597cc, role_id=5fe1cb1c673a407bb1025d500f111390)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:33.345838 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb729e-5a4d-4d77-89fa-0927387d81a2 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:33.359268 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 567/1123] 10.222.0.32 () {58 vars in 1439 bytes} [Thu Jun 2 13:24:33 2022] PUT /identity/v3/projects/2fdc08396e714139b76cdc871034dc16/users/d60587dde681451caf41e42cc94597cc/roles/5fe1cb1c673a407bb1025d500f111390 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:24:35.559291 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e3219-da78-45f6-8ca2-b2dd56ff8c33 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:35.559812 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e3219-da78-45f6-8ca2-b2dd56ff8c33 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:35.559924 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e3219-da78-45f6-8ca2-b2dd56ff8c33 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:35.561352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 557/1124] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:35.566579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5454be-f8d7-4150-a2ee-94739a3a6023 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:35.566956 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5454be-f8d7-4150-a2ee-94739a3a6023 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:35.567128 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5454be-f8d7-4150-a2ee-94739a3a6023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:35.583818 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-5d5454be-f8d7-4150-a2ee-94739a3a6023 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:35.585017 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5d5454be-f8d7-4150-a2ee-94739a3a6023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:35.649109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 568/1125] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:24:35.672271 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e3219-da78-45f6-8ca2-b2dd56ff8c33 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:35.770377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e3219-da78-45f6-8ca2-b2dd56ff8c33 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:35.804885 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b2c4e-0bd0-47c0-928b-e84912aad7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:35.805758 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b2c4e-0bd0-47c0-928b-e84912aad7e4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:35.806045 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b2c4e-0bd0-47c0-928b-e84912aad7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:35.806323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b2c4e-0bd0-47c0-928b-e84912aad7e4 None admin] PATH_INFO: `/v3/roles/5fe1cb1c673a407bb1025d500f111390` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:35.807808 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b2c4e-0bd0-47c0-928b-e84912aad7e4 None admin] RBAC: Authorizing `identity:get_role(role_id=5fe1cb1c673a407bb1025d500f111390)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:35.809220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b2c4e-0bd0-47c0-928b-e84912aad7e4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:35.810700 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 558/1126] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:24:35 2022] GET /identity/v3/roles/5fe1cb1c673a407bb1025d500f111390 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:35.816423 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5454be-f8d7-4150-a2ee-94739a3a6023 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:35.846570 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:35.913963 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5454be-f8d7-4150-a2ee-94739a3a6023 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:35.946693 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec11501-80eb-43b4-8aca-b6eb722b3baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:35.947538 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec11501-80eb-43b4-8aca-b6eb722b3baa None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:35.947821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec11501-80eb-43b4-8aca-b6eb722b3baa None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:35.948095 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec11501-80eb-43b4-8aca-b6eb722b3baa None admin] PATH_INFO: `/v3/users/d60587dde681451caf41e42cc94597cc` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:35.949290 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec11501-80eb-43b4-8aca-b6eb722b3baa None admin] RBAC: Authorizing `identity:get_user(user_id=d60587dde681451caf41e42cc94597cc)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:35.950702 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec11501-80eb-43b4-8aca-b6eb722b3baa None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:35.952286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 569/1127] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:24:35 2022] GET /identity/v3/users/d60587dde681451caf41e42cc94597cc => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:35.957857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b2c4e-0bd0-47c0-928b-e84912aad7e4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:35.972635 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:36.055333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b2c4e-0bd0-47c0-928b-e84912aad7e4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:36.088471 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460506e-e8ca-4035-bfbb-f01eb30ae8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:36.089046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460506e-e8ca-4035-bfbb-f01eb30ae8bc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:36.089326 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460506e-e8ca-4035-bfbb-f01eb30ae8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:36.089598 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460506e-e8ca-4035-bfbb-f01eb30ae8bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:36.153309 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4460506e-e8ca-4035-bfbb-f01eb30ae8bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:36.154759 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4460506e-e8ca-4035-bfbb-f01eb30ae8bc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:36.167400 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:36.249092 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 559/1128] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:24:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:24:36.255066 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec11501-80eb-43b4-8aca-b6eb722b3baa None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:36.347566 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:36.350476 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec11501-80eb-43b4-8aca-b6eb722b3baa None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:36.383499 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff39e23-473f-477e-9e1e-292e4029b027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:36.384354 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff39e23-473f-477e-9e1e-292e4029b027 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:36.384639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff39e23-473f-477e-9e1e-292e4029b027 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:36.384908 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff39e23-473f-477e-9e1e-292e4029b027 None admin] PATH_INFO: `/v3/projects/2fdc08396e714139b76cdc871034dc16` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:36.386063 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff39e23-473f-477e-9e1e-292e4029b027 None admin] RBAC: Authorizing `identity:get_project(project_id=2fdc08396e714139b76cdc871034dc16)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:36.387491 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff39e23-473f-477e-9e1e-292e4029b027 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:36.389164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 570/1129] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:24:36 2022] GET /identity/v3/projects/2fdc08396e714139b76cdc871034dc16 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:36.395191 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460506e-e8ca-4035-bfbb-f01eb30ae8bc None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:36.490667 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460506e-e8ca-4035-bfbb-f01eb30ae8bc None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:36.503749 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:36.523882 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fcf65-cfde-42c0-8938-9d31b0a3087f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:36.524546 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fcf65-cfde-42c0-8938-9d31b0a3087f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:36.524832 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fcf65-cfde-42c0-8938-9d31b0a3087f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:36.525107 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fcf65-cfde-42c0-8938-9d31b0a3087f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:36.525935 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418fcf65-cfde-42c0-8938-9d31b0a3087f None admin] RBAC: Adding query filter params (role.id=5fe1cb1c673a407bb1025d500f111390, scope.project.id=2fdc08396e714139b76cdc871034dc16, user.id=d60587dde681451caf41e42cc94597cc) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:36.526254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418fcf65-cfde-42c0-8938-9d31b0a3087f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:36.527673 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418fcf65-cfde-42c0-8938-9d31b0a3087f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:36.533335 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 560/1130] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:24:36 2022] GET /identity/v3/role_assignments?user.id=d60587dde681451caf41e42cc94597cc&scope.project.id=2fdc08396e714139b76cdc871034dc16&role.id=5fe1cb1c673a407bb1025d500f111390 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:38.755992 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eaeacd-19f3-489e-b332-8301be7be57a None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:38.756578 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eaeacd-19f3-489e-b332-8301be7be57a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:38.756578 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eaeacd-19f3-489e-b332-8301be7be57a None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:38.758433 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 571/1131] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:38.763827 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660338a4-3dbd-491c-bbbb-6d48ab6e1142 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:38.764227 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660338a4-3dbd-491c-bbbb-6d48ab6e1142 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:38.764420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660338a4-3dbd-491c-bbbb-6d48ab6e1142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:38.781500 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-660338a4-3dbd-491c-bbbb-6d48ab6e1142 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:38.782729 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-660338a4-3dbd-491c-bbbb-6d48ab6e1142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:38.847666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 561/1132] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:24:38.870596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eaeacd-19f3-489e-b332-8301be7be57a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:38.967255 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eaeacd-19f3-489e-b332-8301be7be57a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:38.999403 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca6d62-7fea-48f3-aa7f-1127d54ae505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:39.000169 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca6d62-7fea-48f3-aa7f-1127d54ae505 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:39.000484 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca6d62-7fea-48f3-aa7f-1127d54ae505 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:39.000760 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca6d62-7fea-48f3-aa7f-1127d54ae505 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:39.001923 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca6d62-7fea-48f3-aa7f-1127d54ae505 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:39.003340 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca6d62-7fea-48f3-aa7f-1127d54ae505 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:39.004960 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 572/1133] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:24:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:39.011316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660338a4-3dbd-491c-bbbb-6d48ab6e1142 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:39.106098 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660338a4-3dbd-491c-bbbb-6d48ab6e1142 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:39.113063 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:39.140050 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b66030-f494-456e-ab51-ed144fad9601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:39.140722 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b66030-f494-456e-ab51-ed144fad9601 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:39.141004 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b66030-f494-456e-ab51-ed144fad9601 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:39.141277 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b66030-f494-456e-ab51-ed144fad9601 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:39.141974 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b66030-f494-456e-ab51-ed144fad9601 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:39.143396 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b66030-f494-456e-ab51-ed144fad9601 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:39.166593 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 562/1134] 10.222.0.32 () {60 vars in 1141 bytes} [Thu Jun 2 13:24:39 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:24:41.481746 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80340def-4067-41a4-8829-5353ae7e78f6 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:41.482314 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80340def-4067-41a4-8829-5353ae7e78f6 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:41.482314 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80340def-4067-41a4-8829-5353ae7e78f6 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:41.483654 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 573/1135] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:41.488974 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f964a42-64bb-4396-8644-1d07118b4ac3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:41.489418 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f964a42-64bb-4396-8644-1d07118b4ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:41.489549 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f964a42-64bb-4396-8644-1d07118b4ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:41.506039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7f964a42-64bb-4396-8644-1d07118b4ac3 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:41.507709 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7f964a42-64bb-4396-8644-1d07118b4ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:41.572563 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 563/1136] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:24:41.597064 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80340def-4067-41a4-8829-5353ae7e78f6 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:41.631442 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:41.694462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80340def-4067-41a4-8829-5353ae7e78f6 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:41.727701 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0c556-df88-4b6c-8cc6-a72a12ecacd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:41.728499 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0c556-df88-4b6c-8cc6-a72a12ecacd9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:41.728786 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0c556-df88-4b6c-8cc6-a72a12ecacd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:41.729063 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0c556-df88-4b6c-8cc6-a72a12ecacd9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:41.730237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0c556-df88-4b6c-8cc6-a72a12ecacd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:41.731660 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0c556-df88-4b6c-8cc6-a72a12ecacd9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:41.733317 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 574/1137] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:24:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:41.738785 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f964a42-64bb-4396-8644-1d07118b4ac3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:41.826516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:41.839701 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f964a42-64bb-4396-8644-1d07118b4ac3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:41.872431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1daee-469a-48ce-a309-fc1254d0a751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:41.873095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1daee-469a-48ce-a309-fc1254d0a751 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:41.873375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1daee-469a-48ce-a309-fc1254d0a751 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:41.873650 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1daee-469a-48ce-a309-fc1254d0a751 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:41.874359 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd1daee-469a-48ce-a309-fc1254d0a751 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:41.875795 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd1daee-469a-48ce-a309-fc1254d0a751 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:41.895994 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 564/1138] 10.222.0.32 () {60 vars in 1132 bytes} [Thu Jun 2 13:24:41 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:24:44.135446 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacfb02-7392-4376-9f3e-09554aa11a81 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:44.135970 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacfb02-7392-4376-9f3e-09554aa11a81 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:44.136087 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacfb02-7392-4376-9f3e-09554aa11a81 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:44.137417 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 575/1139] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:44.142504 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a5864-ec1c-4378-83f2-fcf72e3e3eeb None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:44.142937 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a5864-ec1c-4378-83f2-fcf72e3e3eeb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:44.143065 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a5864-ec1c-4378-83f2-fcf72e3e3eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:44.159859 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5c9a5864-ec1c-4378-83f2-fcf72e3e3eeb None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:44.161093 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5c9a5864-ec1c-4378-83f2-fcf72e3e3eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:44.225220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 565/1140] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:24:44.248939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacfb02-7392-4376-9f3e-09554aa11a81 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:44.348510 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacfb02-7392-4376-9f3e-09554aa11a81 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:44.350748 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:44.381418 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ebed7-7f18-471d-b7e5-35f771ea1140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:44.382193 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ebed7-7f18-471d-b7e5-35f771ea1140 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:44.382479 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ebed7-7f18-471d-b7e5-35f771ea1140 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:44.382803 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ebed7-7f18-471d-b7e5-35f771ea1140 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:44.392588 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ebed7-7f18-471d-b7e5-35f771ea1140 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:24:44.400639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-570ebed7-7f18-471d-b7e5-35f771ea1140 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:24:44.400639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:44.400639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:44.400639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:44.400639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:44.400639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:44.400639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:44.400639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:44.400639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:44.400639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:44.400639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:44.400639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:44.400639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:24:44.400639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:24:44.400639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:24:44.400639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:24:44.401826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:24:44.401826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:24:44.401826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:24:44.401826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:24:44.401826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:44.401826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:44.401826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:44.401826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:44.401826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:44.401826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:44.401826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:44.401826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:44.401826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:44.401826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:44.401826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:44.401826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:44.402859 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:44.402859 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:44.402859 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:44.402859 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:44.402859 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:24:44.402859 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:24:44.402859 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:24:44.402859 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:24:44.402859 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:24:44.402859 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:24:44.402859 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:24:44.402859 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:44.402859 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 576/1141] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:24:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:44.407731 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a5864-ec1c-4378-83f2-fcf72e3e3eeb None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:44.479766 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:44.505212 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a5864-ec1c-4378-83f2-fcf72e3e3eeb None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:44.538617 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423a980-c861-4576-97e4-afc1b7f4119c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:44.539272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423a980-c861-4576-97e4-afc1b7f4119c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:44.539557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423a980-c861-4576-97e4-afc1b7f4119c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:44.539835 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423a980-c861-4576-97e4-afc1b7f4119c None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:44.540604 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423a980-c861-4576-97e4-afc1b7f4119c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:44.540912 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423a980-c861-4576-97e4-afc1b7f4119c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:44.542282 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423a980-c861-4576-97e4-afc1b7f4119c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:44.550057 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 566/1142] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:24:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:44.555546 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ebed7-7f18-471d-b7e5-35f771ea1140 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:44.652163 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ebed7-7f18-471d-b7e5-35f771ea1140 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:44.683383 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493f748-0d0e-4d62-86d4-246f0bbdbe42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:44.684230 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493f748-0d0e-4d62-86d4-246f0bbdbe42 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:44.684538 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493f748-0d0e-4d62-86d4-246f0bbdbe42 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:44.684811 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493f748-0d0e-4d62-86d4-246f0bbdbe42 None admin] PATH_INFO: `/v3/users/0edcb2c9af994cc3a659c664f12b5b71` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:44.697980 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493f748-0d0e-4d62-86d4-246f0bbdbe42 None admin] RBAC: Authorizing `identity:get_user(user_id=0edcb2c9af994cc3a659c664f12b5b71)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:44.699406 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493f748-0d0e-4d62-86d4-246f0bbdbe42 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:44.701084 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 577/1143] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:24:44 2022] GET /identity/v3/users/0edcb2c9af994cc3a659c664f12b5b71 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:44.706758 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423a980-c861-4576-97e4-afc1b7f4119c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:44.803325 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423a980-c861-4576-97e4-afc1b7f4119c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:44.836174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beabb5c-9daf-4fb3-bfe9-d66a20a045cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:44.836832 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beabb5c-9daf-4fb3-bfe9-d66a20a045cb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:44.837118 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beabb5c-9daf-4fb3-bfe9-d66a20a045cb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:44.837395 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beabb5c-9daf-4fb3-bfe9-d66a20a045cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:44.840750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:44.901700 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beabb5c-9daf-4fb3-bfe9-d66a20a045cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:44.903194 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beabb5c-9daf-4fb3-bfe9-d66a20a045cb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:44.997399 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 567/1144] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:24:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:24:45.003180 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493f748-0d0e-4d62-86d4-246f0bbdbe42 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:45.027999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:45.100279 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493f748-0d0e-4d62-86d4-246f0bbdbe42 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:45.133586 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a23b8a-a862-4829-b27a-c2c7a9c27215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:45.134419 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a23b8a-a862-4829-b27a-c2c7a9c27215 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:45.134702 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a23b8a-a862-4829-b27a-c2c7a9c27215 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:45.134973 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a23b8a-a862-4829-b27a-c2c7a9c27215 None admin] PATH_INFO: `/v3/projects/513e818641714e02a772539b1c1f8668` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:45.136138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a23b8a-a862-4829-b27a-c2c7a9c27215 None admin] RBAC: Authorizing `identity:get_project(project_id=513e818641714e02a772539b1c1f8668)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:45.137581 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a23b8a-a862-4829-b27a-c2c7a9c27215 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:45.139242 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 578/1145] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:24:45 2022] GET /identity/v3/projects/513e818641714e02a772539b1c1f8668 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:45.145352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beabb5c-9daf-4fb3-bfe9-d66a20a045cb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:45.177838 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:45.242439 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beabb5c-9daf-4fb3-bfe9-d66a20a045cb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:45.275561 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be19ce6-2450-43e9-8517-8abf88536bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:45.276200 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be19ce6-2450-43e9-8517-8abf88536bda None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:45.276512 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be19ce6-2450-43e9-8517-8abf88536bda None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:45.276790 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be19ce6-2450-43e9-8517-8abf88536bda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:45.277619 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be19ce6-2450-43e9-8517-8abf88536bda None admin] RBAC: Adding query filter params (role.id=128feb04d1e042ac844f9ad70b89bb02, scope.project.id=513e818641714e02a772539b1c1f8668, user.id=0edcb2c9af994cc3a659c664f12b5b71) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:45.277930 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be19ce6-2450-43e9-8517-8abf88536bda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:45.279369 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be19ce6-2450-43e9-8517-8abf88536bda None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:45.284686 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 568/1146] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:24:45 2022] GET /identity/v3/role_assignments?user.id=0edcb2c9af994cc3a659c664f12b5b71&scope.project.id=513e818641714e02a772539b1c1f8668&role.id=128feb04d1e042ac844f9ad70b89bb02 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:47.447852 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efaf0c-ac6e-4543-9fc7-c599c56caf81 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:47.448437 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efaf0c-ac6e-4543-9fc7-c599c56caf81 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:47.448437 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efaf0c-ac6e-4543-9fc7-c599c56caf81 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:47.449772 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 579/1147] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:24:47.454850 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb280be7-d2f2-4a1f-8238-db8235e6766c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:47.455224 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb280be7-d2f2-4a1f-8238-db8235e6766c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:47.455411 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb280be7-d2f2-4a1f-8238-db8235e6766c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:47.472793 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-cb280be7-d2f2-4a1f-8238-db8235e6766c None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:47.473997 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cb280be7-d2f2-4a1f-8238-db8235e6766c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:47.538210 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 569/1148] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:24:47.559984 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efaf0c-ac6e-4543-9fc7-c599c56caf81 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:47.653396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:47.663426 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efaf0c-ac6e-4543-9fc7-c599c56caf81 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:47.695414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4ae59-3879-46bf-87f3-1a70b48eb489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:47.696178 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4ae59-3879-46bf-87f3-1a70b48eb489 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:47.696486 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4ae59-3879-46bf-87f3-1a70b48eb489 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:47.696762 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4ae59-3879-46bf-87f3-1a70b48eb489 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:47.706482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4ae59-3879-46bf-87f3-1a70b48eb489 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:24:47.714809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-99e4ae59-3879-46bf-87f3-1a70b48eb489 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:24:47.714809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:47.714809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:47.714809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:47.714809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:47.714809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:47.714809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:47.714809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:47.714809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:47.714809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:47.714809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:47.714809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:47.714809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:24:47.714809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:24:47.714809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:24:47.714809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:24:47.715905 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:24:47.715905 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:24:47.715905 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:24:47.715905 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:24:47.715905 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:47.715905 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:47.715905 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:47.715905 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:47.715905 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:47.715905 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:47.715905 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:47.715905 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:47.715905 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:47.715905 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:47.715905 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:47.715905 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:47.717002 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:47.717002 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:47.717002 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:47.717002 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:47.717002 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:24:47.717002 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:24:47.717002 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:24:47.717002 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:24:47.717002 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:24:47.717002 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:24:47.717002 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:24:47.717002 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:47.717002 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 580/1149] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:24:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:47.721790 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb280be7-d2f2-4a1f-8238-db8235e6766c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:47.750411 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:47.820118 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb280be7-d2f2-4a1f-8238-db8235e6766c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:47.859624 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc50c7-278c-407a-a976-a3b549b81a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:47.860280 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc50c7-278c-407a-a976-a3b549b81a64 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:47.860583 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc50c7-278c-407a-a976-a3b549b81a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:47.860856 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc50c7-278c-407a-a976-a3b549b81a64 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:47.861591 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc50c7-278c-407a-a976-a3b549b81a64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:47.861891 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc50c7-278c-407a-a976-a3b549b81a64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:47.863256 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc50c7-278c-407a-a976-a3b549b81a64 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:47.874116 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 570/1150] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:24:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:47.880020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4ae59-3879-46bf-87f3-1a70b48eb489 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:47.975932 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4ae59-3879-46bf-87f3-1a70b48eb489 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:48.008702 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994808c-0feb-4e11-8ac3-226be929e5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:48.010083 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994808c-0feb-4e11-8ac3-226be929e5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:48.010083 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994808c-0feb-4e11-8ac3-226be929e5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:48.010263 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994808c-0feb-4e11-8ac3-226be929e5e8 None admin] PATH_INFO: `/v3/users/0edcb2c9af994cc3a659c664f12b5b71` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:48.011353 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994808c-0feb-4e11-8ac3-226be929e5e8 None admin] RBAC: Authorizing `identity:get_user(user_id=0edcb2c9af994cc3a659c664f12b5b71)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:48.012822 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994808c-0feb-4e11-8ac3-226be929e5e8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:48.014457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 581/1151] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:24:47 2022] GET /identity/v3/users/0edcb2c9af994cc3a659c664f12b5b71 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:48.020168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc50c7-278c-407a-a976-a3b549b81a64 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:48.107233 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:48.116051 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc50c7-278c-407a-a976-a3b549b81a64 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:48.148960 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f6f87-83bb-478b-81e0-b2fa7a88f97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:48.149804 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f6f87-83bb-478b-81e0-b2fa7a88f97d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:48.150085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f6f87-83bb-478b-81e0-b2fa7a88f97d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:48.150358 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f6f87-83bb-478b-81e0-b2fa7a88f97d None admin] PATH_INFO: `/v3/projects/513e818641714e02a772539b1c1f8668` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:48.151528 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f6f87-83bb-478b-81e0-b2fa7a88f97d None admin] RBAC: Authorizing `identity:get_project(project_id=513e818641714e02a772539b1c1f8668)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:48.152992 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f6f87-83bb-478b-81e0-b2fa7a88f97d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:48.154660 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 571/1152] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:24:48 2022] GET /identity/v3/projects/513e818641714e02a772539b1c1f8668 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:48.160511 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994808c-0feb-4e11-8ac3-226be929e5e8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:48.179909 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:48.258259 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994808c-0feb-4e11-8ac3-226be929e5e8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:48.290360 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d9338-3ed8-4988-93c0-d897ef438642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:48.291233 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d9338-3ed8-4988-93c0-d897ef438642 None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:48.291521 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d9338-3ed8-4988-93c0-d897ef438642 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:48.291802 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d9338-3ed8-4988-93c0-d897ef438642 None admin] PATH_INFO: `/v3/projects/513e818641714e02a772539b1c1f8668/users/0edcb2c9af994cc3a659c664f12b5b71/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:48.293785 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d9338-3ed8-4988-93c0-d897ef438642 None admin] RBAC: Authorizing `identity:create_grant(project_id=513e818641714e02a772539b1c1f8668, user_id=0edcb2c9af994cc3a659c664f12b5b71, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:48.295205 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d9338-3ed8-4988-93c0-d897ef438642 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:48.308585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 582/1153] 10.222.0.32 () {58 vars in 1439 bytes} [Thu Jun 2 13:24:48 2022] PUT /identity/v3/projects/513e818641714e02a772539b1c1f8668/users/0edcb2c9af994cc3a659c664f12b5b71/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:24:50.477853 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756009d-4628-45e0-9c56-66a337ab0bb8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:50.478390 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756009d-4628-45e0-9c56-66a337ab0bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:50.478390 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756009d-4628-45e0-9c56-66a337ab0bb8 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:50.479766 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 572/1154] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:50.484846 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905ab4c-1cb3-4705-bf4f-15540166df6f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:50.485243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905ab4c-1cb3-4705-bf4f-15540166df6f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:50.485401 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905ab4c-1cb3-4705-bf4f-15540166df6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:50.501586 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-7905ab4c-1cb3-4705-bf4f-15540166df6f None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:50.502749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7905ab4c-1cb3-4705-bf4f-15540166df6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:50.569063 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 583/1155] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:24:50.593215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756009d-4628-45e0-9c56-66a337ab0bb8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:50.690034 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756009d-4628-45e0-9c56-66a337ab0bb8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:50.722791 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5911126-a4e2-4d3b-969a-23f14053d473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:50.723562 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5911126-a4e2-4d3b-969a-23f14053d473 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:50.723849 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5911126-a4e2-4d3b-969a-23f14053d473 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:50.724125 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5911126-a4e2-4d3b-969a-23f14053d473 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:50.734522 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5911126-a4e2-4d3b-969a-23f14053d473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:24:50.741887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c5911126-a4e2-4d3b-969a-23f14053d473 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:24:50.741887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:50.741887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:50.741887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:50.741887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:50.741887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:50.741887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:50.741887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:50.741887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:50.741887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:50.741887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:50.741887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:50.741887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:24:50.741887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:24:50.741887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:24:50.741887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:24:50.742991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:24:50.742991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:24:50.742991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:24:50.742991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:24:50.742991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:50.742991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:50.742991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:50.742991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:50.742991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:50.742991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:50.742991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:50.742991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:50.742991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:50.742991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:50.742991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:50.742991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:50.744112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:50.744112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:50.744112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:50.744112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:50.744112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:24:50.744112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:24:50.744112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:24:50.744112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:24:50.744112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:24:50.744112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:24:50.744112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:24:50.744112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:24:50.744112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 573/1156] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:24:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:50.748837 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905ab4c-1cb3-4705-bf4f-15540166df6f None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:50.759637 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:50.845970 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905ab4c-1cb3-4705-bf4f-15540166df6f None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:50.878599 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c22239-cb28-4ba7-b260-a7c8c942bf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:50.879251 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c22239-cb28-4ba7-b260-a7c8c942bf70 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:50.879539 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c22239-cb28-4ba7-b260-a7c8c942bf70 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:50.879821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c22239-cb28-4ba7-b260-a7c8c942bf70 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:50.880590 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c22239-cb28-4ba7-b260-a7c8c942bf70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:50.880900 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c22239-cb28-4ba7-b260-a7c8c942bf70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:50.882831 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c22239-cb28-4ba7-b260-a7c8c942bf70 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:50.890573 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 584/1157] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:24:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:50.896173 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5911126-a4e2-4d3b-969a-23f14053d473 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:50.917178 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:50.992787 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5911126-a4e2-4d3b-969a-23f14053d473 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:51.025952 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13fea6-098d-4125-b4bd-337f09a4522b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:51.026809 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13fea6-098d-4125-b4bd-337f09a4522b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:51.027092 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13fea6-098d-4125-b4bd-337f09a4522b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:51.027370 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13fea6-098d-4125-b4bd-337f09a4522b None admin] PATH_INFO: `/v3/users/0edcb2c9af994cc3a659c664f12b5b71` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:51.028577 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13fea6-098d-4125-b4bd-337f09a4522b None admin] RBAC: Authorizing `identity:get_user(user_id=0edcb2c9af994cc3a659c664f12b5b71)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:51.030024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13fea6-098d-4125-b4bd-337f09a4522b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:51.031636 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 574/1158] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:24:50 2022] GET /identity/v3/users/0edcb2c9af994cc3a659c664f12b5b71 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:51.037434 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c22239-cb28-4ba7-b260-a7c8c942bf70 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:51.104810 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:51.136785 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c22239-cb28-4ba7-b260-a7c8c942bf70 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:51.168208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4121c-3749-47a3-b540-da8663d8d931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:51.168871 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4121c-3749-47a3-b540-da8663d8d931 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:51.169156 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4121c-3749-47a3-b540-da8663d8d931 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:51.169432 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4121c-3749-47a3-b540-da8663d8d931 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:51.234929 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4121c-3749-47a3-b540-da8663d8d931 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:51.236396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4121c-3749-47a3-b540-da8663d8d931 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:51.300739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:51.331843 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 585/1159] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:24:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:24:51.337871 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13fea6-098d-4125-b4bd-337f09a4522b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:51.422853 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:51.435231 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13fea6-098d-4125-b4bd-337f09a4522b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:51.467405 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e43c21-0e87-499a-a52f-384e6b171c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:51.468233 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e43c21-0e87-499a-a52f-384e6b171c32 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:51.468540 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e43c21-0e87-499a-a52f-384e6b171c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:51.468816 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e43c21-0e87-499a-a52f-384e6b171c32 None admin] PATH_INFO: `/v3/projects/513e818641714e02a772539b1c1f8668` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:51.470043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e43c21-0e87-499a-a52f-384e6b171c32 None admin] RBAC: Authorizing `identity:get_project(project_id=513e818641714e02a772539b1c1f8668)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:51.471484 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e43c21-0e87-499a-a52f-384e6b171c32 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:51.473155 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 575/1160] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:24:51 2022] GET /identity/v3/projects/513e818641714e02a772539b1c1f8668 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:51.479696 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4121c-3749-47a3-b540-da8663d8d931 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:51.573756 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4121c-3749-47a3-b540-da8663d8d931 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:51.606800 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e26bf-4f0b-4b66-a384-10c1ef49aa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:51.607430 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e26bf-4f0b-4b66-a384-10c1ef49aa13 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:51.607715 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e26bf-4f0b-4b66-a384-10c1ef49aa13 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:51.607993 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e26bf-4f0b-4b66-a384-10c1ef49aa13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:51.608840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e26bf-4f0b-4b66-a384-10c1ef49aa13 None admin] RBAC: Adding query filter params (role.id=128feb04d1e042ac844f9ad70b89bb02, scope.project.id=513e818641714e02a772539b1c1f8668, user.id=0edcb2c9af994cc3a659c664f12b5b71) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:51.609150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e26bf-4f0b-4b66-a384-10c1ef49aa13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:51.610556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e26bf-4f0b-4b66-a384-10c1ef49aa13 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:51.616192 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 586/1161] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:24:51 2022] GET /identity/v3/role_assignments?user.id=0edcb2c9af994cc3a659c664f12b5b71&scope.project.id=513e818641714e02a772539b1c1f8668&role.id=128feb04d1e042ac844f9ad70b89bb02 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:53.816993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdb214-8e15-411c-9a27-dc739ced13fb None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:53.817551 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdb214-8e15-411c-9a27-dc739ced13fb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:53.817551 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdb214-8e15-411c-9a27-dc739ced13fb None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:53.818892 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 576/1162] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:53.823991 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4a0b2-c6b0-4b6e-8c48-9d9f8491f231 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:53.824453 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4a0b2-c6b0-4b6e-8c48-9d9f8491f231 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:53.824579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4a0b2-c6b0-4b6e-8c48-9d9f8491f231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:53.841531 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-86a4a0b2-c6b0-4b6e-8c48-9d9f8491f231 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:53.842693 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-86a4a0b2-c6b0-4b6e-8c48-9d9f8491f231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:53.868734 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:53.915616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 587/1163] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:24:53.937507 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdb214-8e15-411c-9a27-dc739ced13fb None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:54.035694 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdb214-8e15-411c-9a27-dc739ced13fb None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:54.068679 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86931efa-68dc-4b63-ad08-c0424272355c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:54.069264 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86931efa-68dc-4b63-ad08-c0424272355c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:54.069542 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86931efa-68dc-4b63-ad08-c0424272355c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:54.069816 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86931efa-68dc-4b63-ad08-c0424272355c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:54.094253 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:54.136006 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86931efa-68dc-4b63-ad08-c0424272355c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:54.137491 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86931efa-68dc-4b63-ad08-c0424272355c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:54.231742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 577/1164] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:24:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:24:54.237693 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4a0b2-c6b0-4b6e-8c48-9d9f8491f231 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:54.332111 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4a0b2-c6b0-4b6e-8c48-9d9f8491f231 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:54.365232 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a324b0c-a999-499e-a009-972cc6f5cda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:54.366005 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a324b0c-a999-499e-a009-972cc6f5cda0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:54.366859 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a324b0c-a999-499e-a009-972cc6f5cda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:54.367136 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a324b0c-a999-499e-a009-972cc6f5cda0 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:54.373626 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a324b0c-a999-499e-a009-972cc6f5cda0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:54.375056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a324b0c-a999-499e-a009-972cc6f5cda0 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:54.388623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-7a324b0c-a999-499e-a009-972cc6f5cda0 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 02 13:24:54.388623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:54.388623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 02 13:24:54.388623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 02 13:24:54.388623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:24:54.388623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:24:54.388623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:24:54.388623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:24:54.388623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 02 13:24:54.388623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:54.388623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:24:54.388623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:54.388623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:24:54.388623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:24:54.388623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:24:54.388623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:24:54.388623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:24:54.389835 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:24:54.389835 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:24:54.389835 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:24:54.389835 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:24:54.389835 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:24:54.389835 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:24:54.389835 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:24:54.389835 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:24:54.389835 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:24:54.389835 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:24:54.389835 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:24:54.389835 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:24:54.389835 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:24:54.389835 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:24:54.389835 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:24:54.389835 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:24:54.391037 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:24:54.391037 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:24:54.391037 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:24:54.391037 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:24:54.391037 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:24:54.391037 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:24:54.391037 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:24:54.391037 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:24:54.391037 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:24:54.391037 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:24:54.391037 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 02 13:24:54.391037 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:24:54.391037 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 02 13:24:54.391037 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:24:54.391037 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 588/1165] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Jun 2 13:24:54 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:24:54.395372 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86931efa-68dc-4b63-ad08-c0424272355c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:54.449136 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:54.492024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86931efa-68dc-4b63-ad08-c0424272355c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:54.524443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae17e11-1ea3-4543-b4a9-235d2b6fa89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:54.525089 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae17e11-1ea3-4543-b4a9-235d2b6fa89f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:54.525374 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae17e11-1ea3-4543-b4a9-235d2b6fa89f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:54.525650 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae17e11-1ea3-4543-b4a9-235d2b6fa89f None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:54.526355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae17e11-1ea3-4543-b4a9-235d2b6fa89f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:24:54.526658 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae17e11-1ea3-4543-b4a9-235d2b6fa89f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:54.528013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae17e11-1ea3-4543-b4a9-235d2b6fa89f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:54.534991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 578/1166] 10.222.0.32 () {56 vars in 1115 bytes} [Thu Jun 2 13:24:54 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:56.756421 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813d16c-1d93-4ca7-b761-108a75ac58d5 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:56.757023 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813d16c-1d93-4ca7-b761-108a75ac58d5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:56.757023 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813d16c-1d93-4ca7-b761-108a75ac58d5 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:56.758344 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 589/1167] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:56.763483 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0906b2-895b-4d9c-8264-bab54e56b012 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:56.763907 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0906b2-895b-4d9c-8264-bab54e56b012 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:56.764051 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0906b2-895b-4d9c-8264-bab54e56b012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:56.780479 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ba0906b2-895b-4d9c-8264-bab54e56b012 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:56.781673 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ba0906b2-895b-4d9c-8264-bab54e56b012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:56.846006 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 579/1168] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:24:56.869577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813d16c-1d93-4ca7-b761-108a75ac58d5 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:56.894476 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:56.970015 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813d16c-1d93-4ca7-b761-108a75ac58d5 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:57.002255 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4afd3-9e32-4c8a-8e1f-dd567af07500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:57.002896 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4afd3-9e32-4c8a-8e1f-dd567af07500 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:57.003184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4afd3-9e32-4c8a-8e1f-dd567af07500 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:57.003466 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4afd3-9e32-4c8a-8e1f-dd567af07500 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:57.004214 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4afd3-9e32-4c8a-8e1f-dd567af07500 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:57.005632 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4afd3-9e32-4c8a-8e1f-dd567af07500 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:57.021030 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 590/1169] 10.222.0.32 () {60 vars in 1138 bytes} [Thu Jun 2 13:24:56 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:24:59.234788 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89edf9-00e0-45ee-ae89-5bda759afd69 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:59.235348 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89edf9-00e0-45ee-ae89-5bda759afd69 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:59.235348 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89edf9-00e0-45ee-ae89-5bda759afd69 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:59.236745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 580/1170] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:24:59.242505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecf010-c4e1-43de-bb21-dda87cc5e41a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:59.242907 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecf010-c4e1-43de-bb21-dda87cc5e41a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:59.243061 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecf010-c4e1-43de-bb21-dda87cc5e41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:59.265256 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-90ecf010-c4e1-43de-bb21-dda87cc5e41a None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:24:59.266380 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-90ecf010-c4e1-43de-bb21-dda87cc5e41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:24:59.330308 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 591/1171] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:24:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:24:59.353464 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb89edf9-00e0-45ee-ae89-5bda759afd69 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:59.403441 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:59.452517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb89edf9-00e0-45ee-ae89-5bda759afd69 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:59.486540 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb55be-fb39-42eb-8fea-ed7c1582ce2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:59.487374 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb55be-fb39-42eb-8fea-ed7c1582ce2b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:59.487657 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb55be-fb39-42eb-8fea-ed7c1582ce2b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:59.487932 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb55be-fb39-42eb-8fea-ed7c1582ce2b None admin] PATH_INFO: `/v3/domains/05a33c60fafd451a99c2def62506b92e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:59.498393 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb55be-fb39-42eb-8fea-ed7c1582ce2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=05a33c60fafd451a99c2def62506b92e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:59.499847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb55be-fb39-42eb-8fea-ed7c1582ce2b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:59.501480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 581/1172] 10.222.0.32 () {56 vars in 1183 bytes} [Thu Jun 2 13:24:59 2022] GET /identity/v3/domains/05a33c60fafd451a99c2def62506b92e => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:24:59.507702 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecf010-c4e1-43de-bb21-dda87cc5e41a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:24:59.525048 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:24:59.605629 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecf010-c4e1-43de-bb21-dda87cc5e41a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:24:59.638543 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a002401-c028-4893-b0d9-8d7ef58d9cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:24:59.639187 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a002401-c028-4893-b0d9-8d7ef58d9cb5 None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:24:59.639478 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a002401-c028-4893-b0d9-8d7ef58d9cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:24:59.639760 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a002401-c028-4893-b0d9-8d7ef58d9cb5 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:24:59.640505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a002401-c028-4893-b0d9-8d7ef58d9cb5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:24:59.641952 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a002401-c028-4893-b0d9-8d7ef58d9cb5 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:24:59.667337 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 592/1173] 10.222.0.32 () {60 vars in 1141 bytes} [Thu Jun 2 13:24:59 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:25:01.900561 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104b50c-4376-49de-b7a4-b314b9791efa None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:01.901118 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104b50c-4376-49de-b7a4-b314b9791efa None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:01.901118 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104b50c-4376-49de-b7a4-b314b9791efa None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:01.902486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 582/1174] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:01.907849 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe2d6c-6e4b-483b-ba31-b1ca7cbabf1a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:01.908246 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe2d6c-6e4b-483b-ba31-b1ca7cbabf1a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:01.908507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe2d6c-6e4b-483b-ba31-b1ca7cbabf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:01.927931 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-cabe2d6c-6e4b-483b-ba31-b1ca7cbabf1a None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:01.930645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-cabe2d6c-6e4b-483b-ba31-b1ca7cbabf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:01.989830 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:01.998388 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 593/1175] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:25:02.022909 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104b50c-4376-49de-b7a4-b314b9791efa None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:02.122374 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104b50c-4376-49de-b7a4-b314b9791efa None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:02.132307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:02.155283 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb2e94-ab87-425f-b01a-532ab859fd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:02.156078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb2e94-ab87-425f-b01a-532ab859fd24 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:02.156388 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb2e94-ab87-425f-b01a-532ab859fd24 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:02.156669 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb2e94-ab87-425f-b01a-532ab859fd24 None admin] PATH_INFO: `/v3/domains/05a33c60fafd451a99c2def62506b92e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:02.157838 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb2e94-ab87-425f-b01a-532ab859fd24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=05a33c60fafd451a99c2def62506b92e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:02.159277 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb2e94-ab87-425f-b01a-532ab859fd24 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:02.160898 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 583/1176] 10.222.0.32 () {56 vars in 1183 bytes} [Thu Jun 2 13:25:02 2022] GET /identity/v3/domains/05a33c60fafd451a99c2def62506b92e => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:02.167090 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe2d6c-6e4b-483b-ba31-b1ca7cbabf1a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:02.262138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe2d6c-6e4b-483b-ba31-b1ca7cbabf1a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:02.295193 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04019383-7165-4b7a-9795-c3d64ed733cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:02.295868 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04019383-7165-4b7a-9795-c3d64ed733cd None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:02.296159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04019383-7165-4b7a-9795-c3d64ed733cd None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:02.296472 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04019383-7165-4b7a-9795-c3d64ed733cd None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:02.297180 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04019383-7165-4b7a-9795-c3d64ed733cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:02.298608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04019383-7165-4b7a-9795-c3d64ed733cd None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:02.318065 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 594/1177] 10.222.0.32 () {60 vars in 1132 bytes} [Thu Jun 2 13:25:02 2022] POST /identity/v3/users => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:25:04.596270 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d136b-9aa9-4cc9-a70f-be3369b60f4d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:04.596836 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d136b-9aa9-4cc9-a70f-be3369b60f4d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:04.596932 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d136b-9aa9-4cc9-a70f-be3369b60f4d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:04.598231 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 584/1178] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:04.603793 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4dfe6-4cf2-4613-8f2c-1b81373082f8 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:04.604216 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4dfe6-4cf2-4613-8f2c-1b81373082f8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:04.604480 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4dfe6-4cf2-4613-8f2c-1b81373082f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:04.621970 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-acb4dfe6-4cf2-4613-8f2c-1b81373082f8 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:04.623168 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-acb4dfe6-4cf2-4613-8f2c-1b81373082f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:04.669415 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:04.691316 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 595/1179] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:25:04.716403 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d136b-9aa9-4cc9-a70f-be3369b60f4d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:04.819871 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d136b-9aa9-4cc9-a70f-be3369b60f4d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:04.854770 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52fb52-a72f-4ed8-b156-7f7806a7f632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:04.855484 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52fb52-a72f-4ed8-b156-7f7806a7f632 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:04.855765 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52fb52-a72f-4ed8-b156-7f7806a7f632 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:04.856040 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52fb52-a72f-4ed8-b156-7f7806a7f632 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:04.866826 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52fb52-a72f-4ed8-b156-7f7806a7f632 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:25:04.874254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-8e52fb52-a72f-4ed8-b156-7f7806a7f632 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:25:04.874254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:04.874254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:04.874254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:04.874254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:04.874254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:04.874254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:04.874254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:04.874254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:04.874254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:04.874254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:04.874254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:04.874254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:25:04.874254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:25:04.874254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:25:04.874254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:25:04.875408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:25:04.875408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:25:04.875408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:25:04.875408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:25:04.875408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:04.875408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:04.875408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:04.875408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:04.875408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:04.875408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:04.875408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:04.875408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:04.875408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:04.875408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:04.875408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:04.875408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:04.876574 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:04.876574 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:04.876574 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:04.876574 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:04.876574 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:25:04.876574 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:25:04.876574 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:25:04.876574 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:25:04.876574 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:25:04.876574 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:25:04.876574 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:25:04.876574 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:25:04.876574 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 585/1180] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:25:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:25:04.881540 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4dfe6-4cf2-4613-8f2c-1b81373082f8 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:04.976851 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4dfe6-4cf2-4613-8f2c-1b81373082f8 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:05.009531 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0cfc4-7ffe-46a2-a930-85daf31df5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:05.009671 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0cfc4-7ffe-46a2-a930-85daf31df5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:05.009954 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0cfc4-7ffe-46a2-a930-85daf31df5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:05.010231 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0cfc4-7ffe-46a2-a930-85daf31df5d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:05.010972 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb0cfc4-7ffe-46a2-a930-85daf31df5d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:05.011276 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb0cfc4-7ffe-46a2-a930-85daf31df5d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:05.012668 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb0cfc4-7ffe-46a2-a930-85daf31df5d9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:05.020756 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 596/1181] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:25:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:05.026384 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52fb52-a72f-4ed8-b156-7f7806a7f632 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:05.065206 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:05.122900 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52fb52-a72f-4ed8-b156-7f7806a7f632 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:05.155060 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a7b0d-28b2-4cf4-8225-c009f6168a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:05.155898 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a7b0d-28b2-4cf4-8225-c009f6168a19 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:05.156179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a7b0d-28b2-4cf4-8225-c009f6168a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:05.156480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a7b0d-28b2-4cf4-8225-c009f6168a19 None admin] PATH_INFO: `/v3/users/4a9422c1b2a941b9af7a2b3f07570ef0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:05.169457 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a7b0d-28b2-4cf4-8225-c009f6168a19 None admin] RBAC: Authorizing `identity:get_user(user_id=4a9422c1b2a941b9af7a2b3f07570ef0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:05.170884 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a7b0d-28b2-4cf4-8225-c009f6168a19 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:05.172500 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 586/1182] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:25:05 2022] GET /identity/v3/users/4a9422c1b2a941b9af7a2b3f07570ef0 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:05.178053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0cfc4-7ffe-46a2-a930-85daf31df5d9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:05.222496 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:05.274578 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0cfc4-7ffe-46a2-a930-85daf31df5d9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:05.306522 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8d894-c83f-4236-b365-0d552ed20e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:05.307145 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8d894-c83f-4236-b365-0d552ed20e7b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:05.307430 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8d894-c83f-4236-b365-0d552ed20e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:05.307706 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8d894-c83f-4236-b365-0d552ed20e7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:05.371219 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8d894-c83f-4236-b365-0d552ed20e7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:05.372682 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8d894-c83f-4236-b365-0d552ed20e7b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:05.414424 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:05.466747 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 597/1183] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:25:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:25:05.472793 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a7b0d-28b2-4cf4-8225-c009f6168a19 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:05.563850 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:05.570610 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a7b0d-28b2-4cf4-8225-c009f6168a19 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:05.604309 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdcfa87-14dd-427f-a37f-fc755ca766bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:05.605156 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcfa87-14dd-427f-a37f-fc755ca766bf None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:05.605436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcfa87-14dd-427f-a37f-fc755ca766bf None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:05.605709 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcfa87-14dd-427f-a37f-fc755ca766bf None admin] PATH_INFO: `/v3/projects/a3e657418a37422d95e114d1f16b91f4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:05.606857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdcfa87-14dd-427f-a37f-fc755ca766bf None admin] RBAC: Authorizing `identity:get_project(project_id=a3e657418a37422d95e114d1f16b91f4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:05.608285 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdcfa87-14dd-427f-a37f-fc755ca766bf None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:05.610013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 587/1184] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:25:05 2022] GET /identity/v3/projects/a3e657418a37422d95e114d1f16b91f4 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:05.615990 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8d894-c83f-4236-b365-0d552ed20e7b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:05.710332 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8d894-c83f-4236-b365-0d552ed20e7b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:05.742820 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86eb8e-5ae8-46ce-9542-55bc6a6a6850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:05.743458 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86eb8e-5ae8-46ce-9542-55bc6a6a6850 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:05.743743 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86eb8e-5ae8-46ce-9542-55bc6a6a6850 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:05.744018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86eb8e-5ae8-46ce-9542-55bc6a6a6850 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:05.744871 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86eb8e-5ae8-46ce-9542-55bc6a6a6850 None admin] RBAC: Adding query filter params (role.id=128feb04d1e042ac844f9ad70b89bb02, scope.project.id=a3e657418a37422d95e114d1f16b91f4, user.id=4a9422c1b2a941b9af7a2b3f07570ef0) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:05.745185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86eb8e-5ae8-46ce-9542-55bc6a6a6850 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:05.746596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86eb8e-5ae8-46ce-9542-55bc6a6a6850 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:05.751914 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 598/1185] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:25:05 2022] GET /identity/v3/role_assignments?user.id=4a9422c1b2a941b9af7a2b3f07570ef0&scope.project.id=a3e657418a37422d95e114d1f16b91f4&role.id=128feb04d1e042ac844f9ad70b89bb02 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:25:07.914028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fc2df-7fb1-4685-90e5-d6642c623be6 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:07.914556 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fc2df-7fb1-4685-90e5-d6642c623be6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:07.914556 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fc2df-7fb1-4685-90e5-d6642c623be6 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:07.915928 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 588/1186] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:25:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:07.921247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0c680-8acd-4e9a-859a-893933de169b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:07.921655 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0c680-8acd-4e9a-859a-893933de169b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:07.921820 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0c680-8acd-4e9a-859a-893933de169b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:07.938688 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-bdc0c680-8acd-4e9a-859a-893933de169b None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:07.939875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bdc0c680-8acd-4e9a-859a-893933de169b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:07.941805 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:08.006161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 599/1187] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:25:08.029043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fc2df-7fb1-4685-90e5-d6642c623be6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:08.127457 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fc2df-7fb1-4685-90e5-d6642c623be6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:08.160694 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c166456-5492-4034-ab4a-7ae9ec570367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:08.161457 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c166456-5492-4034-ab4a-7ae9ec570367 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:08.161737 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c166456-5492-4034-ab4a-7ae9ec570367 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:08.162010 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c166456-5492-4034-ab4a-7ae9ec570367 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:08.172229 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c166456-5492-4034-ab4a-7ae9ec570367 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:25:08.179626 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9c166456-5492-4034-ab4a-7ae9ec570367 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:25:08.179626 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:08.179626 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:08.179626 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:08.179626 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:08.179626 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:08.179626 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:08.179626 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:08.179626 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:08.179626 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:08.179626 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:08.179626 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:08.179626 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:25:08.179626 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:25:08.179626 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:25:08.179626 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:25:08.180767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:25:08.180767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:25:08.180767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:25:08.180767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:25:08.180767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:08.180767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:08.180767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:08.180767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:08.180767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:08.180767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:08.180767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:08.180767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:08.180767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:08.180767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:08.180767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:08.180767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:08.181621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:08.181621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:08.181621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:08.181621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:08.181621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:25:08.181621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:25:08.181621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:25:08.181621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:25:08.181621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:25:08.181621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:25:08.181621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:25:08.181621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:25:08.181621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 589/1188] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:25:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:25:08.186704 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0c680-8acd-4e9a-859a-893933de169b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:08.281052 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0c680-8acd-4e9a-859a-893933de169b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:08.313777 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42a7e1-a969-4c30-a3e0-c92cbf704542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:08.314431 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42a7e1-a969-4c30-a3e0-c92cbf704542 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:08.314722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42a7e1-a969-4c30-a3e0-c92cbf704542 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:08.315001 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42a7e1-a969-4c30-a3e0-c92cbf704542 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:08.315747 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42a7e1-a969-4c30-a3e0-c92cbf704542 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:08.316059 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42a7e1-a969-4c30-a3e0-c92cbf704542 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:08.317471 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42a7e1-a969-4c30-a3e0-c92cbf704542 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:08.322333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:08.326068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 600/1189] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:25:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:08.331429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c166456-5492-4034-ab4a-7ae9ec570367 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:08.357381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:08.428860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c166456-5492-4034-ab4a-7ae9ec570367 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:08.461994 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a57b31-5122-4bfa-8ffc-f71bbc66625d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:08.462844 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a57b31-5122-4bfa-8ffc-f71bbc66625d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:08.463130 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a57b31-5122-4bfa-8ffc-f71bbc66625d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:08.463410 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a57b31-5122-4bfa-8ffc-f71bbc66625d None admin] PATH_INFO: `/v3/users/4a9422c1b2a941b9af7a2b3f07570ef0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:08.464613 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a57b31-5122-4bfa-8ffc-f71bbc66625d None admin] RBAC: Authorizing `identity:get_user(user_id=4a9422c1b2a941b9af7a2b3f07570ef0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:08.466067 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a57b31-5122-4bfa-8ffc-f71bbc66625d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:08.467667 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 590/1190] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:25:08 2022] GET /identity/v3/users/4a9422c1b2a941b9af7a2b3f07570ef0 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:08.473190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42a7e1-a969-4c30-a3e0-c92cbf704542 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:08.570536 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42a7e1-a969-4c30-a3e0-c92cbf704542 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:08.603037 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a0f53-b155-4822-8ce5-7ddbfa259e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:08.603885 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a0f53-b155-4822-8ce5-7ddbfa259e46 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:08.604170 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a0f53-b155-4822-8ce5-7ddbfa259e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:08.604476 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a0f53-b155-4822-8ce5-7ddbfa259e46 None admin] PATH_INFO: `/v3/projects/a3e657418a37422d95e114d1f16b91f4` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:08.605652 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a0f53-b155-4822-8ce5-7ddbfa259e46 None admin] RBAC: Authorizing `identity:get_project(project_id=a3e657418a37422d95e114d1f16b91f4)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:08.607084 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a0f53-b155-4822-8ce5-7ddbfa259e46 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:08.608805 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 601/1191] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:25:08 2022] GET /identity/v3/projects/a3e657418a37422d95e114d1f16b91f4 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:08.614816 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a57b31-5122-4bfa-8ffc-f71bbc66625d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:08.703567 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:08.713041 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a57b31-5122-4bfa-8ffc-f71bbc66625d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:08.744714 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b114a-73e2-44da-b154-55ff246ad552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:08.745589 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b114a-73e2-44da-b154-55ff246ad552 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:08.745876 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b114a-73e2-44da-b154-55ff246ad552 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:08.746153 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b114a-73e2-44da-b154-55ff246ad552 None admin] PATH_INFO: `/v3/projects/a3e657418a37422d95e114d1f16b91f4/users/4a9422c1b2a941b9af7a2b3f07570ef0/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:08.748086 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b114a-73e2-44da-b154-55ff246ad552 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3e657418a37422d95e114d1f16b91f4, user_id=4a9422c1b2a941b9af7a2b3f07570ef0, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:08.749562 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b114a-73e2-44da-b154-55ff246ad552 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:08.761911 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 591/1192] 10.222.0.32 () {58 vars in 1439 bytes} [Thu Jun 2 13:25:08 2022] PUT /identity/v3/projects/a3e657418a37422d95e114d1f16b91f4/users/4a9422c1b2a941b9af7a2b3f07570ef0/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:25:10.954938 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5e554-cb96-4d7b-9b98-f11b264805d5 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:10.955492 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5e554-cb96-4d7b-9b98-f11b264805d5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:10.955492 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5e554-cb96-4d7b-9b98-f11b264805d5 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:10.956885 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 602/1193] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:25:10.962341 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a78ef1-bed7-4a37-a24e-96c394fa67d5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:10.962735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a78ef1-bed7-4a37-a24e-96c394fa67d5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:10.962898 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a78ef1-bed7-4a37-a24e-96c394fa67d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:10.979764 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-92a78ef1-bed7-4a37-a24e-96c394fa67d5 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:25:10.980974 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-92a78ef1-bed7-4a37-a24e-96c394fa67d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:25:11.047738 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 592/1194] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:25:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:25:11.071344 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5e554-cb96-4d7b-9b98-f11b264805d5 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:11.136524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:11.170030 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5e554-cb96-4d7b-9b98-f11b264805d5 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:11.201341 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b28c8-5a0b-4ca0-80bb-188bae1ee5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:11.202109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b28c8-5a0b-4ca0-80bb-188bae1ee5c0 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:11.202394 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b28c8-5a0b-4ca0-80bb-188bae1ee5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:11.202671 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b28c8-5a0b-4ca0-80bb-188bae1ee5c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:11.213715 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b28c8-5a0b-4ca0-80bb-188bae1ee5c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:25:11.221159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-ae7b28c8-5a0b-4ca0-80bb-188bae1ee5c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:25:11.221159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:25:11.221159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:25:11.221159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:25:11.221159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:25:11.221159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:25:11.221159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:25:11.221159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:25:11.221159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:25:11.221159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:25:11.221159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:25:11.221159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:25:11.221159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:25:11.221159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:25:11.221159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:25:11.221159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:25:11.222227 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:25:11.222227 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:25:11.222227 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:25:11.222227 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:25:11.222227 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:25:11.222227 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:25:11.222227 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:25:11.222227 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:25:11.222227 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:25:11.222227 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:25:11.222227 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:25:11.222227 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:25:11.222227 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:25:11.222227 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:25:11.222227 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:25:11.222227 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:25:11.223190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:25:11.223190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:25:11.223190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:25:11.223190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:25:11.223190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:25:11.223190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:25:11.223190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:25:11.223190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:25:11.223190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:25:11.223190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:25:11.223190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:25:11.223190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:25:11.223190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 603/1195] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:25:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:25:11.228826 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a78ef1-bed7-4a37-a24e-96c394fa67d5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:11.305764 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:11.323789 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a78ef1-bed7-4a37-a24e-96c394fa67d5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:11.357284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a09e1-6a99-4e12-afd1-d702f4a53325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:11.357940 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a09e1-6a99-4e12-afd1-d702f4a53325 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:11.358245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a09e1-6a99-4e12-afd1-d702f4a53325 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:11.358523 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a09e1-6a99-4e12-afd1-d702f4a53325 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:11.359270 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a09e1-6a99-4e12-afd1-d702f4a53325 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:11.359577 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a09e1-6a99-4e12-afd1-d702f4a53325 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:11.360970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a09e1-6a99-4e12-afd1-d702f4a53325 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:11.368824 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 593/1196] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:25:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:11.374337 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b28c8-5a0b-4ca0-80bb-188bae1ee5c0 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:11.469330 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b28c8-5a0b-4ca0-80bb-188bae1ee5c0 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:11.493967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:11.501716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea1957-425f-46d8-bf77-c908aa7b912f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:11.502561 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea1957-425f-46d8-bf77-c908aa7b912f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:11.502846 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea1957-425f-46d8-bf77-c908aa7b912f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:11.503122 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea1957-425f-46d8-bf77-c908aa7b912f None admin] PATH_INFO: `/v3/users/4a9422c1b2a941b9af7a2b3f07570ef0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:11.504320 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea1957-425f-46d8-bf77-c908aa7b912f None admin] RBAC: Authorizing `identity:get_user(user_id=4a9422c1b2a941b9af7a2b3f07570ef0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:11.505741 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea1957-425f-46d8-bf77-c908aa7b912f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:11.507849 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 604/1197] 10.222.0.32 () {56 vars in 1177 bytes} [Thu Jun 2 13:25:11 2022] GET /identity/v3/users/4a9422c1b2a941b9af7a2b3f07570ef0 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:11.513358 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a09e1-6a99-4e12-afd1-d702f4a53325 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:11.609518 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a09e1-6a99-4e12-afd1-d702f4a53325 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:11.641571 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504da435-debf-4694-8e9d-a4f80dd8da51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:11.642195 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504da435-debf-4694-8e9d-a4f80dd8da51 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:11.642475 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504da435-debf-4694-8e9d-a4f80dd8da51 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:11.642746 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504da435-debf-4694-8e9d-a4f80dd8da51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:11.656912 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:11.709232 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504da435-debf-4694-8e9d-a4f80dd8da51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:11.711508 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504da435-debf-4694-8e9d-a4f80dd8da51 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:11.806387 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 594/1198] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:25:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:25:11.812210 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea1957-425f-46d8-bf77-c908aa7b912f None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:11.908133 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea1957-425f-46d8-bf77-c908aa7b912f None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:11.940567 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50fefab-b8b6-42f3-86c9-407ec0cf76f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:11.941407 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fefab-b8b6-42f3-86c9-407ec0cf76f5 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:11.941693 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fefab-b8b6-42f3-86c9-407ec0cf76f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:11.941969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fefab-b8b6-42f3-86c9-407ec0cf76f5 None admin] PATH_INFO: `/v3/projects/a3e657418a37422d95e114d1f16b91f4` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:11.943147 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50fefab-b8b6-42f3-86c9-407ec0cf76f5 None admin] RBAC: Authorizing `identity:get_project(project_id=a3e657418a37422d95e114d1f16b91f4)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:11.945147 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50fefab-b8b6-42f3-86c9-407ec0cf76f5 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:11.946810 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 605/1199] 10.222.0.32 () {56 vars in 1186 bytes} [Thu Jun 2 13:25:11 2022] GET /identity/v3/projects/a3e657418a37422d95e114d1f16b91f4 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:11.952736 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504da435-debf-4694-8e9d-a4f80dd8da51 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:25:11.997064 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:12.050918 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504da435-debf-4694-8e9d-a4f80dd8da51 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:25:12.084180 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb287de-6482-423c-b616-e0d09d09d2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:25:12.084961 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb287de-6482-423c-b616-e0d09d09d2f3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:25:12.085251 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb287de-6482-423c-b616-e0d09d09d2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:25:12.085533 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb287de-6482-423c-b616-e0d09d09d2f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:25:12.086628 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb287de-6482-423c-b616-e0d09d09d2f3 None admin] RBAC: Adding query filter params (role.id=128feb04d1e042ac844f9ad70b89bb02, scope.project.id=a3e657418a37422d95e114d1f16b91f4, user.id=4a9422c1b2a941b9af7a2b3f07570ef0) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:25:12.086942 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb287de-6482-423c-b616-e0d09d09d2f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:25:12.088417 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb287de-6482-423c-b616-e0d09d09d2f3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:25:12.094255 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 595/1200] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:25:11 2022] GET /identity/v3/role_assignments?user.id=4a9422c1b2a941b9af7a2b3f07570ef0&scope.project.id=a3e657418a37422d95e114d1f16b91f4&role.id=128feb04d1e042ac844f9ad70b89bb02 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:25:21.936632 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=68 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:25:22.091559 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=46 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:12.379384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5f93d-8f6f-4f0f-8be5-2b229b557a6a None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:12.379384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5f93d-8f6f-4f0f-8be5-2b229b557a6a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:12.379384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5f93d-8f6f-4f0f-8be5-2b229b557a6a None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:12.379384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 606/1201] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:12.386175 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ac763-db1c-4855-8c15-2d4231f23355 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:12.387027 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ac763-db1c-4855-8c15-2d4231f23355 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:12.387538 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ac763-db1c-4855-8c15-2d4231f23355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:12.409971 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-512ac763-db1c-4855-8c15-2d4231f23355 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:12.411302 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-512ac763-db1c-4855-8c15-2d4231f23355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:12.496265 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 596/1202] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:26:12.523053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5f93d-8f6f-4f0f-8be5-2b229b557a6a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:12.663901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5f93d-8f6f-4f0f-8be5-2b229b557a6a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:12.707049 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556abb6-bd98-41fb-8ba9-4e80ab5b4e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:12.707925 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556abb6-bd98-41fb-8ba9-4e80ab5b4e43 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:12.708833 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556abb6-bd98-41fb-8ba9-4e80ab5b4e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:12.709148 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556abb6-bd98-41fb-8ba9-4e80ab5b4e43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:12.721041 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1556abb6-bd98-41fb-8ba9-4e80ab5b4e43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:12.722692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1556abb6-bd98-41fb-8ba9-4e80ab5b4e43 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:12.742750 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-1556abb6-bd98-41fb-8ba9-4e80ab5b4e43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:12.742750 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:12.742750 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:12.742750 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:12.742750 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:12.742750 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:12.742750 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:12.742750 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:12.742750 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:12.742750 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:12.742750 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:12.742750 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:12.742750 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:12.742750 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:12.742750 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:12.744286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:12.744286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:12.744286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:12.744286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:12.744286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:12.744286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:12.744286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:12.744286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:12.744286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:12.744286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:12.744286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:12.744286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:12.744286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:12.744286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:12.744286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:12.744286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:12.744286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:12.746098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:12.746098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:12.746098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:12.746098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:26:12.746098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 607/1203] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:26:12.753579 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ac763-db1c-4855-8c15-2d4231f23355 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:12.887305 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ac763-db1c-4855-8c15-2d4231f23355 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:12.919553 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:12.929386 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2438ee2-5b66-4be8-845c-7f581cf70c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:12.930131 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2438ee2-5b66-4be8-845c-7f581cf70c6b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:12.930459 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2438ee2-5b66-4be8-845c-7f581cf70c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:12.930815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2438ee2-5b66-4be8-845c-7f581cf70c6b None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:12.931618 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2438ee2-5b66-4be8-845c-7f581cf70c6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:12.932014 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2438ee2-5b66-4be8-845c-7f581cf70c6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:12.933616 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2438ee2-5b66-4be8-845c-7f581cf70c6b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:12.946779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 597/1204] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:12.953644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556abb6-bd98-41fb-8ba9-4e80ab5b4e43 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:13.027475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:13.095053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556abb6-bd98-41fb-8ba9-4e80ab5b4e43 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:13.141236 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2c181-b14f-4514-bc80-59939180b7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:13.141902 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2c181-b14f-4514-bc80-59939180b7de None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:13.142264 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2c181-b14f-4514-bc80-59939180b7de None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:13.142565 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2c181-b14f-4514-bc80-59939180b7de None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:13.143245 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d2c181-b14f-4514-bc80-59939180b7de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:13.144887 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d2c181-b14f-4514-bc80-59939180b7de None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:13.170754 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 608/1205] 10.222.0.32 () {60 vars in 1132 bytes} [Thu Jun 2 13:26:12 2022] POST /identity/v3/users => generated 251 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:26:15.609126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c9e6a-68b6-494a-9a50-6552a54e477a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:15.609818 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c9e6a-68b6-494a-9a50-6552a54e477a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:15.609818 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c9e6a-68b6-494a-9a50-6552a54e477a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:15.611107 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 598/1206] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:15.617159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7249908-8bc7-47c6-a50b-4c363816e64a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:15.617603 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7249908-8bc7-47c6-a50b-4c363816e64a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:15.617718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7249908-8bc7-47c6-a50b-4c363816e64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:15.636916 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c7249908-8bc7-47c6-a50b-4c363816e64a None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:15.638270 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c7249908-8bc7-47c6-a50b-4c363816e64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:15.711547 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 609/1207] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:26:15.734988 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c9e6a-68b6-494a-9a50-6552a54e477a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:15.857712 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c9e6a-68b6-494a-9a50-6552a54e477a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:15.897566 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffd656-f422-4fb6-837a-8a1edba68430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:15.898786 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffd656-f422-4fb6-837a-8a1edba68430 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:15.899300 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffd656-f422-4fb6-837a-8a1edba68430 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:15.899818 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffd656-f422-4fb6-837a-8a1edba68430 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:15.914904 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffd656-f422-4fb6-837a-8a1edba68430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:15.923453 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-32ffd656-f422-4fb6-837a-8a1edba68430 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:15.923453 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:15.923453 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:15.923453 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:15.923453 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:15.923453 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:15.923453 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:15.923453 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:15.923453 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:15.923453 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:15.923453 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:15.923453 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:15.923453 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:15.923453 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:15.923453 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:15.923453 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:15.924911 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:15.924911 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:15.924911 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:15.924911 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:15.924911 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:15.924911 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:15.924911 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:15.924911 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:15.924911 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:15.924911 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:15.924911 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:15.924911 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:15.924911 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:15.924911 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:15.924911 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:15.924911 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:15.926181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:15.926181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:15.926181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:15.926181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:15.926181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:15.926181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:15.926181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:15.926181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:15.926181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:15.926181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:15.926181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:15.926181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:26:15.930327 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 599/1208] 10.222.0.32 () {56 vars in 1102 bytes} [Thu Jun 2 13:26:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:15.931636 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7249908-8bc7-47c6-a50b-4c363816e64a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:15.981153 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:16.056101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7249908-8bc7-47c6-a50b-4c363816e64a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:16.104933 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f52b80-c36e-4cce-ad98-a070e358b0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:16.105975 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f52b80-c36e-4cce-ad98-a070e358b0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:16.106468 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f52b80-c36e-4cce-ad98-a070e358b0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:16.106936 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f52b80-c36e-4cce-ad98-a070e358b0a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:16.107884 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f52b80-c36e-4cce-ad98-a070e358b0a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:16.108523 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f52b80-c36e-4cce-ad98-a070e358b0a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:16.110028 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f52b80-c36e-4cce-ad98-a070e358b0a8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:16.122074 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 610/1209] 10.222.0.32 () {56 vars in 1103 bytes} [Thu Jun 2 13:26:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:16.127561 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffd656-f422-4fb6-837a-8a1edba68430 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:16.182773 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:16.243219 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffd656-f422-4fb6-837a-8a1edba68430 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:16.280471 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8245b07-410b-4802-9600-4aded4029232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:16.281300 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8245b07-410b-4802-9600-4aded4029232 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:16.281832 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8245b07-410b-4802-9600-4aded4029232 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:16.281951 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8245b07-410b-4802-9600-4aded4029232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:16.295157 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8245b07-410b-4802-9600-4aded4029232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:16.296737 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8245b07-410b-4802-9600-4aded4029232 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:16.319157 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c8245b07-410b-4802-9600-4aded4029232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:16.319157 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:16.319157 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:16.319157 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:16.319157 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:16.319157 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:16.319157 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:16.319157 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:16.319157 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:16.319157 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:16.319157 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:16.319157 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:16.319157 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:16.319157 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:16.319157 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:16.320367 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:16.320367 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:16.320367 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:16.320367 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:16.320367 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:16.320367 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:16.320367 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:16.320367 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:16.320367 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:16.320367 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:16.320367 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:16.320367 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:16.320367 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:16.320367 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:16.320367 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:16.320367 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:16.320367 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:16.321411 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:16.321411 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:16.321411 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:16.321411 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:26:16.321411 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 600/1210] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:16.326321 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f52b80-c36e-4cce-ad98-a070e358b0a8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:16.453743 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:16.457623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f52b80-c36e-4cce-ad98-a070e358b0a8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:16.509216 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef882734-e98e-4ac3-b7b2-5ae405b81de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:16.510120 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef882734-e98e-4ac3-b7b2-5ae405b81de9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:16.510447 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef882734-e98e-4ac3-b7b2-5ae405b81de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:16.510867 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef882734-e98e-4ac3-b7b2-5ae405b81de9 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:16.511849 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef882734-e98e-4ac3-b7b2-5ae405b81de9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:16.512220 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef882734-e98e-4ac3-b7b2-5ae405b81de9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:16.513770 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef882734-e98e-4ac3-b7b2-5ae405b81de9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:16.533370 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 611/1211] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:16.538807 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8245b07-410b-4802-9600-4aded4029232 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:16.658814 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8245b07-410b-4802-9600-4aded4029232 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:16.660516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:16.701943 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdc856-f127-4c89-8def-b6ae8531b828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:16.702864 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdc856-f127-4c89-8def-b6ae8531b828 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:16.703091 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdc856-f127-4c89-8def-b6ae8531b828 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:16.703354 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdc856-f127-4c89-8def-b6ae8531b828 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:16.711184 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdc856-f127-4c89-8def-b6ae8531b828 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:16.712979 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdc856-f127-4c89-8def-b6ae8531b828 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:16.730355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-64cdc856-f127-4c89-8def-b6ae8531b828 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:26:16.730355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:16.730355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:16.730355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:16.730355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:16.730355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:16.730355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:16.730355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:16.730355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:16.730355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:16.730355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:16.730355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:16.730355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:26:16.730355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:26:16.730355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:26:16.730355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:26:16.731558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:16.731558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:16.731558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:26:16.731558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:16.731558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:26:16.731558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:16.731558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:16.731558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:16.731558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:16.731558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:16.731558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:16.731558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:16.731558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:16.731558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:16.731558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:16.731558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:16.731558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:16.731558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:16.732571 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:16.732571 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:16.732571 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:26:16.732571 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:26:16.732571 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:26:16.732571 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:26:16.732571 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:26:16.732571 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:26:16.732571 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:26:16.732571 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:26:16.732571 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 601/1212] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:16.737587 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef882734-e98e-4ac3-b7b2-5ae405b81de9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:16.861061 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef882734-e98e-4ac3-b7b2-5ae405b81de9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:16.901481 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f6265-eece-4205-8cb2-b7c6ac7b0182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:16.902159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f6265-eece-4205-8cb2-b7c6ac7b0182 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:16.902447 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f6265-eece-4205-8cb2-b7c6ac7b0182 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:16.902728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f6265-eece-4205-8cb2-b7c6ac7b0182 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:16.903884 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f6265-eece-4205-8cb2-b7c6ac7b0182 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:16.904204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f6265-eece-4205-8cb2-b7c6ac7b0182 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:16.905677 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f6265-eece-4205-8cb2-b7c6ac7b0182 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:16.927999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 612/1213] 10.222.0.32 () {56 vars in 1143 bytes} [Thu Jun 2 13:26:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:16.933701 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdc856-f127-4c89-8def-b6ae8531b828 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:17.053070 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdc856-f127-4c89-8def-b6ae8531b828 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:17.093094 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7fb68-c703-49f7-9de6-a653bf106376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:17.093770 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7fb68-c703-49f7-9de6-a653bf106376 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:17.094146 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7fb68-c703-49f7-9de6-a653bf106376 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:17.094485 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7fb68-c703-49f7-9de6-a653bf106376 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:17.128781 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:17.171715 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7fb68-c703-49f7-9de6-a653bf106376 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:17.173576 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7fb68-c703-49f7-9de6-a653bf106376 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:17.291582 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 602/1214] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:26:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:26:17.298037 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f6265-eece-4205-8cb2-b7c6ac7b0182 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:17.319509 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:17.415711 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f6265-eece-4205-8cb2-b7c6ac7b0182 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:17.453059 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e272d1c-0275-41fa-aa45-634c31e421d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:17.453846 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e272d1c-0275-41fa-aa45-634c31e421d9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:17.454127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e272d1c-0275-41fa-aa45-634c31e421d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:17.454398 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e272d1c-0275-41fa-aa45-634c31e421d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:17.465571 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e272d1c-0275-41fa-aa45-634c31e421d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:17.467014 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e272d1c-0275-41fa-aa45-634c31e421d9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:17.490344 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-3e272d1c-0275-41fa-aa45-634c31e421d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:17.490344 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:17.490344 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:17.490344 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:17.490344 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:17.490344 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:17.490344 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:17.490344 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:17.490344 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:17.490344 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:17.490344 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:17.490344 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:17.490344 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:17.490344 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:17.490344 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:17.491289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:17.491289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:17.491289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:17.491289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:17.491289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:17.491289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:17.491289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:17.491289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:17.491289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:17.491289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:17.491289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:17.491289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:17.491289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:17.491289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:17.491289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:17.491289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:17.491289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:17.492202 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:17.492202 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:17.492202 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:17.492202 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:26:17.494594 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 613/1215] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:17.500290 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7fb68-c703-49f7-9de6-a653bf106376 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:17.587356 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:17.637361 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7fb68-c703-49f7-9de6-a653bf106376 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:17.675488 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26765c-f26f-44e9-a104-2bed0409be43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:17.676504 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26765c-f26f-44e9-a104-2bed0409be43 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:17.676504 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26765c-f26f-44e9-a104-2bed0409be43 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:17.676796 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26765c-f26f-44e9-a104-2bed0409be43 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:17.677535 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26765c-f26f-44e9-a104-2bed0409be43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:17.677955 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26765c-f26f-44e9-a104-2bed0409be43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:17.679339 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26765c-f26f-44e9-a104-2bed0409be43 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:17.692246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 603/1216] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:17.699487 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e272d1c-0275-41fa-aa45-634c31e421d9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:17.781540 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:17.824453 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e272d1c-0275-41fa-aa45-634c31e421d9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:17.865486 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e7e9d-c50f-4f45-bf4a-e34c22601580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:17.866192 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e7e9d-c50f-4f45-bf4a-e34c22601580 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:17.866474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e7e9d-c50f-4f45-bf4a-e34c22601580 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:17.866745 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e7e9d-c50f-4f45-bf4a-e34c22601580 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:17.873539 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e7e9d-c50f-4f45-bf4a-e34c22601580 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:17.875208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e7e9d-c50f-4f45-bf4a-e34c22601580 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:17.892150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-574e7e9d-c50f-4f45-bf4a-e34c22601580 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:17.892150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:17.892150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:17.892150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:17.892150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:17.892150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:17.892150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:17.892150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:17.892150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:17.892150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:17.892150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:17.892150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:17.892150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:26:17.892150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:26:17.892150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:26:17.893367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:26:17.893367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:17.893367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:17.893367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:17.893367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:17.893367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:17.893367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:17.893367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:17.893367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:17.893367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:17.893367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:17.893367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:17.893367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:17.893367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:17.893367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:17.893367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:17.893367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:17.899382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:26:17.899382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:26:17.899382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:26:17.899382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:26:17.899382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:26:17.899382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:26:17.899382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:17.899382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:26:17.899382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 614/1217] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:26:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:17.901291 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26765c-f26f-44e9-a104-2bed0409be43 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:18.025101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26765c-f26f-44e9-a104-2bed0409be43 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:18.050705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:18.065811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745d81c-184c-45d8-999d-3e881746135a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:18.066676 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745d81c-184c-45d8-999d-3e881746135a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:18.067063 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745d81c-184c-45d8-999d-3e881746135a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:18.067500 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745d81c-184c-45d8-999d-3e881746135a None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:18.068981 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745d81c-184c-45d8-999d-3e881746135a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:18.069431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745d81c-184c-45d8-999d-3e881746135a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:18.071148 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745d81c-184c-45d8-999d-3e881746135a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:18.084532 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 604/1218] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:26:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:26:18.091072 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e7e9d-c50f-4f45-bf4a-e34c22601580 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:18.209990 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e7e9d-c50f-4f45-bf4a-e34c22601580 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:18.243754 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:18.250063 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b24937-1c05-418c-beb5-4958251b000c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:18.250744 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b24937-1c05-418c-beb5-4958251b000c None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:18.251034 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b24937-1c05-418c-beb5-4958251b000c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:18.251315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b24937-1c05-418c-beb5-4958251b000c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:18.252163 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b24937-1c05-418c-beb5-4958251b000c None admin] RBAC: Adding query filter params (role.id=a12865c9fb9e4fa0b61e4adfd53188fb, scope.project.id=a9007447059e4862972078c032a5d67b, user.id=24410ef5e78042c79c5b4a0d78b56258) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:18.252513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b24937-1c05-418c-beb5-4958251b000c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:18.254008 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b24937-1c05-418c-beb5-4958251b000c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:18.268328 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 615/1219] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:26:18 2022] GET /identity/v3/role_assignments?user.id=24410ef5e78042c79c5b4a0d78b56258&scope.project.id=a9007447059e4862972078c032a5d67b&role.id=a12865c9fb9e4fa0b61e4adfd53188fb => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:20.577462 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ec221-e17d-434b-8864-6b50dc5902b9 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:20.578031 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ec221-e17d-434b-8864-6b50dc5902b9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:20.578031 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ec221-e17d-434b-8864-6b50dc5902b9 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:20.579425 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 605/1220] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:20.585695 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc89ad7-d8c6-47c7-815a-43a2ad6162de None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:20.586166 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc89ad7-d8c6-47c7-815a-43a2ad6162de None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:20.586525 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc89ad7-d8c6-47c7-815a-43a2ad6162de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:20.606231 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ebc89ad7-d8c6-47c7-815a-43a2ad6162de None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:20.607719 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ebc89ad7-d8c6-47c7-815a-43a2ad6162de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:20.683720 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 616/1221] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:26:20.709303 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ec221-e17d-434b-8864-6b50dc5902b9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:20.820275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ec221-e17d-434b-8864-6b50dc5902b9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:20.856384 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab89bf-f376-41f2-8b5e-08c78d4e6683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:20.857116 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab89bf-f376-41f2-8b5e-08c78d4e6683 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:20.857394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab89bf-f376-41f2-8b5e-08c78d4e6683 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:20.857670 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab89bf-f376-41f2-8b5e-08c78d4e6683 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:20.870390 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab89bf-f376-41f2-8b5e-08c78d4e6683 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:20.881431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-0aab89bf-f376-41f2-8b5e-08c78d4e6683 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:20.881431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:20.881431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:20.881431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:20.881431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:20.881431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:20.881431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:20.881431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:20.881431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:20.881431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:20.881431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:20.881431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:20.881431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:20.881431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:20.881431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:20.881431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:20.883286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:20.883286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:20.883286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:20.883286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:20.883286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:20.883286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:20.883286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:20.883286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:20.883286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:20.883286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:20.883286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:20.883286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:20.883286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:20.883286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:20.883286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:20.883286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:20.884480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:20.884480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:20.884480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:20.884480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:20.884480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:20.884480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:20.884480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:20.884480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:20.884480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:20.884480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:20.884480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:20.884480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:26:20.884480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 606/1222] 10.222.0.32 () {56 vars in 1102 bytes} [Thu Jun 2 13:26:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:20.888813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc89ad7-d8c6-47c7-815a-43a2ad6162de None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:21.011056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc89ad7-d8c6-47c7-815a-43a2ad6162de None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:21.045970 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:21.059179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aee12f-64af-4c0d-8ee4-5ac229df974b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:21.059919 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aee12f-64af-4c0d-8ee4-5ac229df974b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:21.060209 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aee12f-64af-4c0d-8ee4-5ac229df974b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:21.060551 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aee12f-64af-4c0d-8ee4-5ac229df974b None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:21.061378 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aee12f-64af-4c0d-8ee4-5ac229df974b None admin] RBAC: Adding query filter params (name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:21.061822 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aee12f-64af-4c0d-8ee4-5ac229df974b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:21.063534 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aee12f-64af-4c0d-8ee4-5ac229df974b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:21.075009 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 617/1223] 10.222.0.32 () {56 vars in 1103 bytes} [Thu Jun 2 13:26:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:21.081033 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab89bf-f376-41f2-8b5e-08c78d4e6683 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:21.135132 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:21.203065 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab89bf-f376-41f2-8b5e-08c78d4e6683 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:21.242649 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73474bac-d470-40ef-8f6e-5eff23a4a761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:21.243633 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73474bac-d470-40ef-8f6e-5eff23a4a761 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:21.243949 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73474bac-d470-40ef-8f6e-5eff23a4a761 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:21.244253 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73474bac-d470-40ef-8f6e-5eff23a4a761 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:21.257924 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73474bac-d470-40ef-8f6e-5eff23a4a761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:21.259557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73474bac-d470-40ef-8f6e-5eff23a4a761 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:21.278401 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-73474bac-d470-40ef-8f6e-5eff23a4a761 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:21.278401 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:21.278401 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:21.278401 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:21.278401 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:21.278401 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:21.278401 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:21.278401 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:21.278401 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:21.278401 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:21.278401 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:21.278401 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:21.278401 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:21.278401 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:21.278401 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:21.279548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:21.279548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:21.279548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:21.279548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:21.279548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:21.279548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:21.279548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:21.279548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:21.279548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:21.279548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:21.279548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:21.279548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:21.279548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:21.279548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:21.279548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:21.279548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:21.279548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:21.280539 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:21.280539 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:21.280539 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:21.280539 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:26:21.280539 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 607/1224] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:21.285598 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aee12f-64af-4c0d-8ee4-5ac229df974b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:21.412366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aee12f-64af-4c0d-8ee4-5ac229df974b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:21.456329 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae8c19-0058-4d25-9b63-c7bb27b25ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:21.457249 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae8c19-0058-4d25-9b63-c7bb27b25ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:21.457666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae8c19-0058-4d25-9b63-c7bb27b25ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:21.458073 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae8c19-0058-4d25-9b63-c7bb27b25ed9 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:21.459069 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae8c19-0058-4d25-9b63-c7bb27b25ed9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:21.459550 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae8c19-0058-4d25-9b63-c7bb27b25ed9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:21.461581 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae8c19-0058-4d25-9b63-c7bb27b25ed9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:21.477665 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 618/1225] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:26:21.483625 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73474bac-d470-40ef-8f6e-5eff23a4a761 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:21.595719 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:21.603253 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73474bac-d470-40ef-8f6e-5eff23a4a761 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:21.647750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b34dcc-033f-4988-a4b6-9eeb884657e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:21.648572 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b34dcc-033f-4988-a4b6-9eeb884657e4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:21.648856 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b34dcc-033f-4988-a4b6-9eeb884657e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:21.649132 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b34dcc-033f-4988-a4b6-9eeb884657e4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:21.656982 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b34dcc-033f-4988-a4b6-9eeb884657e4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:21.658664 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b34dcc-033f-4988-a4b6-9eeb884657e4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:21.675028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b1b34dcc-033f-4988-a4b6-9eeb884657e4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:26:21.675028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:21.675028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:21.675028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:21.675028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:21.675028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:21.675028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:21.675028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:21.675028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:21.675028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:21.675028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:21.675028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:21.675028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:26:21.675028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:26:21.675028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:26:21.675028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:26:21.676319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:21.676319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:21.676319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:26:21.676319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:21.676319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:26:21.676319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:21.676319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:21.676319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:21.676319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:21.676319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:21.676319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:21.676319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:21.676319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:21.676319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:21.676319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:21.676319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:21.676319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:21.676319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:21.677517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:21.677517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:21.677517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:26:21.677517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:26:21.677517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:26:21.677517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:26:21.677517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:26:21.677517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:26:21.677517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:26:21.677517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:26:21.677517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 608/1226] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:21.685061 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae8c19-0058-4d25-9b63-c7bb27b25ed9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:21.737278 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:21.797085 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae8c19-0058-4d25-9b63-c7bb27b25ed9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:21.842693 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c88de-8381-4a04-9b20-d2adc10181fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:21.843544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c88de-8381-4a04-9b20-d2adc10181fa None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:21.844072 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c88de-8381-4a04-9b20-d2adc10181fa None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:21.844626 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c88de-8381-4a04-9b20-d2adc10181fa None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:21.845950 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c88de-8381-4a04-9b20-d2adc10181fa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:21.846414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c88de-8381-4a04-9b20-d2adc10181fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:21.849413 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c88de-8381-4a04-9b20-d2adc10181fa None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:21.868725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 619/1227] 10.222.0.32 () {56 vars in 1143 bytes} [Thu Jun 2 13:26:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:26:21.876235 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b34dcc-033f-4988-a4b6-9eeb884657e4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:22.000278 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b34dcc-033f-4988-a4b6-9eeb884657e4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:22.046641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdd268-b462-4cbc-9124-29465b7c3c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:22.047472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdd268-b462-4cbc-9124-29465b7c3c56 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:22.047786 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdd268-b462-4cbc-9124-29465b7c3c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:22.048155 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdd268-b462-4cbc-9124-29465b7c3c56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:22.060228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbdd268-b462-4cbc-9124-29465b7c3c56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:22.061820 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbdd268-b462-4cbc-9124-29465b7c3c56 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:22.081596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4fbdd268-b462-4cbc-9124-29465b7c3c56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:22.081596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:22.081596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:22.081596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:22.081596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:22.081596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:22.081596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:22.081596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:22.081596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:22.081596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:22.081596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:22.081596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:22.081596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:22.081596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:22.081596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:22.082903 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:22.082903 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:22.082903 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:22.082903 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:22.082903 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:22.082903 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:22.082903 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:22.082903 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:22.082903 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:22.082903 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:22.082903 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:22.082903 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:22.082903 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:22.082903 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:22.082903 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:22.082903 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:22.082903 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:22.084174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:22.084174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:22.084174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:22.084174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:26:22.084174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 609/1228] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:22.092553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c88de-8381-4a04-9b20-d2adc10181fa None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:22.209070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c88de-8381-4a04-9b20-d2adc10181fa None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:22.212322 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:22.250230 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccce7fb-b53b-4e83-9f20-f54fbeae939e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:22.251052 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccce7fb-b53b-4e83-9f20-f54fbeae939e None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:22.251275 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccce7fb-b53b-4e83-9f20-f54fbeae939e None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:22.251623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccce7fb-b53b-4e83-9f20-f54fbeae939e None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:22.252462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccce7fb-b53b-4e83-9f20-f54fbeae939e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:22.252779 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccce7fb-b53b-4e83-9f20-f54fbeae939e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:22.254236 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccce7fb-b53b-4e83-9f20-f54fbeae939e None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:22.267253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 620/1229] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:22.273078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdd268-b462-4cbc-9124-29465b7c3c56 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:22.283060 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:22.380415 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdd268-b462-4cbc-9124-29465b7c3c56 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:22.422831 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427a2ce-a3f6-4dbc-a27c-1050690d034f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:22.423952 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427a2ce-a3f6-4dbc-a27c-1050690d034f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:22.424235 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427a2ce-a3f6-4dbc-a27c-1050690d034f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:22.424544 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427a2ce-a3f6-4dbc-a27c-1050690d034f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:22.433356 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427a2ce-a3f6-4dbc-a27c-1050690d034f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:22.435309 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427a2ce-a3f6-4dbc-a27c-1050690d034f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:22.453373 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-d427a2ce-a3f6-4dbc-a27c-1050690d034f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:22.453373 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:22.453373 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:22.453373 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:22.453373 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:22.453373 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:22.453373 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:22.453373 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:22.453373 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:22.453373 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:22.453373 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:22.453373 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:22.453373 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:26:22.453373 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:26:22.453373 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:26:22.459921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:26:22.459921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:22.459921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:22.459921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:22.459921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:22.459921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:22.459921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:22.459921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:22.459921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:22.459921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:22.459921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:22.459921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:22.459921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:22.459921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:22.459921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:22.459921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:22.459921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:22.461490 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:26:22.461490 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:26:22.461490 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:26:22.461490 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:26:22.461490 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:26:22.461490 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:26:22.461490 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:22.461490 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:26:22.461490 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 610/1230] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:26:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:22.462116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccce7fb-b53b-4e83-9f20-f54fbeae939e None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:22.574487 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccce7fb-b53b-4e83-9f20-f54fbeae939e None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:22.615014 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f8e2b-7ac9-4ae1-9056-a563bef2baae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:22.618175 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f8e2b-7ac9-4ae1-9056-a563bef2baae None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:22.618672 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f8e2b-7ac9-4ae1-9056-a563bef2baae None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:22.619163 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f8e2b-7ac9-4ae1-9056-a563bef2baae None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:22.620657 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f8e2b-7ac9-4ae1-9056-a563bef2baae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:22.621206 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f8e2b-7ac9-4ae1-9056-a563bef2baae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:22.623718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f8e2b-7ac9-4ae1-9056-a563bef2baae None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:22.638218 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 621/1231] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:26:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:22.644345 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427a2ce-a3f6-4dbc-a27c-1050690d034f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:22.721058 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:22.757445 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427a2ce-a3f6-4dbc-a27c-1050690d034f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:22.794592 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93261e-16f4-47e3-bc8f-4de5d7ddb024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:22.795626 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93261e-16f4-47e3-bc8f-4de5d7ddb024 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:22.795929 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93261e-16f4-47e3-bc8f-4de5d7ddb024 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:22.796207 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93261e-16f4-47e3-bc8f-4de5d7ddb024 None admin] PATH_INFO: `/v3/projects/a9007447059e4862972078c032a5d67b/users/24410ef5e78042c79c5b4a0d78b56258/roles/a12865c9fb9e4fa0b61e4adfd53188fb` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:22.814874 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c93261e-16f4-47e3-bc8f-4de5d7ddb024 None admin] RBAC: Authorizing `identity:create_grant(project_id=a9007447059e4862972078c032a5d67b, user_id=24410ef5e78042c79c5b4a0d78b56258, role_id=a12865c9fb9e4fa0b61e4adfd53188fb)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:22.816503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c93261e-16f4-47e3-bc8f-4de5d7ddb024 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:22.841685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 611/1232] 10.222.0.32 () {58 vars in 1439 bytes} [Thu Jun 2 13:26:22 2022] PUT /identity/v3/projects/a9007447059e4862972078c032a5d67b/users/24410ef5e78042c79c5b4a0d78b56258/roles/a12865c9fb9e4fa0b61e4adfd53188fb => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:26:25.153525 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278a026-4bdd-4e71-ac83-d5f03ae41d83 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:25.154068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278a026-4bdd-4e71-ac83-d5f03ae41d83 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:25.154068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278a026-4bdd-4e71-ac83-d5f03ae41d83 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:25.155690 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 622/1233] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:25.161344 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a1b1f-541a-471c-b008-4eb21d774ef2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:25.161899 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a1b1f-541a-471c-b008-4eb21d774ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:25.161899 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a1b1f-541a-471c-b008-4eb21d774ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:25.178700 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-979a1b1f-541a-471c-b008-4eb21d774ef2 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:25.179942 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-979a1b1f-541a-471c-b008-4eb21d774ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:25.252604 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 612/1234] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:26:25.277394 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278a026-4bdd-4e71-ac83-d5f03ae41d83 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:25.305540 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:25.391691 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278a026-4bdd-4e71-ac83-d5f03ae41d83 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:25.431114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db07e4-5a92-45e2-8193-3a48ba6f89de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:25.431974 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db07e4-5a92-45e2-8193-3a48ba6f89de None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:25.432320 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db07e4-5a92-45e2-8193-3a48ba6f89de None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:25.432668 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db07e4-5a92-45e2-8193-3a48ba6f89de None admin] PATH_INFO: `/v3/roles/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:25.444282 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db07e4-5a92-45e2-8193-3a48ba6f89de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:25.452725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-57db07e4-5a92-45e2-8193-3a48ba6f89de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:25.452725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:25.452725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:25.452725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:25.452725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:25.452725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:25.452725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:25.452725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:25.452725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:25.452725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:25.452725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:25.452725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:25.452725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:25.452725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:25.452725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:25.452725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:25.453863 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:25.453863 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:25.453863 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:25.453863 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:25.453863 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:25.453863 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:25.453863 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:25.453863 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:25.453863 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:25.453863 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:25.453863 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:25.453863 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:25.453863 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:25.453863 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:25.453863 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:25.453863 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:25.454751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:25.454751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:25.454751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:25.454751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:25.454751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:25.454751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:25.454751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:25.454751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:25.454751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:25.454751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:25.454751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:26:25.454751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:26:25.454751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 623/1235] 10.222.0.32 () {56 vars in 1102 bytes} [Thu Jun 2 13:26:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:25.460700 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a1b1f-541a-471c-b008-4eb21d774ef2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:25.510131 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:25.569494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a1b1f-541a-471c-b008-4eb21d774ef2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:25.604584 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413dc7b4-13d4-41e0-929c-067e029f2d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:25.605254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dc7b4-13d4-41e0-929c-067e029f2d11 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:25.605549 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dc7b4-13d4-41e0-929c-067e029f2d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:25.605833 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dc7b4-13d4-41e0-929c-067e029f2d11 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:25.606587 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413dc7b4-13d4-41e0-929c-067e029f2d11 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:25.606902 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413dc7b4-13d4-41e0-929c-067e029f2d11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:25.608337 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413dc7b4-13d4-41e0-929c-067e029f2d11 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:25.617640 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 613/1236] 10.222.0.32 () {56 vars in 1103 bytes} [Thu Jun 2 13:26:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:25.624199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db07e4-5a92-45e2-8193-3a48ba6f89de None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:25.719712 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:25.737796 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db07e4-5a92-45e2-8193-3a48ba6f89de None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:25.775197 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3f77e-8e22-4c3e-bc38-d55177d94a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:25.775989 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3f77e-8e22-4c3e-bc38-d55177d94a5d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:25.776274 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3f77e-8e22-4c3e-bc38-d55177d94a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:25.776732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3f77e-8e22-4c3e-bc38-d55177d94a5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:25.788593 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3f77e-8e22-4c3e-bc38-d55177d94a5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:25.790068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3f77e-8e22-4c3e-bc38-d55177d94a5d None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:25.808716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-d7b3f77e-8e22-4c3e-bc38-d55177d94a5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:25.808716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:25.808716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:25.808716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:25.808716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:25.808716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:25.808716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:25.808716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:25.808716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:25.808716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:25.808716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:25.808716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:25.808716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:25.808716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:25.808716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:25.810005 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:25.810005 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:25.810005 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:25.810005 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:25.810005 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:25.810005 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:25.810005 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:25.810005 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:25.810005 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:25.810005 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:25.810005 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:25.810005 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:25.810005 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:25.810005 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:25.810005 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:25.810005 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:25.810005 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:25.810919 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:25.810919 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:25.810919 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:25.810919 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:26:25.810919 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 624/1237] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:25.817850 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413dc7b4-13d4-41e0-929c-067e029f2d11 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:25.936653 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413dc7b4-13d4-41e0-929c-067e029f2d11 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:25.946537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:25.973181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838eecf-94f7-4cfc-b972-d3ffb4c46120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:25.974365 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838eecf-94f7-4cfc-b972-d3ffb4c46120 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:25.974671 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838eecf-94f7-4cfc-b972-d3ffb4c46120 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:25.974950 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838eecf-94f7-4cfc-b972-d3ffb4c46120 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:25.975670 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838eecf-94f7-4cfc-b972-d3ffb4c46120 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:25.975996 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838eecf-94f7-4cfc-b972-d3ffb4c46120 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:25.977407 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838eecf-94f7-4cfc-b972-d3ffb4c46120 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:25.990221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 614/1238] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:25.996082 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3f77e-8e22-4c3e-bc38-d55177d94a5d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:26.105134 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3f77e-8e22-4c3e-bc38-d55177d94a5d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:26.139488 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99a65c-2e6c-410b-b0bc-034d334e0474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:26.140369 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99a65c-2e6c-410b-b0bc-034d334e0474 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:26.140663 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99a65c-2e6c-410b-b0bc-034d334e0474 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:26.140953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99a65c-2e6c-410b-b0bc-034d334e0474 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:26.143663 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:26.149697 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99a65c-2e6c-410b-b0bc-034d334e0474 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:26.151329 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99a65c-2e6c-410b-b0bc-034d334e0474 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:26.168289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-3b99a65c-2e6c-410b-b0bc-034d334e0474 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:26:26.168289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:26.168289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:26.168289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:26.168289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:26.168289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:26.168289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:26.168289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:26.168289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:26.168289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:26.168289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:26.168289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:26.168289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:26:26.168289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:26:26.168289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:26:26.168289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:26:26.169855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:26.169855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:26.169855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:26:26.169855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:26.169855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:26:26.169855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:26.169855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:26.169855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:26.169855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:26.169855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:26.169855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:26.169855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:26.169855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:26.169855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:26.169855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:26.169855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:26.169855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:26.169855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:26.171022 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:26.171022 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:26.171022 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:26:26.171022 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:26:26.171022 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:26:26.171022 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:26:26.171022 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:26:26.171022 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:26:26.171022 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:26:26.171022 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:26:26.171022 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 625/1239] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:26.177178 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838eecf-94f7-4cfc-b972-d3ffb4c46120 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:26.283150 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838eecf-94f7-4cfc-b972-d3ffb4c46120 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:26.321052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d6acf-198e-45ee-bb43-11f78fcc8a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:26.321842 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d6acf-198e-45ee-bb43-11f78fcc8a79 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:26.322148 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d6acf-198e-45ee-bb43-11f78fcc8a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:26.322580 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d6acf-198e-45ee-bb43-11f78fcc8a79 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:26.323612 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d6acf-198e-45ee-bb43-11f78fcc8a79 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:26.323928 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d6acf-198e-45ee-bb43-11f78fcc8a79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:26.325627 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d6acf-198e-45ee-bb43-11f78fcc8a79 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:26.346067 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 615/1240] 10.222.0.32 () {56 vars in 1143 bytes} [Thu Jun 2 13:26:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:26.352422 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99a65c-2e6c-410b-b0bc-034d334e0474 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:26.461164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99a65c-2e6c-410b-b0bc-034d334e0474 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:26.499982 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a103419-6fd7-4138-b542-93c041208363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:26.500876 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a103419-6fd7-4138-b542-93c041208363 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:26.501160 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a103419-6fd7-4138-b542-93c041208363 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:26.501475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a103419-6fd7-4138-b542-93c041208363 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:26.576801 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:26.585225 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a103419-6fd7-4138-b542-93c041208363 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:26.586934 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a103419-6fd7-4138-b542-93c041208363 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:26.696724 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 626/1241] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:26:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:26:26.702622 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d6acf-198e-45ee-bb43-11f78fcc8a79 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:26.732843 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:26.816576 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d6acf-198e-45ee-bb43-11f78fcc8a79 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:26.859981 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62f1f7-3246-4997-aee9-71e73f919900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:26.860764 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62f1f7-3246-4997-aee9-71e73f919900 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:26.861073 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62f1f7-3246-4997-aee9-71e73f919900 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:26.861373 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62f1f7-3246-4997-aee9-71e73f919900 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:26.876051 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62f1f7-3246-4997-aee9-71e73f919900 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:26.877568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62f1f7-3246-4997-aee9-71e73f919900 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:26.896797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-7e62f1f7-3246-4997-aee9-71e73f919900 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:26.896797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:26.896797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:26.896797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:26.896797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:26.896797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:26.896797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:26.896797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:26.896797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:26.896797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:26.896797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:26.896797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:26.896797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:26.896797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:26.896797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:26.898040 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:26.898040 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:26.898040 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:26.898040 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:26.898040 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:26.898040 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:26.898040 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:26.898040 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:26.898040 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:26.898040 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:26.898040 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:26.898040 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:26.898040 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:26.898040 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:26.898040 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:26.898040 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:26.898040 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:26.899350 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:26.899350 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:26.899350 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:26.899350 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:26:26.899350 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 616/1242] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:26.903848 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a103419-6fd7-4138-b542-93c041208363 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:27.007173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:27.014429 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a103419-6fd7-4138-b542-93c041208363 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:27.054082 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b1fd0-49d4-4684-b952-aeb25ee83c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:27.054901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b1fd0-49d4-4684-b952-aeb25ee83c39 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:27.055209 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b1fd0-49d4-4684-b952-aeb25ee83c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:27.055593 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b1fd0-49d4-4684-b952-aeb25ee83c39 None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:27.056521 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b1fd0-49d4-4684-b952-aeb25ee83c39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:27.056834 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b1fd0-49d4-4684-b952-aeb25ee83c39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:27.058215 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b1fd0-49d4-4684-b952-aeb25ee83c39 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:27.070795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 627/1243] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:27.076430 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62f1f7-3246-4997-aee9-71e73f919900 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:27.163350 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:27.185840 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62f1f7-3246-4997-aee9-71e73f919900 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:27.224166 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca132f4-8cd6-4b05-bad9-92ea61bda8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:27.225099 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca132f4-8cd6-4b05-bad9-92ea61bda8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:27.225421 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca132f4-8cd6-4b05-bad9-92ea61bda8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:27.225735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca132f4-8cd6-4b05-bad9-92ea61bda8e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:27.232758 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca132f4-8cd6-4b05-bad9-92ea61bda8e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:27.234536 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca132f4-8cd6-4b05-bad9-92ea61bda8e2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:27.250917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-bca132f4-8cd6-4b05-bad9-92ea61bda8e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:27.250917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:27.250917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:27.250917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:27.250917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:27.250917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:27.250917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:27.250917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:27.250917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:27.250917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:27.250917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:27.250917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:27.250917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:26:27.250917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:26:27.250917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:26:27.252126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:26:27.252126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:27.252126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:27.252126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:27.252126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:27.252126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:27.252126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:27.252126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:27.252126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:27.252126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:27.252126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:27.252126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:27.252126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:27.252126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:27.252126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:27.252126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:27.252126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:27.253338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:26:27.253338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:26:27.253338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:26:27.253338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:26:27.253338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:26:27.253338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:26:27.253338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:27.253338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:26:27.253338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 617/1244] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:26:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:26:27.258950 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b1fd0-49d4-4684-b952-aeb25ee83c39 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:27.375754 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b1fd0-49d4-4684-b952-aeb25ee83c39 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:27.413931 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df5955-5c74-49df-83b5-e6972a0350e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:27.414703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df5955-5c74-49df-83b5-e6972a0350e3 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:27.415057 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df5955-5c74-49df-83b5-e6972a0350e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:27.415366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df5955-5c74-49df-83b5-e6972a0350e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:27.416190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df5955-5c74-49df-83b5-e6972a0350e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:27.416528 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df5955-5c74-49df-83b5-e6972a0350e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:27.417979 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df5955-5c74-49df-83b5-e6972a0350e3 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:27.437615 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 628/1245] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:26:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:27.439067 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca132f4-8cd6-4b05-bad9-92ea61bda8e2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:27.554947 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca132f4-8cd6-4b05-bad9-92ea61bda8e2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:27.592182 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58967a8f-0d09-4cd5-9de1-84c3d4686c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:27.592908 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58967a8f-0d09-4cd5-9de1-84c3d4686c2f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:27.593193 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58967a8f-0d09-4cd5-9de1-84c3d4686c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:27.593474 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58967a8f-0d09-4cd5-9de1-84c3d4686c2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:27.594424 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58967a8f-0d09-4cd5-9de1-84c3d4686c2f None admin] RBAC: Adding query filter params (role.id=a12865c9fb9e4fa0b61e4adfd53188fb, scope.project.id=a9007447059e4862972078c032a5d67b, user.id=24410ef5e78042c79c5b4a0d78b56258) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:27.594781 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58967a8f-0d09-4cd5-9de1-84c3d4686c2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:27.596350 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58967a8f-0d09-4cd5-9de1-84c3d4686c2f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:27.603271 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 618/1246] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:26:27 2022] GET /identity/v3/role_assignments?user.id=24410ef5e78042c79c5b4a0d78b56258&scope.project.id=a9007447059e4862972078c032a5d67b&role.id=a12865c9fb9e4fa0b61e4adfd53188fb => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:30.172074 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d3643-96c6-42e2-b74e-27c62f067060 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:30.172686 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d3643-96c6-42e2-b74e-27c62f067060 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:30.172686 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d3643-96c6-42e2-b74e-27c62f067060 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:30.174047 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 629/1247] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:30.180019 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb7cb0-2b0f-4400-b6fc-290b165dbe7d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:30.180553 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb7cb0-2b0f-4400-b6fc-290b165dbe7d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:30.180666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb7cb0-2b0f-4400-b6fc-290b165dbe7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:30.185826 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:30.202605 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c8eb7cb0-2b0f-4400-b6fc-290b165dbe7d None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:30.203824 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c8eb7cb0-2b0f-4400-b6fc-290b165dbe7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:30.282271 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 619/1248] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:26:30.305311 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d3643-96c6-42e2-b74e-27c62f067060 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:30.323879 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:30.416519 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d3643-96c6-42e2-b74e-27c62f067060 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:30.458403 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f1cd9-df95-40f3-aeff-c9737a7f717d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:30.459285 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f1cd9-df95-40f3-aeff-c9737a7f717d None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:30.459560 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f1cd9-df95-40f3-aeff-c9737a7f717d None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:30.459835 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f1cd9-df95-40f3-aeff-c9737a7f717d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:30.472623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f1cd9-df95-40f3-aeff-c9737a7f717d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:30.481688 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-f12f1cd9-df95-40f3-aeff-c9737a7f717d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:26:30.481688 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:30.481688 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:30.481688 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:30.481688 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:30.481688 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:30.481688 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:30.481688 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:30.481688 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:30.481688 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:30.481688 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:30.481688 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:30.481688 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:30.481688 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:30.481688 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:30.481688 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:30.482720 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:30.482720 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:30.482720 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:30.482720 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:30.482720 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:30.482720 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:30.482720 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:30.482720 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:30.482720 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:30.482720 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:30.482720 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:30.482720 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:30.482720 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:30.482720 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:30.482720 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:30.482720 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:30.483593 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:30.483593 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:30.483593 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:30.483593 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:30.483593 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:30.483593 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:30.483593 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:30.483593 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:30.483593 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:30.483593 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:30.483593 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:26:30.483593 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:26:30.483593 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 630/1249] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:26:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:30.489724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb7cb0-2b0f-4400-b6fc-290b165dbe7d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:30.595922 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb7cb0-2b0f-4400-b6fc-290b165dbe7d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:30.636745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:30.642544 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc720cec-ecdb-463c-8d53-2c86b36541d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:30.643280 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc720cec-ecdb-463c-8d53-2c86b36541d6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:30.643607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc720cec-ecdb-463c-8d53-2c86b36541d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:30.643890 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc720cec-ecdb-463c-8d53-2c86b36541d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:30.644691 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc720cec-ecdb-463c-8d53-2c86b36541d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:30.645000 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc720cec-ecdb-463c-8d53-2c86b36541d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:30.646411 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc720cec-ecdb-463c-8d53-2c86b36541d6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:30.656707 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 620/1250] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:26:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:30.663685 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f1cd9-df95-40f3-aeff-c9737a7f717d None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:30.746259 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:30.770434 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f1cd9-df95-40f3-aeff-c9737a7f717d None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:30.807175 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877d444-8f10-429d-aeb5-9f3061fa93e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:30.808175 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877d444-8f10-429d-aeb5-9f3061fa93e6 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:30.808477 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877d444-8f10-429d-aeb5-9f3061fa93e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:30.808834 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877d444-8f10-429d-aeb5-9f3061fa93e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:30.820962 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877d444-8f10-429d-aeb5-9f3061fa93e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:30.822407 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877d444-8f10-429d-aeb5-9f3061fa93e6 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:30.841585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-1877d444-8f10-429d-aeb5-9f3061fa93e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:30.841585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:30.841585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:30.841585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:30.841585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:30.841585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:30.841585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:30.841585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:30.841585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:30.841585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:30.841585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:30.841585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:30.841585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:30.841585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:30.841585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:30.842710 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:30.842710 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:30.842710 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:30.842710 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:30.842710 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:30.842710 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:30.842710 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:30.842710 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:30.842710 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:30.842710 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:30.842710 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:30.842710 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:30.842710 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:30.842710 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:30.842710 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:30.842710 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:30.842710 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:30.843642 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:30.843642 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:30.843642 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:30.843642 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:26:30.843642 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 631/1251] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:30.849763 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc720cec-ecdb-463c-8d53-2c86b36541d6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:30.967013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc720cec-ecdb-463c-8d53-2c86b36541d6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:31.005423 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f03f14-17cd-446c-a243-ba4afdd626fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:31.006130 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f03f14-17cd-446c-a243-ba4afdd626fa None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:31.006415 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f03f14-17cd-446c-a243-ba4afdd626fa None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:31.006691 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f03f14-17cd-446c-a243-ba4afdd626fa None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:31.007409 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f03f14-17cd-446c-a243-ba4afdd626fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:31.007715 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f03f14-17cd-446c-a243-ba4afdd626fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:31.009438 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f03f14-17cd-446c-a243-ba4afdd626fa None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:31.025035 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 621/1252] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:31.031060 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877d444-8f10-429d-aeb5-9f3061fa93e6 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:31.143710 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877d444-8f10-429d-aeb5-9f3061fa93e6 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:31.172897 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:31.182220 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eef65c-cb97-4ce0-b08c-59cdc236adba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:31.183013 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eef65c-cb97-4ce0-b08c-59cdc236adba None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:31.183291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eef65c-cb97-4ce0-b08c-59cdc236adba None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:31.183570 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eef65c-cb97-4ce0-b08c-59cdc236adba None admin] PATH_INFO: `/v3/users/placement` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:31.191717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eef65c-cb97-4ce0-b08c-59cdc236adba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:31.193226 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eef65c-cb97-4ce0-b08c-59cdc236adba None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:31.208006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-f3eef65c-cb97-4ce0-b08c-59cdc236adba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:26:31.208006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:31.208006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:31.208006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:31.208006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:31.208006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:31.208006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:31.208006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:31.208006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:31.208006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:31.208006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:31.208006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:31.208006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:26:31.208006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:26:31.208006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:26:31.208006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:26:31.209272 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:31.209272 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:31.209272 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:26:31.209272 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:31.209272 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:26:31.209272 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:31.209272 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:31.209272 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:31.209272 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:31.209272 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:31.209272 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:31.209272 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:31.209272 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:31.209272 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:31.209272 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:31.209272 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:31.209272 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:31.209272 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:31.210400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:31.210400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:31.210400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:26:31.210400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:26:31.210400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:26:31.210400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:26:31.210400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:26:31.210400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:26:31.210400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:26:31.210400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:26:31.210400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 632/1253] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:31.215577 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f03f14-17cd-446c-a243-ba4afdd626fa None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:31.277958 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:31.334653 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f03f14-17cd-446c-a243-ba4afdd626fa None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:31.374806 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5802f-ddbb-49b0-a7d7-1b1681353d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:31.375516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5802f-ddbb-49b0-a7d7-1b1681353d07 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:31.375814 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5802f-ddbb-49b0-a7d7-1b1681353d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:31.376085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5802f-ddbb-49b0-a7d7-1b1681353d07 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:31.376979 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5802f-ddbb-49b0-a7d7-1b1681353d07 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:31.377293 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5802f-ddbb-49b0-a7d7-1b1681353d07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:31.378723 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5802f-ddbb-49b0-a7d7-1b1681353d07 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:31.397095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 622/1254] 10.222.0.32 () {56 vars in 1143 bytes} [Thu Jun 2 13:26:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:31.403179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eef65c-cb97-4ce0-b08c-59cdc236adba None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:31.514909 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eef65c-cb97-4ce0-b08c-59cdc236adba None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:31.561064 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d8166-4e25-4b22-8da7-5006b5c164b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:31.561667 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d8166-4e25-4b22-8da7-5006b5c164b7 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:31.561949 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d8166-4e25-4b22-8da7-5006b5c164b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:31.562225 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d8166-4e25-4b22-8da7-5006b5c164b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:31.629109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:31.642748 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d8166-4e25-4b22-8da7-5006b5c164b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:31.644375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d8166-4e25-4b22-8da7-5006b5c164b7 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:31.749670 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 633/1255] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:26:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:26:31.756181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5802f-ddbb-49b0-a7d7-1b1681353d07 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:31.875397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5802f-ddbb-49b0-a7d7-1b1681353d07 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:31.890706 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:31.914100 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032bf4a-91a8-48af-ba86-94737706db13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:31.914905 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032bf4a-91a8-48af-ba86-94737706db13 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:31.915190 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032bf4a-91a8-48af-ba86-94737706db13 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:31.915467 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032bf4a-91a8-48af-ba86-94737706db13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:31.926349 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032bf4a-91a8-48af-ba86-94737706db13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:31.927869 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032bf4a-91a8-48af-ba86-94737706db13 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:31.947700 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-8032bf4a-91a8-48af-ba86-94737706db13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:31.947700 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:31.947700 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:31.947700 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:31.947700 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:31.947700 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:31.947700 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:31.947700 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:31.947700 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:31.947700 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:31.947700 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:31.947700 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:31.947700 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:31.947700 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:31.947700 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:31.948914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:31.948914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:31.948914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:31.948914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:31.948914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:31.948914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:31.948914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:31.948914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:31.948914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:31.948914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:31.948914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:31.948914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:31.948914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:31.948914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:31.948914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:31.948914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:31.948914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:31.949834 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:31.949834 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:31.949834 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:31.949834 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:26:31.949834 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 623/1256] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:31.955031 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d8166-4e25-4b22-8da7-5006b5c164b7 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:32.049065 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:32.062336 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d8166-4e25-4b22-8da7-5006b5c164b7 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:32.099184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6c0bd-a9d2-4e2e-92e8-7396830ef62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:32.099854 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6c0bd-a9d2-4e2e-92e8-7396830ef62f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:32.100135 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6c0bd-a9d2-4e2e-92e8-7396830ef62f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:32.100448 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6c0bd-a9d2-4e2e-92e8-7396830ef62f None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:32.101174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6c0bd-a9d2-4e2e-92e8-7396830ef62f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:32.101482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6c0bd-a9d2-4e2e-92e8-7396830ef62f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:32.102854 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6c0bd-a9d2-4e2e-92e8-7396830ef62f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:32.114927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 634/1257] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:32.120740 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032bf4a-91a8-48af-ba86-94737706db13 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:32.222319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032bf4a-91a8-48af-ba86-94737706db13 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:32.258932 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303a375-3d7a-4091-8951-8731a733878e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:32.259732 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303a375-3d7a-4091-8951-8731a733878e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:32.260020 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303a375-3d7a-4091-8951-8731a733878e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:32.260326 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303a375-3d7a-4091-8951-8731a733878e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:32.267313 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303a375-3d7a-4091-8951-8731a733878e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:32.268814 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303a375-3d7a-4091-8951-8731a733878e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:32.282767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4303a375-3d7a-4091-8951-8731a733878e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:32.282767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:32.282767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:32.282767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:32.282767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:32.282767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:32.282767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:32.282767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:32.282767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:32.282767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:32.282767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:32.282767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:32.282767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:26:32.282767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:26:32.282767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:26:32.283820 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:26:32.283820 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:32.283820 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:32.283820 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:32.283820 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:32.283820 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:32.283820 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:32.283820 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:32.283820 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:32.283820 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:32.283820 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:32.283820 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:32.283820 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:32.283820 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:32.283820 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:32.283820 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:32.283820 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:32.284748 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:26:32.284748 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:26:32.284748 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:26:32.284748 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:26:32.284748 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:26:32.284748 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:26:32.284748 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:32.284748 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:26:32.284748 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 624/1258] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:26:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:32.289979 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6c0bd-a9d2-4e2e-92e8-7396830ef62f None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:32.388374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6c0bd-a9d2-4e2e-92e8-7396830ef62f None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:32.420592 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d89e07-4f27-4198-8dc1-458316b3eac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:32.421230 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d89e07-4f27-4198-8dc1-458316b3eac5 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:32.421516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d89e07-4f27-4198-8dc1-458316b3eac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:32.421794 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d89e07-4f27-4198-8dc1-458316b3eac5 None admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:32.422586 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d89e07-4f27-4198-8dc1-458316b3eac5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:32.422898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d89e07-4f27-4198-8dc1-458316b3eac5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:32.424347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d89e07-4f27-4198-8dc1-458316b3eac5 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:32.436477 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 635/1259] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:26:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:26:32.442576 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303a375-3d7a-4091-8951-8731a733878e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:32.467674 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:32.544339 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303a375-3d7a-4091-8951-8731a733878e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:32.576559 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a6326-691c-45c2-9b72-f19f97ab49b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:32.577203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a6326-691c-45c2-9b72-f19f97ab49b0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:32.577488 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a6326-691c-45c2-9b72-f19f97ab49b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:32.577767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a6326-691c-45c2-9b72-f19f97ab49b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:32.578590 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a6326-691c-45c2-9b72-f19f97ab49b0 None admin] RBAC: Adding query filter params (role.id=128feb04d1e042ac844f9ad70b89bb02, scope.project.id=a9007447059e4862972078c032a5d67b, user.id=24410ef5e78042c79c5b4a0d78b56258) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:32.578903 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a6326-691c-45c2-9b72-f19f97ab49b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:32.580348 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a6326-691c-45c2-9b72-f19f97ab49b0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:32.585629 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 625/1260] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:26:32 2022] GET /identity/v3/role_assignments?user.id=24410ef5e78042c79c5b4a0d78b56258&scope.project.id=a9007447059e4862972078c032a5d67b&role.id=128feb04d1e042ac844f9ad70b89bb02 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:34.763270 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70d46f-a48a-4cd3-8c43-7fcf099e5650 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:34.763828 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70d46f-a48a-4cd3-8c43-7fcf099e5650 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:34.763828 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70d46f-a48a-4cd3-8c43-7fcf099e5650 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:34.765216 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 636/1261] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:34.771047 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d64bf-8f17-44d6-8fd4-e61f14abeea6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:34.771444 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d64bf-8f17-44d6-8fd4-e61f14abeea6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:34.771603 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d64bf-8f17-44d6-8fd4-e61f14abeea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:34.788455 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b55d64bf-8f17-44d6-8fd4-e61f14abeea6 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:34.789627 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b55d64bf-8f17-44d6-8fd4-e61f14abeea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:34.866413 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 626/1262] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:26:34.890072 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70d46f-a48a-4cd3-8c43-7fcf099e5650 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:34.902117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:34.990188 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70d46f-a48a-4cd3-8c43-7fcf099e5650 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:35.023610 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8996ec-2467-439d-ac0d-4107874312b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:35.024465 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8996ec-2467-439d-ac0d-4107874312b9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:35.024747 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8996ec-2467-439d-ac0d-4107874312b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:35.025014 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8996ec-2467-439d-ac0d-4107874312b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:35.034752 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8996ec-2467-439d-ac0d-4107874312b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:35.042877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-ce8996ec-2467-439d-ac0d-4107874312b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:26:35.042877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:35.042877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:35.042877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:35.042877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:35.042877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:35.042877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:35.042877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:35.042877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:35.042877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:35.042877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:35.042877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:35.042877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:35.042877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:35.042877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:35.042877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:35.043994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:35.043994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:35.043994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:35.043994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:35.043994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:35.043994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:35.043994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:35.043994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:35.043994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:35.043994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:35.043994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:35.043994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:35.043994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:35.043994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:35.043994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:35.043994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:35.045068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:35.045068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:35.045068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:35.045068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:35.045068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:35.045068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:35.045068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:35.045068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:35.045068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:35.045068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:35.045068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:26:35.045068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:26:35.045068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 637/1263] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:26:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:35.050036 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d64bf-8f17-44d6-8fd4-e61f14abeea6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:35.068118 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:35.146065 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d64bf-8f17-44d6-8fd4-e61f14abeea6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:35.178345 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbccc168-4bcb-4091-9b23-497d6d91ad26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:35.179003 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccc168-4bcb-4091-9b23-497d6d91ad26 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:35.179285 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccc168-4bcb-4091-9b23-497d6d91ad26 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:35.179561 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccc168-4bcb-4091-9b23-497d6d91ad26 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:35.180317 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbccc168-4bcb-4091-9b23-497d6d91ad26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:35.180633 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbccc168-4bcb-4091-9b23-497d6d91ad26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:35.181999 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbccc168-4bcb-4091-9b23-497d6d91ad26 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:35.189898 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 627/1264] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:26:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:35.195562 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8996ec-2467-439d-ac0d-4107874312b9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:35.260149 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:35.293735 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8996ec-2467-439d-ac0d-4107874312b9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:35.324952 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802aa02-635b-46e2-8802-3f7d9c304ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:35.325717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802aa02-635b-46e2-8802-3f7d9c304ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:35.325995 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802aa02-635b-46e2-8802-3f7d9c304ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:35.326267 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802aa02-635b-46e2-8802-3f7d9c304ba8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:35.337211 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802aa02-635b-46e2-8802-3f7d9c304ba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:35.338656 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802aa02-635b-46e2-8802-3f7d9c304ba8 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:35.356117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-5802aa02-635b-46e2-8802-3f7d9c304ba8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:35.356117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:35.356117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:35.356117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:35.356117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:35.356117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:35.356117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:35.356117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:35.356117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:35.356117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:35.356117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:35.356117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:35.356117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:35.356117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:35.356117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:35.357199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:35.357199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:35.357199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:35.357199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:35.357199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:35.357199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:35.357199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:35.357199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:35.357199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:35.357199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:35.357199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:35.357199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:35.357199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:35.357199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:35.357199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:35.357199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:35.357199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:35.358383 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:35.358383 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:35.358383 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:35.358383 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:26:35.358383 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 638/1265] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:35.362969 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbccc168-4bcb-4091-9b23-497d6d91ad26 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:35.441365 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:35.460966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbccc168-4bcb-4091-9b23-497d6d91ad26 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:35.492948 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc11e96-916a-4128-a607-384169e09e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:35.493591 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc11e96-916a-4128-a607-384169e09e4b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:35.493877 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc11e96-916a-4128-a607-384169e09e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:35.494155 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc11e96-916a-4128-a607-384169e09e4b None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:35.494867 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc11e96-916a-4128-a607-384169e09e4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:35.495175 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc11e96-916a-4128-a607-384169e09e4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:35.496573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc11e96-916a-4128-a607-384169e09e4b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:35.508421 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 628/1266] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:35.513946 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802aa02-635b-46e2-8802-3f7d9c304ba8 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:35.610491 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802aa02-635b-46e2-8802-3f7d9c304ba8 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:35.628985 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:35.643804 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29b5ac-42c2-45c7-9f5c-735a707977cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:35.644631 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29b5ac-42c2-45c7-9f5c-735a707977cc None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:35.644971 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29b5ac-42c2-45c7-9f5c-735a707977cc None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:35.645734 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29b5ac-42c2-45c7-9f5c-735a707977cc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:35.653051 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29b5ac-42c2-45c7-9f5c-735a707977cc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:35.654475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29b5ac-42c2-45c7-9f5c-735a707977cc None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:35.668247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-ae29b5ac-42c2-45c7-9f5c-735a707977cc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:26:35.668247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:35.668247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:35.668247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:35.668247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:35.668247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:35.668247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:35.668247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:35.668247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:35.668247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:35.668247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:35.668247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:35.668247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:26:35.668247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:26:35.668247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:26:35.668247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:26:35.669333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:35.669333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:35.669333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:26:35.669333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:35.669333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:26:35.669333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:35.669333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:35.669333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:35.669333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:35.669333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:35.669333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:35.669333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:35.669333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:35.669333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:35.669333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:35.669333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:35.669333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:35.669333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:35.675477 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:35.675477 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:35.675477 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:26:35.675477 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:26:35.675477 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:26:35.675477 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:26:35.675477 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:26:35.675477 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:26:35.675477 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:26:35.675477 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:26:35.675477 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 639/1267] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:35.676233 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc11e96-916a-4128-a607-384169e09e4b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:35.772348 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc11e96-916a-4128-a607-384169e09e4b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:35.804855 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f8b98-e0b1-4522-8112-4c0072659240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:35.805520 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f8b98-e0b1-4522-8112-4c0072659240 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:35.805787 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f8b98-e0b1-4522-8112-4c0072659240 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:35.806059 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f8b98-e0b1-4522-8112-4c0072659240 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:35.806899 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f8b98-e0b1-4522-8112-4c0072659240 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:35.807192 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f8b98-e0b1-4522-8112-4c0072659240 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:35.808696 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f8b98-e0b1-4522-8112-4c0072659240 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:35.818837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:35.829516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 629/1268] 10.222.0.32 () {56 vars in 1143 bytes} [Thu Jun 2 13:26:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:35.836636 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29b5ac-42c2-45c7-9f5c-735a707977cc None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:35.933116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29b5ac-42c2-45c7-9f5c-735a707977cc None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:35.966000 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289cc93-750a-4eef-9a2f-0006d40b96ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:35.966780 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289cc93-750a-4eef-9a2f-0006d40b96ef None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:35.967059 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289cc93-750a-4eef-9a2f-0006d40b96ef None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:35.967333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289cc93-750a-4eef-9a2f-0006d40b96ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:35.977508 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4289cc93-750a-4eef-9a2f-0006d40b96ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:35.978938 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4289cc93-750a-4eef-9a2f-0006d40b96ef None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:35.995763 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-4289cc93-750a-4eef-9a2f-0006d40b96ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:35.995763 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:35.995763 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:35.995763 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:35.995763 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:35.995763 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:35.995763 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:35.995763 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:35.995763 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:35.995763 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:35.995763 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:35.995763 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:35.995763 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:35.995763 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:35.995763 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:35.996821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:35.996821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:35.996821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:35.996821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:35.996821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:35.996821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:35.996821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:35.996821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:35.996821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:35.996821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:35.996821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:35.996821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:35.996821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:35.996821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:35.996821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:35.996821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:35.996821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:35.997884 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:35.997884 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:35.997884 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:35.997884 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:26:35.997884 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 640/1269] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:36.002778 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f8b98-e0b1-4522-8112-4c0072659240 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:36.101836 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f8b98-e0b1-4522-8112-4c0072659240 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:36.135623 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae096e6-121f-41ce-93f7-1f8ec45ea7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:36.136283 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae096e6-121f-41ce-93f7-1f8ec45ea7fa None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:36.136594 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae096e6-121f-41ce-93f7-1f8ec45ea7fa None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:36.136873 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae096e6-121f-41ce-93f7-1f8ec45ea7fa None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:36.137595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae096e6-121f-41ce-93f7-1f8ec45ea7fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:36.137905 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae096e6-121f-41ce-93f7-1f8ec45ea7fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:36.139293 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae096e6-121f-41ce-93f7-1f8ec45ea7fa None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:36.150352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 630/1270] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:36.155935 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289cc93-750a-4eef-9a2f-0006d40b96ef None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:36.187292 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:36.259148 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289cc93-750a-4eef-9a2f-0006d40b96ef None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:36.291198 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04112a3-de1d-444b-ba3a-753626bd9f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:36.291970 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04112a3-de1d-444b-ba3a-753626bd9f7b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:36.292252 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04112a3-de1d-444b-ba3a-753626bd9f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:36.292552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04112a3-de1d-444b-ba3a-753626bd9f7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:36.299040 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04112a3-de1d-444b-ba3a-753626bd9f7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:36.300521 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04112a3-de1d-444b-ba3a-753626bd9f7b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:36.314804 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-a04112a3-de1d-444b-ba3a-753626bd9f7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:36.314804 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:36.314804 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:36.314804 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:36.314804 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:36.314804 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:36.314804 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:36.314804 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:36.314804 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:36.314804 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:36.314804 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:36.314804 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:36.314804 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:26:36.314804 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:26:36.314804 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:26:36.315751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:26:36.315751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:36.315751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:36.315751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:36.315751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:36.315751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:36.315751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:36.315751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:36.315751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:36.315751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:36.315751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:36.315751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:36.315751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:36.315751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:36.315751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:36.315751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:36.315751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:36.316917 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:26:36.316917 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:26:36.316917 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:26:36.316917 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:26:36.316917 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:26:36.316917 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:26:36.316917 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:36.316917 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:26:36.316917 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 641/1271] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:26:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:36.321753 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae096e6-121f-41ce-93f7-1f8ec45ea7fa None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:36.379946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:36.421501 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae096e6-121f-41ce-93f7-1f8ec45ea7fa None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:36.455149 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c11bd-6d31-4f94-98fd-a5858b007ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:36.455731 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c11bd-6d31-4f94-98fd-a5858b007ead None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:36.456011 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c11bd-6d31-4f94-98fd-a5858b007ead None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:36.456285 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c11bd-6d31-4f94-98fd-a5858b007ead None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:36.457084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c11bd-6d31-4f94-98fd-a5858b007ead None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:36.457388 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c11bd-6d31-4f94-98fd-a5858b007ead None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:36.458811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c11bd-6d31-4f94-98fd-a5858b007ead None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:36.479980 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 631/1272] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:26:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:36.485729 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04112a3-de1d-444b-ba3a-753626bd9f7b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:36.574118 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:36.582991 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04112a3-de1d-444b-ba3a-753626bd9f7b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:36.617255 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8feecb-95c3-42f8-b7d5-b7d543035c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:36.618126 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8feecb-95c3-42f8-b7d5-b7d543035c7c None admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:36.618416 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8feecb-95c3-42f8-b7d5-b7d543035c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:36.618692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8feecb-95c3-42f8-b7d5-b7d543035c7c None admin] PATH_INFO: `/v3/projects/a9007447059e4862972078c032a5d67b/users/24410ef5e78042c79c5b4a0d78b56258/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:36.620665 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8feecb-95c3-42f8-b7d5-b7d543035c7c None admin] RBAC: Authorizing `identity:create_grant(project_id=a9007447059e4862972078c032a5d67b, user_id=24410ef5e78042c79c5b4a0d78b56258, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:36.622093 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8feecb-95c3-42f8-b7d5-b7d543035c7c None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:36.634549 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 642/1273] 10.222.0.32 () {58 vars in 1439 bytes} [Thu Jun 2 13:26:36 2022] PUT /identity/v3/projects/a9007447059e4862972078c032a5d67b/users/24410ef5e78042c79c5b4a0d78b56258/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:26:38.834110 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257a1d7-c329-4b6a-bbbd-257b12fa609a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:38.834743 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257a1d7-c329-4b6a-bbbd-257b12fa609a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:38.834743 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257a1d7-c329-4b6a-bbbd-257b12fa609a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:38.836471 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 632/1274] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:38.842199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed7de3-6b3a-48c5-8893-2beeef6f31e9 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:38.842640 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed7de3-6b3a-48c5-8893-2beeef6f31e9 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:38.842835 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed7de3-6b3a-48c5-8893-2beeef6f31e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:38.861413 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-02ed7de3-6b3a-48c5-8893-2beeef6f31e9 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:38.862912 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-02ed7de3-6b3a-48c5-8893-2beeef6f31e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:38.929654 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 643/1275] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:26:38.953460 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257a1d7-c329-4b6a-bbbd-257b12fa609a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:39.052201 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257a1d7-c329-4b6a-bbbd-257b12fa609a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:39.070071 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:39.087161 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82eea0-8027-4236-b7d3-447fa8069aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:39.087888 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82eea0-8027-4236-b7d3-447fa8069aad None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:39.088177 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82eea0-8027-4236-b7d3-447fa8069aad None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:39.088493 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82eea0-8027-4236-b7d3-447fa8069aad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:39.098440 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82eea0-8027-4236-b7d3-447fa8069aad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:26:39.106069 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-6e82eea0-8027-4236-b7d3-447fa8069aad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:26:39.106069 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:39.106069 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:39.106069 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:39.106069 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:39.106069 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:39.106069 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:39.106069 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:39.106069 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:39.106069 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:39.106069 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:39.106069 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:39.106069 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:26:39.106069 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:26:39.106069 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:26:39.106069 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:26:39.107174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:26:39.107174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:26:39.107174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:26:39.107174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:26:39.107174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:39.107174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:39.107174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:39.107174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:39.107174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:39.107174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:39.107174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:39.107174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:39.107174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:39.107174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:39.107174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:39.107174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:39.108109 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:39.108109 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:39.108109 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:39.108109 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:39.108109 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:26:39.108109 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:26:39.108109 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:26:39.108109 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:26:39.108109 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:26:39.108109 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:26:39.108109 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:26:39.108109 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:26:39.108109 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 633/1276] 10.222.0.32 () {56 vars in 1096 bytes} [Thu Jun 2 13:26:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:39.113249 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed7de3-6b3a-48c5-8893-2beeef6f31e9 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:39.192770 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:39.210973 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed7de3-6b3a-48c5-8893-2beeef6f31e9 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:39.244376 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfe968-e3be-4b84-a6c5-e0e63aa0112a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:39.245032 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfe968-e3be-4b84-a6c5-e0e63aa0112a None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:39.245323 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfe968-e3be-4b84-a6c5-e0e63aa0112a None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:39.245607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfe968-e3be-4b84-a6c5-e0e63aa0112a None admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:39.246355 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfe968-e3be-4b84-a6c5-e0e63aa0112a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:39.246666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfe968-e3be-4b84-a6c5-e0e63aa0112a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:39.248031 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfe968-e3be-4b84-a6c5-e0e63aa0112a None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:39.256284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 644/1277] 10.222.0.32 () {56 vars in 1099 bytes} [Thu Jun 2 13:26:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:39.261790 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82eea0-8027-4236-b7d3-447fa8069aad None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:39.359262 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82eea0-8027-4236-b7d3-447fa8069aad None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:39.391693 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7bf89-536f-4f57-ad39-a148e88ce18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:39.392491 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7bf89-536f-4f57-ad39-a148e88ce18c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:39.392774 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7bf89-536f-4f57-ad39-a148e88ce18c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:39.393049 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7bf89-536f-4f57-ad39-a148e88ce18c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:39.403992 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7bf89-536f-4f57-ad39-a148e88ce18c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:39.405491 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7bf89-536f-4f57-ad39-a148e88ce18c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:39.422408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-fea7bf89-536f-4f57-ad39-a148e88ce18c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:39.422408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:39.422408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:39.422408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:39.422408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:39.422408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:39.422408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:39.422408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:39.422408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:39.422408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:39.422408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:39.422408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:39.422408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:39.422408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:39.422408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:39.423436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:39.423436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:39.423436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:39.423436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:39.423436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:39.423436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:39.423436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:39.423436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:39.423436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:39.423436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:39.423436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:39.423436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:39.423436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:39.423436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:39.423436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:39.423436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:39.423436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:39.424584 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:39.424584 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:39.424584 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:39.424584 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:26:39.424584 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 634/1278] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:39.429751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfe968-e3be-4b84-a6c5-e0e63aa0112a None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:39.524495 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfe968-e3be-4b84-a6c5-e0e63aa0112a None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:39.557916 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5e163-654a-4d2e-b7c3-26bd4650ed3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:39.558815 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5e163-654a-4d2e-b7c3-26bd4650ed3b None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:39.559098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5e163-654a-4d2e-b7c3-26bd4650ed3b None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:39.559378 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5e163-654a-4d2e-b7c3-26bd4650ed3b None admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:39.560091 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5e163-654a-4d2e-b7c3-26bd4650ed3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:39.560430 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5e163-654a-4d2e-b7c3-26bd4650ed3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:39.561787 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5e163-654a-4d2e-b7c3-26bd4650ed3b None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:39.572634 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 645/1279] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:39.578118 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7bf89-536f-4f57-ad39-a148e88ce18c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:39.609330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:39.676265 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7bf89-536f-4f57-ad39-a148e88ce18c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:39.707704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fc3a6-b37e-4949-9f01-84e0ecbeaa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:39.708540 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fc3a6-b37e-4949-9f01-84e0ecbeaa32 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:39.709327 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fc3a6-b37e-4949-9f01-84e0ecbeaa32 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:39.709598 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fc3a6-b37e-4949-9f01-84e0ecbeaa32 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:39.716987 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53fc3a6-b37e-4949-9f01-84e0ecbeaa32 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:39.718421 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53fc3a6-b37e-4949-9f01-84e0ecbeaa32 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:39.732633 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c53fc3a6-b37e-4949-9f01-84e0ecbeaa32 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:26:39.732633 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:39.732633 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:39.732633 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:39.732633 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:39.732633 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:39.732633 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:39.732633 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:39.732633 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:39.732633 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:39.732633 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:39.732633 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:39.732633 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:26:39.732633 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:26:39.732633 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:26:39.732633 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:26:39.733704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:39.733704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:39.733704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:26:39.733704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:39.733704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:26:39.733704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:26:39.733704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:39.733704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:39.733704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:39.733704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:39.733704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:39.733704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:39.733704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:39.733704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:39.733704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:39.733704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:39.733704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:39.733704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:39.734855 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:39.734855 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:39.734855 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:26:39.734855 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:26:39.734855 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:26:39.734855 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:26:39.734855 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:26:39.734855 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:26:39.734855 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:26:39.734855 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:26:39.734855 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 635/1280] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:39.739468 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5e163-654a-4d2e-b7c3-26bd4650ed3b None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:39.743175 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:39.842665 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5e163-654a-4d2e-b7c3-26bd4650ed3b None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:39.875147 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0b151-5475-46fb-a5cf-5333940c98b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:39.875740 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0b151-5475-46fb-a5cf-5333940c98b4 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:39.876026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0b151-5475-46fb-a5cf-5333940c98b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:39.876323 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0b151-5475-46fb-a5cf-5333940c98b4 None admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:39.877165 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0b151-5475-46fb-a5cf-5333940c98b4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:39.877475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0b151-5475-46fb-a5cf-5333940c98b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:39.878894 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0b151-5475-46fb-a5cf-5333940c98b4 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:39.895825 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 646/1281] 10.222.0.32 () {56 vars in 1143 bytes} [Thu Jun 2 13:26:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:39.902141 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fc3a6-b37e-4949-9f01-84e0ecbeaa32 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:39.989655 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:39.999462 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fc3a6-b37e-4949-9f01-84e0ecbeaa32 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:40.032894 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33348659-f9b0-4101-9556-f3ad40cbe357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:40.033535 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33348659-f9b0-4101-9556-f3ad40cbe357 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:40.033819 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33348659-f9b0-4101-9556-f3ad40cbe357 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:40.034093 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33348659-f9b0-4101-9556-f3ad40cbe357 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:40.098829 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33348659-f9b0-4101-9556-f3ad40cbe357 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:40.100339 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33348659-f9b0-4101-9556-f3ad40cbe357 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:40.184326 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:40.195316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 636/1282] 10.222.0.32 () {58 vars in 1282 bytes} [Thu Jun 2 13:26:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:26:40.201158 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0b151-5475-46fb-a5cf-5333940c98b4 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:40.261521 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:40.299112 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0b151-5475-46fb-a5cf-5333940c98b4 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:40.332786 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa877697-44cc-4265-ab0e-8a52f16ae689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:40.333568 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa877697-44cc-4265-ab0e-8a52f16ae689 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:40.333884 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa877697-44cc-4265-ab0e-8a52f16ae689 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:40.334166 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa877697-44cc-4265-ab0e-8a52f16ae689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:40.344146 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa877697-44cc-4265-ab0e-8a52f16ae689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:40.345628 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa877697-44cc-4265-ab0e-8a52f16ae689 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:40.363270 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-fa877697-44cc-4265-ab0e-8a52f16ae689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:40.363270 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:40.363270 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:40.363270 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:40.363270 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:40.363270 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:40.363270 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:40.363270 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:40.363270 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:40.363270 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:40.363270 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:40.363270 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:40.363270 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:26:40.363270 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:26:40.363270 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:26:40.364329 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:26:40.364329 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:40.364329 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:40.364329 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:40.364329 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:40.364329 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:40.364329 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:40.364329 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:40.364329 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:40.364329 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:40.364329 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:40.364329 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:40.364329 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:40.364329 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:40.364329 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:40.364329 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:40.364329 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:40.365977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:26:40.365977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:26:40.365977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:26:40.365977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:26:40.365977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 647/1283] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:26:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:40.370548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33348659-f9b0-4101-9556-f3ad40cbe357 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:40.466531 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33348659-f9b0-4101-9556-f3ad40cbe357 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:40.499007 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607388b-8080-4aa9-b94e-25bfe0060b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:40.499662 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607388b-8080-4aa9-b94e-25bfe0060b62 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:40.499946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607388b-8080-4aa9-b94e-25bfe0060b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:40.500223 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607388b-8080-4aa9-b94e-25bfe0060b62 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:40.500963 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607388b-8080-4aa9-b94e-25bfe0060b62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:40.501272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607388b-8080-4aa9-b94e-25bfe0060b62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:40.502644 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607388b-8080-4aa9-b94e-25bfe0060b62 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:40.514134 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 637/1284] 10.222.0.32 () {56 vars in 1109 bytes} [Thu Jun 2 13:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:40.519775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa877697-44cc-4265-ab0e-8a52f16ae689 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:40.619630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa877697-44cc-4265-ab0e-8a52f16ae689 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:40.635848 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:40.657800 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08fd33-45fc-4a3a-93cc-f13193d69ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:40.658593 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08fd33-45fc-4a3a-93cc-f13193d69ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:40.658886 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08fd33-45fc-4a3a-93cc-f13193d69ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:40.659165 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08fd33-45fc-4a3a-93cc-f13193d69ef9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:40.666306 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08fd33-45fc-4a3a-93cc-f13193d69ef9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:40.667796 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08fd33-45fc-4a3a-93cc-f13193d69ef9 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:40.684585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application [None req-be08fd33-45fc-4a3a-93cc-f13193d69ef9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:40.684585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:40.684585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:40.684585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:40.684585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:40.684585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:40.684585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:40.684585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:40.684585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:40.684585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:40.684585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:40.684585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:40.684585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:26:40.684585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:26:40.684585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:26:40.685675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:26:40.685675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:40.685675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:40.685675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:40.685675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:40.685675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:40.685675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:40.685675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:40.685675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:40.685675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:40.685675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:40.685675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:40.685675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:40.685675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:40.685675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:40.685675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:40.685675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:40.686797 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:26:40.686797 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:26:40.686797 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:26:40.686797 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:26:40.686797 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:26:40.686797 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:26:40.686797 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:26:40.686797 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: ERROR keystone.server.flask.application Jun 02 13:26:40.686797 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 648/1285] 10.222.0.32 () {56 vars in 1111 bytes} [Thu Jun 2 13:26:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:40.692171 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607388b-8080-4aa9-b94e-25bfe0060b62 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:40.742175 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:40.792239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607388b-8080-4aa9-b94e-25bfe0060b62 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:40.826341 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ab8a6-1439-45cd-b75f-8dcd4a685cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:40.826992 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ab8a6-1439-45cd-b75f-8dcd4a685cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:40.827273 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ab8a6-1439-45cd-b75f-8dcd4a685cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:40.827545 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ab8a6-1439-45cd-b75f-8dcd4a685cd0 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:40.828359 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ab8a6-1439-45cd-b75f-8dcd4a685cd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:40.828670 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ab8a6-1439-45cd-b75f-8dcd4a685cd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:40.830110 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ab8a6-1439-45cd-b75f-8dcd4a685cd0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:40.842530 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 638/1286] 10.222.0.32 () {56 vars in 1148 bytes} [Thu Jun 2 13:26:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:40.848617 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08fd33-45fc-4a3a-93cc-f13193d69ef9 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:40.946944 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08fd33-45fc-4a3a-93cc-f13193d69ef9 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:40.979460 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a515f4-4dcf-4792-a6f6-6a43a1348072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:40.980100 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a515f4-4dcf-4792-a6f6-6a43a1348072 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:40.980408 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a515f4-4dcf-4792-a6f6-6a43a1348072 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:40.980687 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a515f4-4dcf-4792-a6f6-6a43a1348072 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:40.981516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a515f4-4dcf-4792-a6f6-6a43a1348072 None admin] RBAC: Adding query filter params (role.id=128feb04d1e042ac844f9ad70b89bb02, scope.project.id=a9007447059e4862972078c032a5d67b, user.id=24410ef5e78042c79c5b4a0d78b56258) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:40.981826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a515f4-4dcf-4792-a6f6-6a43a1348072 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:40.983242 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a515f4-4dcf-4792-a6f6-6a43a1348072 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:40.988997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 649/1287] 10.222.0.32 () {56 vars in 1374 bytes} [Thu Jun 2 13:26:40 2022] GET /identity/v3/role_assignments?user.id=24410ef5e78042c79c5b4a0d78b56258&scope.project.id=a9007447059e4862972078c032a5d67b&role.id=128feb04d1e042ac844f9ad70b89bb02 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:43.219330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42966327-630f-4448-b897-30a07d685a41 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:43.219858 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42966327-630f-4448-b897-30a07d685a41 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:43.219858 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42966327-630f-4448-b897-30a07d685a41 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:43.221262 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 639/1288] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:43.226508 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af71827-2b28-45db-a838-17105ca4ab89 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:43.226885 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af71827-2b28-45db-a838-17105ca4ab89 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:43.227079 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af71827-2b28-45db-a838-17105ca4ab89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:43.244196 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-7af71827-2b28-45db-a838-17105ca4ab89 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:43.245415 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7af71827-2b28-45db-a838-17105ca4ab89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:43.273833 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:43.310089 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 650/1289] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:26:43.333168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42966327-630f-4448-b897-30a07d685a41 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:43.429685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42966327-630f-4448-b897-30a07d685a41 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:43.439789 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:43.463032 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68561d-a1e0-41e9-8e70-edf5bb17305c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:43.463803 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68561d-a1e0-41e9-8e70-edf5bb17305c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:43.464085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68561d-a1e0-41e9-8e70-edf5bb17305c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:43.464379 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68561d-a1e0-41e9-8e70-edf5bb17305c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:43.465021 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68561d-a1e0-41e9-8e70-edf5bb17305c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:43.466384 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68561d-a1e0-41e9-8e70-edf5bb17305c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:43.477817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ee68561d-a1e0-41e9-8e70-edf5bb17305c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:26:43.477817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:43.477817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:26:43.477817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:26:43.477817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:26:43.477817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:26:43.477817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:26:43.477817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:26:43.477817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:26:43.477817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:26:43.477817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:26:43.477817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:26:43.477817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:43.477817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:43.477817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:43.477817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:43.477817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:43.479028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:43.479028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:43.479028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:43.479028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:43.479028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:43.479028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:43.479028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:26:43.479028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:26:43.479028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:26:43.479028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:26:43.479028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:43.479028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:43.479028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:43.479028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:43.479028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:43.479028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:43.480046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:43.480046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:43.480046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:43.480046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:43.480046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:43.480046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:43.480046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:43.480046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:43.480046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:43.480046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:43.480046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:26:43.480046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:26:43.480046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:26:43.480046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:26:43.480046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 640/1290] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Jun 2 13:26:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:43.484911 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af71827-2b28-45db-a838-17105ca4ab89 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:43.580447 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af71827-2b28-45db-a838-17105ca4ab89 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:43.612661 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9109f-d7b8-4ade-8c46-50f545d54c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:43.613314 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9109f-d7b8-4ade-8c46-50f545d54c5f None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:43.613602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9109f-d7b8-4ade-8c46-50f545d54c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:43.613882 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9109f-d7b8-4ade-8c46-50f545d54c5f None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:43.614589 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9109f-d7b8-4ade-8c46-50f545d54c5f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:43.615410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9109f-d7b8-4ade-8c46-50f545d54c5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:43.616805 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9109f-d7b8-4ade-8c46-50f545d54c5f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:43.621500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 651/1291] 10.222.0.32 () {56 vars in 1116 bytes} [Thu Jun 2 13:26:43 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:43.627149 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68561d-a1e0-41e9-8e70-edf5bb17305c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:43.723150 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68561d-a1e0-41e9-8e70-edf5bb17305c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:43.755854 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48a754-b1e2-4dde-9c00-8cb943669f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:43.756511 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48a754-b1e2-4dde-9c00-8cb943669f74 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:43.756794 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48a754-b1e2-4dde-9c00-8cb943669f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:43.757069 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48a754-b1e2-4dde-9c00-8cb943669f74 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:43.757755 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48a754-b1e2-4dde-9c00-8cb943669f74 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:43.758059 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48a754-b1e2-4dde-9c00-8cb943669f74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:43.759418 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48a754-b1e2-4dde-9c00-8cb943669f74 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:43.763716 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 641/1292] 10.222.0.32 () {56 vars in 1116 bytes} [Thu Jun 2 13:26:43 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:45.972162 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df625079-08e1-4300-b718-0cf9037617f7 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:45.972737 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df625079-08e1-4300-b718-0cf9037617f7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:45.972737 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df625079-08e1-4300-b718-0cf9037617f7 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:45.974607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 652/1293] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:45.979863 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827c75a-a1e4-4658-b612-e370e7f262ad None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:45.980263 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827c75a-a1e4-4658-b612-e370e7f262ad None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:45.980438 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827c75a-a1e4-4658-b612-e370e7f262ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:45.997395 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d827c75a-a1e4-4658-b612-e370e7f262ad None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:45.998573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d827c75a-a1e4-4658-b612-e370e7f262ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:46.027837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:46.064797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 642/1294] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:26:46.087827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df625079-08e1-4300-b718-0cf9037617f7 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:46.118979 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:46.186682 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df625079-08e1-4300-b718-0cf9037617f7 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:46.218923 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e78f1-b356-4633-ab9b-4bcc9358374f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:46.219570 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e78f1-b356-4633-ab9b-4bcc9358374f None admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:46.219857 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e78f1-b356-4633-ab9b-4bcc9358374f None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:46.220135 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e78f1-b356-4633-ab9b-4bcc9358374f None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:46.220882 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e78f1-b356-4633-ab9b-4bcc9358374f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:46.222291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e78f1-b356-4633-ab9b-4bcc9358374f None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:46.235088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 653/1295] 10.222.0.32 () {60 vars in 1141 bytes} [Thu Jun 2 13:26:46 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:26:48.457010 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed243ae-84fe-4091-a213-6a4198b7ce6e None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:48.457576 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed243ae-84fe-4091-a213-6a4198b7ce6e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:48.457576 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed243ae-84fe-4091-a213-6a4198b7ce6e None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:48.459503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 643/1296] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:26:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:48.464998 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0df32c-ecba-4dd9-bdf9-9a3d3fe79984 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:48.465436 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0df32c-ecba-4dd9-bdf9-9a3d3fe79984 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:48.465618 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0df32c-ecba-4dd9-bdf9-9a3d3fe79984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:48.481768 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ba0df32c-ecba-4dd9-bdf9-9a3d3fe79984 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:48.482931 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ba0df32c-ecba-4dd9-bdf9-9a3d3fe79984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:48.553282 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 654/1297] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:48 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:26:48.575788 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed243ae-84fe-4091-a213-6a4198b7ce6e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:48.674182 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed243ae-84fe-4091-a213-6a4198b7ce6e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:48.707184 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d66f0-f73c-418c-815c-b445e796949a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:48.707901 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d66f0-f73c-418c-815c-b445e796949a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:48.708181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d66f0-f73c-418c-815c-b445e796949a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:48.708513 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d66f0-f73c-418c-815c-b445e796949a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:48.709165 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d66f0-f73c-418c-815c-b445e796949a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:48.710537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d66f0-f73c-418c-815c-b445e796949a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:48.722221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-dd5d66f0-f73c-418c-815c-b445e796949a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:26:48.722221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:48.722221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:26:48.722221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:26:48.722221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:26:48.722221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:26:48.722221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:26:48.722221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:26:48.722221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:26:48.722221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:26:48.722221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:26:48.722221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:26:48.722221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:48.722221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:48.722221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:48.722221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:48.722221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:48.723431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:48.723431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:48.723431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:48.723431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:48.723431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:48.723431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:48.723431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:26:48.723431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:26:48.723431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:26:48.723431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:26:48.723431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:48.723431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:48.723431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:48.723431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:48.723431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:48.723431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:48.724366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:48.724366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:48.724366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:48.724366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:48.724366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:48.724366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:48.724366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:48.724366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:48.724366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:48.724366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:48.724366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:26:48.724366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:26:48.724366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:26:48.724366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:26:48.724366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 644/1298] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Jun 2 13:26:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:48.729317 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0df32c-ecba-4dd9-bdf9-9a3d3fe79984 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:48.747528 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:48.826241 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0df32c-ecba-4dd9-bdf9-9a3d3fe79984 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:48.858169 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f542a3-4d0c-43d5-859f-66c61ea1cb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:48.858820 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f542a3-4d0c-43d5-859f-66c61ea1cb45 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:48.859106 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f542a3-4d0c-43d5-859f-66c61ea1cb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:48.859382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f542a3-4d0c-43d5-859f-66c61ea1cb45 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:48.860086 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f542a3-4d0c-43d5-859f-66c61ea1cb45 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:48.860425 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f542a3-4d0c-43d5-859f-66c61ea1cb45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:48.861803 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f542a3-4d0c-43d5-859f-66c61ea1cb45 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:48.867348 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 655/1299] 10.222.0.32 () {56 vars in 1116 bytes} [Thu Jun 2 13:26:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:48.873460 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d66f0-f73c-418c-815c-b445e796949a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:48.904122 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:48.969858 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d66f0-f73c-418c-815c-b445e796949a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:49.002485 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac884062-9c1d-465d-b958-ffca1c17612a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:49.003119 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac884062-9c1d-465d-b958-ffca1c17612a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:49.003400 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac884062-9c1d-465d-b958-ffca1c17612a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:49.003673 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac884062-9c1d-465d-b958-ffca1c17612a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:49.004479 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac884062-9c1d-465d-b958-ffca1c17612a None admin] RBAC: Adding query filter params (interface=public, service_id=3e572add75c84c65a5376ea54b69b002, region_id=RegionOne) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:49.004796 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac884062-9c1d-465d-b958-ffca1c17612a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:49.006220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac884062-9c1d-465d-b958-ffca1c17612a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:49.011343 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 645/1300] 10.222.0.32 () {56 vars in 1251 bytes} [Thu Jun 2 13:26:48 2022] GET /identity/v3/endpoints?service_id=3e572add75c84c65a5376ea54b69b002&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:49.016895 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f542a3-4d0c-43d5-859f-66c61ea1cb45 None admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:49.094561 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:49.112553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f542a3-4d0c-43d5-859f-66c61ea1cb45 None admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:49.145036 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa72792-2c6b-42ed-815e-c22b3e969917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:49.145679 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa72792-2c6b-42ed-815e-c22b3e969917 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:49.145987 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa72792-2c6b-42ed-815e-c22b3e969917 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:49.146270 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa72792-2c6b-42ed-815e-c22b3e969917 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:49.146942 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa72792-2c6b-42ed-815e-c22b3e969917 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:49.148290 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa72792-2c6b-42ed-815e-c22b3e969917 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:49.154943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 656/1301] 10.222.0.32 () {56 vars in 1087 bytes} [Thu Jun 2 13:26:49 2022] GET /identity/v3/services => generated 2191 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:26:51.321314 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6cb6d-2de9-49a5-bcb7-d8de843efff7 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:51.321829 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6cb6d-2de9-49a5-bcb7-d8de843efff7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:51.321945 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6cb6d-2de9-49a5-bcb7-d8de843efff7 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:51.323240 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 646/1302] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:26:51.328457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998bb63-be7b-47ad-a0f3-18a746a6d641 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:51.328873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998bb63-be7b-47ad-a0f3-18a746a6d641 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:51.329003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998bb63-be7b-47ad-a0f3-18a746a6d641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:51.345535 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f998bb63-be7b-47ad-a0f3-18a746a6d641 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:26:51.346699 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f998bb63-be7b-47ad-a0f3-18a746a6d641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:26:51.409663 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 657/1303] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:26:51 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:26:51.432793 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6cb6d-2de9-49a5-bcb7-d8de843efff7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:51.524762 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:51.531548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6cb6d-2de9-49a5-bcb7-d8de843efff7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:51.563546 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f6c20-0bd3-4d4f-b392-b9a6d357672a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:51.564344 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f6c20-0bd3-4d4f-b392-b9a6d357672a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:51.564629 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f6c20-0bd3-4d4f-b392-b9a6d357672a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:51.564902 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f6c20-0bd3-4d4f-b392-b9a6d357672a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:51.565544 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f6c20-0bd3-4d4f-b392-b9a6d357672a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:51.566914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f6c20-0bd3-4d4f-b392-b9a6d357672a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:51.578394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c28f6c20-0bd3-4d4f-b392-b9a6d357672a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:26:51.578394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:51.578394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:26:51.578394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:26:51.578394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:26:51.578394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:26:51.578394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:26:51.578394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:26:51.578394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:26:51.578394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:26:51.578394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:26:51.578394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:26:51.578394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:26:51.578394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:26:51.578394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:26:51.578394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:26:51.578394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:26:51.579550 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:26:51.579550 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:26:51.579550 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:26:51.579550 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:26:51.579550 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:26:51.579550 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:26:51.579550 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:26:51.579550 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:26:51.579550 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:26:51.579550 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:26:51.579550 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:26:51.579550 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:26:51.579550 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:26:51.579550 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:26:51.579550 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:26:51.579550 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:26:51.580567 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:26:51.580567 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 02 13:26:51.580567 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:26:51.580567 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:26:51.580567 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:26:51.580567 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:26:51.580567 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:26:51.580567 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:26:51.580567 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:26:51.580567 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:26:51.580567 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:26:51.580567 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:26:51.580567 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:26:51.580567 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 02 13:26:51.580567 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 647/1304] 10.222.0.32 () {56 vars in 1117 bytes} [Thu Jun 2 13:26:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:26:51.585905 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998bb63-be7b-47ad-a0f3-18a746a6d641 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:51.659258 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:26:51.682013 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998bb63-be7b-47ad-a0f3-18a746a6d641 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:51.714936 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4a572-f2c1-4e0d-a63f-7da4e81de694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:51.715582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4a572-f2c1-4e0d-a63f-7da4e81de694 None admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:51.715867 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4a572-f2c1-4e0d-a63f-7da4e81de694 None admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:51.716146 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4a572-f2c1-4e0d-a63f-7da4e81de694 None admin] PATH_INFO: `/v3/services` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:51.716885 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4a572-f2c1-4e0d-a63f-7da4e81de694 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:26:51.717196 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4a572-f2c1-4e0d-a63f-7da4e81de694 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:51.718555 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4a572-f2c1-4e0d-a63f-7da4e81de694 None admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:51.723562 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 658/1305] 10.222.0.32 () {56 vars in 1116 bytes} [Thu Jun 2 13:26:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:26:51.729843 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f6c20-0bd3-4d4f-b392-b9a6d357672a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:26:51.825786 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f6c20-0bd3-4d4f-b392-b9a6d357672a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:26:51.859041 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3465dc8-c76e-4d91-98cf-a88241f1a470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:26:51.859618 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3465dc8-c76e-4d91-98cf-a88241f1a470 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:26:51.859904 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3465dc8-c76e-4d91-98cf-a88241f1a470 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:26:51.860185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3465dc8-c76e-4d91-98cf-a88241f1a470 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:26:51.860959 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3465dc8-c76e-4d91-98cf-a88241f1a470 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:26:51.862323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3465dc8-c76e-4d91-98cf-a88241f1a470 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:26:51.880699 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 648/1306] 10.222.0.32 () {60 vars in 1144 bytes} [Thu Jun 2 13:26:51 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:27:01.720617 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=30 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:01.875779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:55.256404 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac58b5-4516-48cf-9f7a-039df6fcbca4 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:55.256973 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac58b5-4516-48cf-9f7a-039df6fcbca4 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:55.256973 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac58b5-4516-48cf-9f7a-039df6fcbca4 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:55.262227 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 659/1307] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:27:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:55.263598 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0da4e7-cac7-44ce-9e42-3cfdf8a06f0d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:55.264087 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0da4e7-cac7-44ce-9e42-3cfdf8a06f0d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:55.264177 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0da4e7-cac7-44ce-9e42-3cfdf8a06f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:55.343532 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-df0da4e7-cac7-44ce-9e42-3cfdf8a06f0d None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:55.345030 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-df0da4e7-cac7-44ce-9e42-3cfdf8a06f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:55.455382 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 649/1308] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:27:55.506825 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b587cb7-87f3-4c85-ab8a-213fbd03301e None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:55.507106 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b587cb7-87f3-4c85-ab8a-213fbd03301e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:55.507469 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b587cb7-87f3-4c85-ab8a-213fbd03301e None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:55.509044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 660/1309] 10.222.0.32 () {54 vars in 964 bytes} [Thu Jun 2 13:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:55.515101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c584d-7869-46cb-b8f9-7de81e0e026d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:55.515354 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c584d-7869-46cb-b8f9-7de81e0e026d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:55.515641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c584d-7869-46cb-b8f9-7de81e0e026d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:55.619556 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b87c584d-7869-46cb-b8f9-7de81e0e026d None None] MFA Rules not processed for user `9eb2722c122f4aeba23ec16b5a3c485f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:55.620831 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b87c584d-7869-46cb-b8f9-7de81e0e026d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:55.658588 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:55.778493 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 650/1310] 10.222.0.32 () {58 vars in 1061 bytes} [Thu Jun 2 13:27:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:27:55.787690 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b587cb7-87f3-4c85-ab8a-213fbd03301e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:55.789715 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4b587cb7-87f3-4c85-ab8a-213fbd03301e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:55.940057 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b587cb7-87f3-4c85-ab8a-213fbd03301e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:56.031634 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c7671-a5ae-4d17-bba5-60b78422ffaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:56.032623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c7671-a5ae-4d17-bba5-60b78422ffaa service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:56.033069 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c7671-a5ae-4d17-bba5-60b78422ffaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:56.033502 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c7671-a5ae-4d17-bba5-60b78422ffaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:56.036088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-929c7671-a5ae-4d17-bba5-60b78422ffaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:56.093460 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:56.152145 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c7671-a5ae-4d17-bba5-60b78422ffaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:56.153651 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c7671-a5ae-4d17-bba5-60b78422ffaa service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:56.175999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 661/1311] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:27:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:27:58.753119 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8def15-704f-4df4-96cb-a4caeb67bbe1 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:58.754307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8def15-704f-4df4-96cb-a4caeb67bbe1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:58.754307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8def15-704f-4df4-96cb-a4caeb67bbe1 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:58.755764 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 651/1312] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:27:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:27:58.761723 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3f986-f85b-4936-bc62-a7aab58dada3 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:58.762138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3f986-f85b-4936-bc62-a7aab58dada3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:58.762395 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3f986-f85b-4936-bc62-a7aab58dada3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:58.866345 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-83d3f986-f85b-4936-bc62-a7aab58dada3 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:27:58.868032 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-83d3f986-f85b-4936-bc62-a7aab58dada3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:58.998029 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 662/1313] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:27:59.036081 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8def15-704f-4df4-96cb-a4caeb67bbe1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:27:59.037774 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-da8def15-704f-4df4-96cb-a4caeb67bbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:59.147096 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8def15-704f-4df4-96cb-a4caeb67bbe1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:27:59.227140 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:27:59.229808 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54222a-cad4-40c0-b480-c9fac4304c06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:27:59.230645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54222a-cad4-40c0-b480-c9fac4304c06 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:27:59.231095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54222a-cad4-40c0-b480-c9fac4304c06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:27:59.231557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54222a-cad4-40c0-b480-c9fac4304c06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:27:59.233228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-be54222a-cad4-40c0-b480-c9fac4304c06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:27:59.341631 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54222a-cad4-40c0-b480-c9fac4304c06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:27:59.343080 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54222a-cad4-40c0-b480-c9fac4304c06 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:27:59.361266 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 652/1314] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:27:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:28:01.924228 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e91ba9-7774-44d4-aa87-93ecca15dff4 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:01.924807 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e91ba9-7774-44d4-aa87-93ecca15dff4 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:01.924807 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e91ba9-7774-44d4-aa87-93ecca15dff4 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:01.926135 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 663/1315] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:01.931269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a1bdd-8c0b-4960-98e7-cc02137348e6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:01.931665 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a1bdd-8c0b-4960-98e7-cc02137348e6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:01.931840 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a1bdd-8c0b-4960-98e7-cc02137348e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:01.996117 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b81a1bdd-8c0b-4960-98e7-cc02137348e6 None None] MFA Rules not processed for user `e5ce74481717495db8afe81424370eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:01.997363 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b81a1bdd-8c0b-4960-98e7-cc02137348e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:02.049067 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:02.093724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 653/1316] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:28:01 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:28:02.133223 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e91ba9-7774-44d4-aa87-93ecca15dff4 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:02.134753 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-76e91ba9-7774-44d4-aa87-93ecca15dff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:02.144457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:02.238074 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e91ba9-7774-44d4-aa87-93ecca15dff4 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:02.309044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ac715-1997-4928-8a4d-49f42aa2319a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:02.309690 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ac715-1997-4928-8a4d-49f42aa2319a service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:02.309980 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ac715-1997-4928-8a4d-49f42aa2319a service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:02.310287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ac715-1997-4928-8a4d-49f42aa2319a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:02.311946 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8b2ac715-1997-4928-8a4d-49f42aa2319a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:02.373266 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:02.420112 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ac715-1997-4928-8a4d-49f42aa2319a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:02.421590 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ac715-1997-4928-8a4d-49f42aa2319a service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:02.439761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 664/1317] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:28:02 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:28:05.233879 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fca93b-a4f5-4fea-855a-15cfa5d30d91 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:05.234412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fca93b-a4f5-4fea-855a-15cfa5d30d91 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:05.234412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fca93b-a4f5-4fea-855a-15cfa5d30d91 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:05.235796 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 654/1318] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:05.240904 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0b383-af8c-4a16-94ed-8800bf8b5afb None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:05.241306 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0b383-af8c-4a16-94ed-8800bf8b5afb None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:05.241454 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0b383-af8c-4a16-94ed-8800bf8b5afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:05.303886 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-bdb0b383-af8c-4a16-94ed-8800bf8b5afb None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:05.305110 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bdb0b383-af8c-4a16-94ed-8800bf8b5afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:05.399359 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 665/1319] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:28:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:28:05.449749 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02332727-51d2-4671-bf6e-aecc8d6e5fbb None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:05.450038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02332727-51d2-4671-bf6e-aecc8d6e5fbb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:05.450317 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02332727-51d2-4671-bf6e-aecc8d6e5fbb None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:05.451678 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 655/1320] 10.222.0.32 () {54 vars in 964 bytes} [Thu Jun 2 13:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:05.457933 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50247318-fb43-461c-82f1-dedd21417cdf None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:05.458221 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50247318-fb43-461c-82f1-dedd21417cdf None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:05.458498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50247318-fb43-461c-82f1-dedd21417cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:05.478605 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:05.531460 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-50247318-fb43-461c-82f1-dedd21417cdf None None] MFA Rules not processed for user `9eb2722c122f4aeba23ec16b5a3c485f`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:05.532728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-50247318-fb43-461c-82f1-dedd21417cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:05.607496 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 666/1321] 10.222.0.32 () {58 vars in 1061 bytes} [Thu Jun 2 13:28:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:28:05.616718 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02332727-51d2-4671-bf6e-aecc8d6e5fbb None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:05.618243 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-02332727-51d2-4671-bf6e-aecc8d6e5fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:05.720580 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02332727-51d2-4671-bf6e-aecc8d6e5fbb None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:05.790993 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e8a68-7d5c-40d2-a5f4-06329b70efc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:05.791625 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e8a68-7d5c-40d2-a5f4-06329b70efc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:05.791905 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e8a68-7d5c-40d2-a5f4-06329b70efc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:05.792176 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e8a68-7d5c-40d2-a5f4-06329b70efc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:05.793819 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-168e8a68-7d5c-40d2-a5f4-06329b70efc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:05.801531 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:05.900524 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e8a68-7d5c-40d2-a5f4-06329b70efc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:05.901912 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e8a68-7d5c-40d2-a5f4-06329b70efc5 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:05.919446 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 656/1322] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:28:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:28:09.265594 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee125cc-a21a-4ca4-82c2-e858bb416f9f None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:09.266139 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee125cc-a21a-4ca4-82c2-e858bb416f9f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:09.266139 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee125cc-a21a-4ca4-82c2-e858bb416f9f None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:09.267440 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 667/1323] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:09.273546 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7825486-018c-4bae-97d8-f0920d8d7f61 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:09.273971 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7825486-018c-4bae-97d8-f0920d8d7f61 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:09.274235 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7825486-018c-4bae-97d8-f0920d8d7f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:09.339255 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d7825486-018c-4bae-97d8-f0920d8d7f61 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:09.340490 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d7825486-018c-4bae-97d8-f0920d8d7f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:09.397712 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:09.435579 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 657/1324] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:28:09.472401 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee125cc-a21a-4ca4-82c2-e858bb416f9f None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:09.473936 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fee125cc-a21a-4ca4-82c2-e858bb416f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:09.578567 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee125cc-a21a-4ca4-82c2-e858bb416f9f None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:09.593099 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:09.657856 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0c2d3-664d-4818-95f7-2996c4e46ac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:09.658531 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0c2d3-664d-4818-95f7-2996c4e46ac6 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:09.658816 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0c2d3-664d-4818-95f7-2996c4e46ac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:09.659153 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0c2d3-664d-4818-95f7-2996c4e46ac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:09.660832 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c6c0c2d3-664d-4818-95f7-2996c4e46ac6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:09.771453 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0c2d3-664d-4818-95f7-2996c4e46ac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:09.772948 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0c2d3-664d-4818-95f7-2996c4e46ac6 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:09.791026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 668/1325] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:28:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:28:12.095196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56780b96-2536-4f87-91a9-cecd21d34d36 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:12.095756 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56780b96-2536-4f87-91a9-cecd21d34d36 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:12.095756 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56780b96-2536-4f87-91a9-cecd21d34d36 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:12.097722 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 658/1326] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:28:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:12.102875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fe392-2d9c-4ef9-bb9d-eec3809870a4 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:12.103292 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fe392-2d9c-4ef9-bb9d-eec3809870a4 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:12.103432 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fe392-2d9c-4ef9-bb9d-eec3809870a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:12.152662 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:12.170864 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-565fe392-2d9c-4ef9-bb9d-eec3809870a4 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:12.172075 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-565fe392-2d9c-4ef9-bb9d-eec3809870a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:12.269700 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 669/1327] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:28:12.304353 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56780b96-2536-4f87-91a9-cecd21d34d36 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:12.305881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-56780b96-2536-4f87-91a9-cecd21d34d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:12.407577 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56780b96-2536-4f87-91a9-cecd21d34d36 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:12.480090 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c75e9-73d5-492b-9884-d70ddb5ad0ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:12.480823 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c75e9-73d5-492b-9884-d70ddb5ad0ca service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:12.481107 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c75e9-73d5-492b-9884-d70ddb5ad0ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:12.481380 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c75e9-73d5-492b-9884-d70ddb5ad0ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:12.483003 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-807c75e9-73d5-492b-9884-d70ddb5ad0ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:12.500797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:12.590541 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c75e9-73d5-492b-9884-d70ddb5ad0ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:12.591979 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c75e9-73d5-492b-9884-d70ddb5ad0ca service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:12.610136 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 659/1328] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:28:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:28:14.902857 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf549c-fa44-4972-8eee-86731f57d153 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:14.903425 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf549c-fa44-4972-8eee-86731f57d153 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:14.903425 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf549c-fa44-4972-8eee-86731f57d153 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:14.904953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 670/1329] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:14.910696 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7cb43-37f4-410e-89f3-28c593bea923 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:14.911147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7cb43-37f4-410e-89f3-28c593bea923 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:14.911262 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7cb43-37f4-410e-89f3-28c593bea923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:14.976956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f6c7cb43-37f4-410e-89f3-28c593bea923 None None] MFA Rules not processed for user `e5ce74481717495db8afe81424370eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:14.978420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f6c7cb43-37f4-410e-89f3-28c593bea923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:15.045110 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:15.078930 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 660/1330] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:28:14 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:28:15.117119 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf549c-fa44-4972-8eee-86731f57d153 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:15.118668 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-77bf549c-fa44-4972-8eee-86731f57d153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:15.226498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf549c-fa44-4972-8eee-86731f57d153 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:15.246987 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:15.301099 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbdb5b-aff2-418e-a711-8cfad68068e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:15.301749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbdb5b-aff2-418e-a711-8cfad68068e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:15.302035 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbdb5b-aff2-418e-a711-8cfad68068e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:15.302307 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbdb5b-aff2-418e-a711-8cfad68068e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:15.303945 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-44bbdb5b-aff2-418e-a711-8cfad68068e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:15.411643 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bbdb5b-aff2-418e-a711-8cfad68068e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:15.413112 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bbdb5b-aff2-418e-a711-8cfad68068e6 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:15.431156 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 671/1331] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:28:15 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:28:17.874130 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba33188-e34b-41d7-9722-aaff87a7ce8a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:17.874585 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba33188-e34b-41d7-9722-aaff87a7ce8a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:17.874675 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba33188-e34b-41d7-9722-aaff87a7ce8a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:17.876126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 661/1332] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:17.881596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04e735-fa69-4830-9308-cb8fbdceb2c4 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:17.882051 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04e735-fa69-4830-9308-cb8fbdceb2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:17.882142 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04e735-fa69-4830-9308-cb8fbdceb2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:17.949759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:17.953946 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-cd04e735-fa69-4830-9308-cb8fbdceb2c4 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:17.956415 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-cd04e735-fa69-4830-9308-cb8fbdceb2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:18.055408 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 672/1333] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:28:18.091119 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba33188-e34b-41d7-9722-aaff87a7ce8a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:18.092784 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cba33188-e34b-41d7-9722-aaff87a7ce8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:18.197934 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba33188-e34b-41d7-9722-aaff87a7ce8a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:18.272738 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ec926-f411-4ba4-9348-2b4b4f9c4cd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:18.273393 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ec926-f411-4ba4-9348-2b4b4f9c4cd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:18.273677 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ec926-f411-4ba4-9348-2b4b4f9c4cd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:18.273959 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ec926-f411-4ba4-9348-2b4b4f9c4cd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:18.275606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8c4ec926-f411-4ba4-9348-2b4b4f9c4cd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:18.302262 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:18.385347 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ec926-f411-4ba4-9348-2b4b4f9c4cd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:18.386803 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ec926-f411-4ba4-9348-2b4b4f9c4cd1 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:18.534094 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 662/1334] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:28:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:28:20.827229 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae017c6-d423-4af9-ad6a-317b8b49fc1b None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:20.827782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae017c6-d423-4af9-ad6a-317b8b49fc1b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:20.827782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae017c6-d423-4af9-ad6a-317b8b49fc1b None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:20.829199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 673/1335] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:20.835055 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f78797-660c-4b6b-bdcd-f5d3ebe4bd55 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:20.835487 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f78797-660c-4b6b-bdcd-f5d3ebe4bd55 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:20.835601 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f78797-660c-4b6b-bdcd-f5d3ebe4bd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:20.899534 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-22f78797-660c-4b6b-bdcd-f5d3ebe4bd55 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:20.900781 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-22f78797-660c-4b6b-bdcd-f5d3ebe4bd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:20.975068 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:20.996961 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 663/1336] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:28:21.037123 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae017c6-d423-4af9-ad6a-317b8b49fc1b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:21.038718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3ae017c6-d423-4af9-ad6a-317b8b49fc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:21.141067 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae017c6-d423-4af9-ad6a-317b8b49fc1b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:21.169465 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:21.214977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9604e5-9fe7-4fc1-9915-c7e71c0311c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:21.215562 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9604e5-9fe7-4fc1-9915-c7e71c0311c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:21.215848 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9604e5-9fe7-4fc1-9915-c7e71c0311c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:21.216125 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9604e5-9fe7-4fc1-9915-c7e71c0311c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:21.217802 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bf9604e5-9fe7-4fc1-9915-c7e71c0311c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:21.324048 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9604e5-9fe7-4fc1-9915-c7e71c0311c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:21.325523 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9604e5-9fe7-4fc1-9915-c7e71c0311c7 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:21.343943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 674/1337] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:28:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:28:23.979904 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88fe61-ab4c-4ed6-878a-f122fed87ac1 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:23.980462 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88fe61-ab4c-4ed6-878a-f122fed87ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:23.980462 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88fe61-ab4c-4ed6-878a-f122fed87ac1 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:23.981780 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 664/1338] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:23.986997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92436350-b420-4b8a-ab61-0559b40f7423 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:23.987404 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92436350-b420-4b8a-ab61-0559b40f7423 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:23.987567 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92436350-b420-4b8a-ab61-0559b40f7423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:24.053247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-92436350-b420-4b8a-ab61-0559b40f7423 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:24.054469 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-92436350-b420-4b8a-ab61-0559b40f7423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:24.062626 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:24.151880 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 675/1339] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:28:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:28:24.186937 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88fe61-ab4c-4ed6-878a-f122fed87ac1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:24.188524 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5c88fe61-ab4c-4ed6-878a-f122fed87ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:24.291277 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88fe61-ab4c-4ed6-878a-f122fed87ac1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:24.363257 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92646bd-19eb-4ffb-be6d-f3c5d17b908a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:24.363900 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92646bd-19eb-4ffb-be6d-f3c5d17b908a service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:24.364185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92646bd-19eb-4ffb-be6d-f3c5d17b908a service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:24.364503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92646bd-19eb-4ffb-be6d-f3c5d17b908a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:24.366138 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b92646bd-19eb-4ffb-be6d-f3c5d17b908a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:24.399740 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:24.474633 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92646bd-19eb-4ffb-be6d-f3c5d17b908a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:24.476067 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92646bd-19eb-4ffb-be6d-f3c5d17b908a service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:24.494058 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 665/1340] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:28:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:28:28.645129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a5702-b741-452f-8462-ddb38b0633e8 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:28.645629 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a5702-b741-452f-8462-ddb38b0633e8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:28.645629 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a5702-b741-452f-8462-ddb38b0633e8 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:28.646989 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 676/1341] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:28:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:28.652433 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934d534-50a8-4a78-9a94-3aa881090c50 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:28.652854 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934d534-50a8-4a78-9a94-3aa881090c50 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:28.652994 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934d534-50a8-4a78-9a94-3aa881090c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:28.721720 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1934d534-50a8-4a78-9a94-3aa881090c50 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:28.722941 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1934d534-50a8-4a78-9a94-3aa881090c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:28.814126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:28.828204 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 666/1342] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:28:28.868205 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a5702-b741-452f-8462-ddb38b0633e8 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:28.870557 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9d5a5702-b741-452f-8462-ddb38b0633e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:28.968096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a5702-b741-452f-8462-ddb38b0633e8 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:28.971608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f03cf-3aba-44c6-a811-4470c7b5ea09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:28.972267 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f03cf-3aba-44c6-a811-4470c7b5ea09 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:28.972582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f03cf-3aba-44c6-a811-4470c7b5ea09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:28.972863 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f03cf-3aba-44c6-a811-4470c7b5ea09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:28.982053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f03cf-3aba-44c6-a811-4470c7b5ea09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:28.983507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f03cf-3aba-44c6-a811-4470c7b5ea09 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:28.993450 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 677/1343] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:28:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:28:31.821341 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349da7f-9216-419e-b7e4-629e033feb0c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:31.822160 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349da7f-9216-419e-b7e4-629e033feb0c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:31.822160 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349da7f-9216-419e-b7e4-629e033feb0c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:31.823256 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 667/1344] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:31.828978 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e3a86-3256-435b-9853-8c41d08a22e4 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:31.829494 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e3a86-3256-435b-9853-8c41d08a22e4 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:31.829590 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e3a86-3256-435b-9853-8c41d08a22e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:31.860253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-1d1e3a86-3256-435b-9853-8c41d08a22e4 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:31.861484 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1d1e3a86-3256-435b-9853-8c41d08a22e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:31.889333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:31.938253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 678/1345] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:28:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:28:31.975831 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349da7f-9216-419e-b7e4-629e033feb0c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:31.986364 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349da7f-9216-419e-b7e4-629e033feb0c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:31.989856 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb2cb4-da15-4e90-99e0-9c9c43ad2607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:31.990486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb2cb4-da15-4e90-99e0-9c9c43ad2607 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:31.990768 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb2cb4-da15-4e90-99e0-9c9c43ad2607 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:31.991045 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb2cb4-da15-4e90-99e0-9c9c43ad2607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:31.999952 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb2cb4-da15-4e90-99e0-9c9c43ad2607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:32.001416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb2cb4-da15-4e90-99e0-9c9c43ad2607 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:32.016597 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 668/1346] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:28:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:28:36.223140 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a4248-f8f8-4364-a671-cdbbb5ac7f52 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:36.223140 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a4248-f8f8-4364-a671-cdbbb5ac7f52 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:36.223732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a4248-f8f8-4364-a671-cdbbb5ac7f52 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:36.224726 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 679/1347] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:36.230138 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfcd0c-1cf9-4446-95e8-950c413ba252 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:36.230568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfcd0c-1cf9-4446-95e8-950c413ba252 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:36.230705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfcd0c-1cf9-4446-95e8-950c413ba252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:36.248455 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-28dfcd0c-1cf9-4446-95e8-950c413ba252 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:36.249665 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-28dfcd0c-1cf9-4446-95e8-950c413ba252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:36.258091 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 669/1348] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:28:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:28:36.295797 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a4248-f8f8-4364-a671-cdbbb5ac7f52 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:36.306622 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a4248-f8f8-4364-a671-cdbbb5ac7f52 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:36.310462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319e3da-85d8-4c7f-9863-67ca007887f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:36.311108 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319e3da-85d8-4c7f-9863-67ca007887f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:36.311396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319e3da-85d8-4c7f-9863-67ca007887f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:36.311676 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319e3da-85d8-4c7f-9863-67ca007887f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:36.321665 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319e3da-85d8-4c7f-9863-67ca007887f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:36.323100 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319e3da-85d8-4c7f-9863-67ca007887f6 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:36.333013 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 680/1349] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:28:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:28:41.730518 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254e0f4-354e-4159-90fe-07b7c4fb0d7c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:41.731031 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254e0f4-354e-4159-90fe-07b7c4fb0d7c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:41.731121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254e0f4-354e-4159-90fe-07b7c4fb0d7c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:41.732620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 670/1350] 10.222.0.32 () {54 vars in 921 bytes} [Thu Jun 2 13:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:41.738048 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ad09e-d2f5-4352-b529-5ca9d4b96a45 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:41.738510 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ad09e-d2f5-4352-b529-5ca9d4b96a45 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:41.738934 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ad09e-d2f5-4352-b529-5ca9d4b96a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:41.898226 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c74ad09e-d2f5-4352-b529-5ca9d4b96a45 None None] MFA Rules not processed for user `24410ef5e78042c79c5b4a0d78b56258`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:41.899931 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c74ad09e-d2f5-4352-b529-5ca9d4b96a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:42.160720 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 681/1351] 10.222.0.32 () {58 vars in 1018 bytes} [Thu Jun 2 13:28:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 02 13:28:46.243267 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=13 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:46.289298 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cab58-2445-4174-8097-b914cf5b3b80 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:46.289738 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cab58-2445-4174-8097-b914cf5b3b80 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:46.290484 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cab58-2445-4174-8097-b914cf5b3b80 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:46.292809 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 671/1352] 10.222.0.32 () {54 vars in 921 bytes} [Thu Jun 2 13:28:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:46.298452 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59ac76-0741-4c90-a694-126b99b30831 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:46.299454 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59ac76-0741-4c90-a694-126b99b30831 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:46.299933 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59ac76-0741-4c90-a694-126b99b30831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:46.319085 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-dd59ac76-0741-4c90-a694-126b99b30831 None None] MFA Rules not processed for user `24410ef5e78042c79c5b4a0d78b56258`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:46.320496 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-dd59ac76-0741-4c90-a694-126b99b30831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:46.334261 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 682/1353] 10.222.0.32 () {58 vars in 1018 bytes} [Thu Jun 2 13:28:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:28:47.875881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975cfe4-c951-4ac2-a536-990cde41bf4f None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:47.876436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975cfe4-c951-4ac2-a536-990cde41bf4f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:47.876436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975cfe4-c951-4ac2-a536-990cde41bf4f None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:47.878372 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 672/1354] 10.222.0.32 () {54 vars in 921 bytes} [Thu Jun 2 13:28:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:47.884206 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a903762-3cc1-47d7-8517-0e413bd3361e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:47.884805 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a903762-3cc1-47d7-8517-0e413bd3361e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:47.884805 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a903762-3cc1-47d7-8517-0e413bd3361e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:47.903536 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3a903762-3cc1-47d7-8517-0e413bd3361e None None] MFA Rules not processed for user `24410ef5e78042c79c5b4a0d78b56258`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:47.904816 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3a903762-3cc1-47d7-8517-0e413bd3361e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:47.913470 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 683/1355] 10.222.0.32 () {58 vars in 1018 bytes} [Thu Jun 2 13:28:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:28:51.696215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ba903-c9a8-4a06-a9d0-aec8616704d6 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:51.696783 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ba903-c9a8-4a06-a9d0-aec8616704d6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:51.696783 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ba903-c9a8-4a06-a9d0-aec8616704d6 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:51.698052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 673/1356] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:51.703151 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc1efc-4985-4c39-bef6-522ba4d91b31 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:51.703544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc1efc-4985-4c39-bef6-522ba4d91b31 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:51.703698 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc1efc-4985-4c39-bef6-522ba4d91b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:51.722733 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c8cc1efc-4985-4c39-bef6-522ba4d91b31 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:51.723906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c8cc1efc-4985-4c39-bef6-522ba4d91b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:51.731804 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 684/1357] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:28:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:28:51.786132 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443a9ed-2de1-448d-9387-3cc9aa3dcec6 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:51.786701 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443a9ed-2de1-448d-9387-3cc9aa3dcec6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:51.786984 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443a9ed-2de1-448d-9387-3cc9aa3dcec6 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:51.788377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 674/1358] 10.222.0.32 () {54 vars in 961 bytes} [Thu Jun 2 13:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:51.796468 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222dc5a-b279-41e9-914d-770fd9e29c0a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:51.796766 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222dc5a-b279-41e9-914d-770fd9e29c0a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:51.797048 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222dc5a-b279-41e9-914d-770fd9e29c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:51.852983 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:51.862069 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6222dc5a-b279-41e9-914d-770fd9e29c0a None None] MFA Rules not processed for user `b2e5d9f3c4e04ca3bf52b28b67d2a4d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:51.863305 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6222dc5a-b279-41e9-914d-770fd9e29c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:51.950541 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 685/1359] 10.222.0.32 () {58 vars in 1058 bytes} [Thu Jun 2 13:28:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:28:51.958997 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443a9ed-2de1-448d-9387-3cc9aa3dcec6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:51.979613 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443a9ed-2de1-448d-9387-3cc9aa3dcec6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:51.985849 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa396cec-fa82-4eff-b56b-f4658d4cfd9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:51.986858 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa396cec-fa82-4eff-b56b-f4658d4cfd9d service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:51.987366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa396cec-fa82-4eff-b56b-f4658d4cfd9d service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:51.987859 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa396cec-fa82-4eff-b56b-f4658d4cfd9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:52.000005 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa396cec-fa82-4eff-b56b-f4658d4cfd9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:52.002933 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa396cec-fa82-4eff-b56b-f4658d4cfd9d service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:52.016392 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 675/1360] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:28:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:28:54.483891 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b520a-d9c2-42ab-ac10-968e1b560f4a None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:54.484496 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b520a-d9c2-42ab-ac10-968e1b560f4a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:54.484496 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b520a-d9c2-42ab-ac10-968e1b560f4a None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:54.485974 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 686/1361] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:54.490997 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02b340-4d8f-48aa-bbb2-80638fc3eed9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:54.491403 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02b340-4d8f-48aa-bbb2-80638fc3eed9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:54.491544 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02b340-4d8f-48aa-bbb2-80638fc3eed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:54.509461 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4c02b340-4d8f-48aa-bbb2-80638fc3eed9 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:54.510654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4c02b340-4d8f-48aa-bbb2-80638fc3eed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:54.519126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 676/1362] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:28:54.562715 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b520a-d9c2-42ab-ac10-968e1b560f4a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:54.581572 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b520a-d9c2-42ab-ac10-968e1b560f4a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:54.590430 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca30b89-1d1f-44a6-8950-a9d06c318d37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:54.591183 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca30b89-1d1f-44a6-8950-a9d06c318d37 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:54.591568 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca30b89-1d1f-44a6-8950-a9d06c318d37 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:54.591911 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca30b89-1d1f-44a6-8950-a9d06c318d37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:54.601400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca30b89-1d1f-44a6-8950-a9d06c318d37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:54.603069 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca30b89-1d1f-44a6-8950-a9d06c318d37 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:54.612989 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 687/1363] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:28:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:28:57.191211 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf250ea3-247f-4431-b89c-4e6d231be935 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:57.193415 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf250ea3-247f-4431-b89c-4e6d231be935 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:57.194881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf250ea3-247f-4431-b89c-4e6d231be935 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:57.196421 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 677/1364] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:28:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:57.202395 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7453f-2ae7-493e-8855-5574b960ce0a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:57.202897 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7453f-2ae7-493e-8855-5574b960ce0a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:57.203013 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7453f-2ae7-493e-8855-5574b960ce0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:57.227198 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-25a7453f-2ae7-493e-8855-5574b960ce0a None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:57.228366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-25a7453f-2ae7-493e-8855-5574b960ce0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:57.237795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 688/1365] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:28:57.281985 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e840101-b7d8-426f-8aa6-9e72f1089c61 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:57.282276 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e840101-b7d8-426f-8aa6-9e72f1089c61 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:57.282555 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e840101-b7d8-426f-8aa6-9e72f1089c61 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:57.284496 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 678/1366] 10.222.0.32 () {54 vars in 961 bytes} [Thu Jun 2 13:28:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:57.289850 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdaac06-3b91-4417-ad88-6f17985bfb77 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:57.290143 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdaac06-3b91-4417-ad88-6f17985bfb77 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:57.290420 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdaac06-3b91-4417-ad88-6f17985bfb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:57.309176 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-8bdaac06-3b91-4417-ad88-6f17985bfb77 None None] MFA Rules not processed for user `b2e5d9f3c4e04ca3bf52b28b67d2a4d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:57.310431 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8bdaac06-3b91-4417-ad88-6f17985bfb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:57.320170 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 689/1367] 10.222.0.32 () {58 vars in 1058 bytes} [Thu Jun 2 13:28:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:28:57.327585 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e840101-b7d8-426f-8aa6-9e72f1089c61 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:57.342254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e840101-b7d8-426f-8aa6-9e72f1089c61 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:57.348185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2860483-3c41-4292-990a-c77cd6b69616 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:57.348862 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2860483-3c41-4292-990a-c77cd6b69616 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:57.349149 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2860483-3c41-4292-990a-c77cd6b69616 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:57.349427 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2860483-3c41-4292-990a-c77cd6b69616 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:57.357940 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2860483-3c41-4292-990a-c77cd6b69616 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:57.359554 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2860483-3c41-4292-990a-c77cd6b69616 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:57.369954 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 679/1368] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:28:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:28:59.701238 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c95708-ce2f-40cd-8c7c-2ee43a4784f3 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:59.701766 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c95708-ce2f-40cd-8c7c-2ee43a4784f3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:59.701849 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c95708-ce2f-40cd-8c7c-2ee43a4784f3 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:59.703151 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 690/1369] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:28:59.709151 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004df888-79db-41a8-97da-3d8190dba67d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:59.709579 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004df888-79db-41a8-97da-3d8190dba67d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:59.709716 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004df888-79db-41a8-97da-3d8190dba67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:59.728045 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-004df888-79db-41a8-97da-3d8190dba67d None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:28:59.729521 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-004df888-79db-41a8-97da-3d8190dba67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:28:59.740552 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 680/1370] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:28:59.782125 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c95708-ce2f-40cd-8c7c-2ee43a4784f3 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:28:59.796330 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c95708-ce2f-40cd-8c7c-2ee43a4784f3 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:28:59.802475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6625b-dab0-42de-8dc4-f4aab5853d38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:28:59.803233 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6625b-dab0-42de-8dc4-f4aab5853d38 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:59.803635 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6625b-dab0-42de-8dc4-f4aab5853d38 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:59.804009 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6625b-dab0-42de-8dc4-f4aab5853d38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:59.812739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b6625b-dab0-42de-8dc4-f4aab5853d38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:28:59.815035 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b6625b-dab0-42de-8dc4-f4aab5853d38 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:28:59.826987 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 691/1371] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:28:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:28:59.971669 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafa16d-c816-4a94-b4b1-dc31e5d2fa0b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:59.971964 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafa16d-c816-4a94-b4b1-dc31e5d2fa0b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:59.972568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafa16d-c816-4a94-b4b1-dc31e5d2fa0b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:28:59.974242 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 681/1372] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:28:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:28:59.980410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f2f05-e077-4cac-91d6-c2db6eac4ce8 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:28:59.980781 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f2f05-e077-4cac-91d6-c2db6eac4ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:28:59.981136 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f2f05-e077-4cac-91d6-c2db6eac4ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:00.001021 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6e3f2f05-e077-4cac-91d6-c2db6eac4ce8 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:00.003372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6e3f2f05-e077-4cac-91d6-c2db6eac4ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:00.020354 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 692/1373] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:00.328264 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bf8fe-4344-42ab-80d7-0b61c293ffb1 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:00.328264 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bf8fe-4344-42ab-80d7-0b61c293ffb1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:00.328264 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bf8fe-4344-42ab-80d7-0b61c293ffb1 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:00.330932 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 682/1374] 10.222.0.32 () {54 vars in 963 bytes} [Thu Jun 2 13:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:29:00.334855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb5015-fcfe-44cc-b9fd-717ff233ecb0 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:00.335147 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb5015-fcfe-44cc-b9fd-717ff233ecb0 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:00.335425 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb5015-fcfe-44cc-b9fd-717ff233ecb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:00.386251 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-8fcb5015-fcfe-44cc-b9fd-717ff233ecb0 None None] MFA Rules not processed for user `09a1e517aa87428ebdb1e54671a8d93d`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:00.387440 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8fcb5015-fcfe-44cc-b9fd-717ff233ecb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:00.450318 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 693/1375] 10.222.0.32 () {58 vars in 1060 bytes} [Thu Jun 2 13:29:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:00.458552 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bf8fe-4344-42ab-80d7-0b61c293ffb1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:00.471220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bf8fe-4344-42ab-80d7-0b61c293ffb1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:00.475078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b781d-8cf8-480b-b615-5a29ea1cb0f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:00.475841 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b781d-8cf8-480b-b615-5a29ea1cb0f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:00.476190 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b781d-8cf8-480b-b615-5a29ea1cb0f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:00.476560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b781d-8cf8-480b-b615-5a29ea1cb0f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:00.486258 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b781d-8cf8-480b-b615-5a29ea1cb0f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:00.487799 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b781d-8cf8-480b-b615-5a29ea1cb0f6 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:00.498269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 683/1376] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:02.168522 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0415c96-ad83-4dd2-8570-6875bc6e54c6 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:02.169078 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0415c96-ad83-4dd2-8570-6875bc6e54c6 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:02.169078 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0415c96-ad83-4dd2-8570-6875bc6e54c6 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:02.170500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 694/1377] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:29:02.176570 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba9576-9f60-431e-aa11-2dc14ce1429c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:02.177172 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba9576-9f60-431e-aa11-2dc14ce1429c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:02.177172 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba9576-9f60-431e-aa11-2dc14ce1429c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:02.196534 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c9ba9576-9f60-431e-aa11-2dc14ce1429c None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:02.197848 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c9ba9576-9f60-431e-aa11-2dc14ce1429c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:02.206490 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 684/1378] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:29:02.252354 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0415c96-ad83-4dd2-8570-6875bc6e54c6 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:02.267643 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0415c96-ad83-4dd2-8570-6875bc6e54c6 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:02.273221 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3780aaf-eaea-437e-b9c0-8b201cb8a8b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:02.273886 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3780aaf-eaea-437e-b9c0-8b201cb8a8b0 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:02.274174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3780aaf-eaea-437e-b9c0-8b201cb8a8b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:02.274458 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3780aaf-eaea-437e-b9c0-8b201cb8a8b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:02.284243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3780aaf-eaea-437e-b9c0-8b201cb8a8b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:02.285906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3780aaf-eaea-437e-b9c0-8b201cb8a8b0 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:02.290385 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:02.298096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 695/1379] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:04.598089 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b64da6-d6d4-479b-8483-ca79c6f89167 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:04.598629 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b64da6-d6d4-479b-8483-ca79c6f89167 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:04.598629 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b64da6-d6d4-479b-8483-ca79c6f89167 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:04.600114 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 685/1380] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:29:04.605407 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff258710-fca4-4d43-8ded-034cd01f63c2 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:04.605810 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff258710-fca4-4d43-8ded-034cd01f63c2 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:04.605994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff258710-fca4-4d43-8ded-034cd01f63c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:04.624475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ff258710-fca4-4d43-8ded-034cd01f63c2 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:04.625659 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ff258710-fca4-4d43-8ded-034cd01f63c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:04.634206 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 696/1381] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:04.677802 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b64da6-d6d4-479b-8483-ca79c6f89167 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:04.692873 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b64da6-d6d4-479b-8483-ca79c6f89167 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:04.698347 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a2b3a-fb00-4e33-b322-39523aac2af9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:04.699093 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a2b3a-fb00-4e33-b322-39523aac2af9 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:04.699519 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a2b3a-fb00-4e33-b322-39523aac2af9 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:04.699900 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a2b3a-fb00-4e33-b322-39523aac2af9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:04.708986 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a2b3a-fb00-4e33-b322-39523aac2af9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:04.710939 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a2b3a-fb00-4e33-b322-39523aac2af9 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:04.721166 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 686/1382] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:07.018193 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb154f02-6671-4808-b754-5da92574ec7c None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:07.018650 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb154f02-6671-4808-b754-5da92574ec7c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:07.018759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb154f02-6671-4808-b754-5da92574ec7c None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:07.020097 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 697/1383] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:29:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:29:07.025509 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503f4f0-79dc-4a3c-abb3-45598d719cd2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:07.025972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503f4f0-79dc-4a3c-abb3-45598d719cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:07.026242 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503f4f0-79dc-4a3c-abb3-45598d719cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:07.044057 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8503f4f0-79dc-4a3c-abb3-45598d719cd2 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:07.045402 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8503f4f0-79dc-4a3c-abb3-45598d719cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:07.053252 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 687/1384] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:07.096689 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb154f02-6671-4808-b754-5da92574ec7c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:07.111544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb154f02-6671-4808-b754-5da92574ec7c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:07.117024 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b50839-5528-4dd2-aaeb-5f73a93161a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:07.117785 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b50839-5528-4dd2-aaeb-5f73a93161a4 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:07.118201 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b50839-5528-4dd2-aaeb-5f73a93161a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:07.118643 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b50839-5528-4dd2-aaeb-5f73a93161a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:07.127747 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b50839-5528-4dd2-aaeb-5f73a93161a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:07.129474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b50839-5528-4dd2-aaeb-5f73a93161a4 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:07.139586 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 698/1385] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:09.614565 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960a305-6426-43df-8a65-4f1cd79fdc7e None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:09.615051 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960a305-6426-43df-8a65-4f1cd79fdc7e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:09.615161 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960a305-6426-43df-8a65-4f1cd79fdc7e None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:09.616680 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 688/1386] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:29:09.622075 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b99536-37e8-4382-a6b6-e1ba3505c38d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:09.622724 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b99536-37e8-4382-a6b6-e1ba3505c38d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:09.622724 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b99536-37e8-4382-a6b6-e1ba3505c38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:09.640877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-71b99536-37e8-4382-a6b6-e1ba3505c38d None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:09.642599 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-71b99536-37e8-4382-a6b6-e1ba3505c38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:09.650667 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 699/1387] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:29:09.694662 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960a305-6426-43df-8a65-4f1cd79fdc7e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:09.710094 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960a305-6426-43df-8a65-4f1cd79fdc7e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:09.715884 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06523631-e2b4-4fe9-8073-47676c2e6ddb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:09.716549 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06523631-e2b4-4fe9-8073-47676c2e6ddb service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:09.716837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06523631-e2b4-4fe9-8073-47676c2e6ddb service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:09.717111 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06523631-e2b4-4fe9-8073-47676c2e6ddb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:09.726249 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06523631-e2b4-4fe9-8073-47676c2e6ddb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:09.727838 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06523631-e2b4-4fe9-8073-47676c2e6ddb service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:09.737650 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 689/1388] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:12.042617 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b886ff-e5f1-4562-8be6-5992a25ad4eb None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:12.043171 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b886ff-e5f1-4562-8be6-5992a25ad4eb None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:12.043171 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b886ff-e5f1-4562-8be6-5992a25ad4eb None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:12.044588 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 700/1389] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:29:12.050909 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeee6b7-0ab9-455a-a6dc-09c827d404f2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:12.051437 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeee6b7-0ab9-455a-a6dc-09c827d404f2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:12.051815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeee6b7-0ab9-455a-a6dc-09c827d404f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:12.078438 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-feeee6b7-0ab9-455a-a6dc-09c827d404f2 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:12.081122 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-feeee6b7-0ab9-455a-a6dc-09c827d404f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:12.093798 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 690/1390] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:12.139934 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b886ff-e5f1-4562-8be6-5992a25ad4eb None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:12.155097 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b886ff-e5f1-4562-8be6-5992a25ad4eb None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:12.160558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0ec26-2ba9-4bf6-bda8-34f516cd0603 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:12.162417 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0ec26-2ba9-4bf6-bda8-34f516cd0603 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:12.162704 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0ec26-2ba9-4bf6-bda8-34f516cd0603 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:12.163157 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0ec26-2ba9-4bf6-bda8-34f516cd0603 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:12.173378 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0ec26-2ba9-4bf6-bda8-34f516cd0603 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:12.175014 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0ec26-2ba9-4bf6-bda8-34f516cd0603 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:12.185249 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 701/1391] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:14.463467 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebd0ca-a4a2-4b82-b000-69f7e1c362f4 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:14.464075 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebd0ca-a4a2-4b82-b000-69f7e1c362f4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:14.464075 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebd0ca-a4a2-4b82-b000-69f7e1c362f4 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:14.465425 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 691/1392] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:29:14.470596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc643d-ba9c-4c3b-8fb7-fe1a8c147d75 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:14.471075 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc643d-ba9c-4c3b-8fb7-fe1a8c147d75 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:14.471179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc643d-ba9c-4c3b-8fb7-fe1a8c147d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:14.488828 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e8cc643d-ba9c-4c3b-8fb7-fe1a8c147d75 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:14.490025 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e8cc643d-ba9c-4c3b-8fb7-fe1a8c147d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:14.497886 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 702/1393] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:14.541933 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ebd0ca-a4a2-4b82-b000-69f7e1c362f4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:14.556411 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ebd0ca-a4a2-4b82-b000-69f7e1c362f4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:14.561925 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238baae4-c3b9-480f-acc4-353e0f6ef60d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:14.562559 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238baae4-c3b9-480f-acc4-353e0f6ef60d service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:14.562849 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238baae4-c3b9-480f-acc4-353e0f6ef60d service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:14.563651 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238baae4-c3b9-480f-acc4-353e0f6ef60d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:14.572082 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238baae4-c3b9-480f-acc4-353e0f6ef60d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:14.573720 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238baae4-c3b9-480f-acc4-353e0f6ef60d service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:14.583994 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 692/1394] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:16.256490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf426f9c-7a0e-4265-a36f-61eeee5ba297 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:16.257102 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf426f9c-7a0e-4265-a36f-61eeee5ba297 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:16.257102 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf426f9c-7a0e-4265-a36f-61eeee5ba297 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:16.258416 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 703/1395] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:29:16.263857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feba129-d52c-46cf-b03d-6319f791ec36 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:16.264333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feba129-d52c-46cf-b03d-6319f791ec36 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:16.264486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feba129-d52c-46cf-b03d-6319f791ec36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:16.270649 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=52 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:16.284197 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6feba129-d52c-46cf-b03d-6319f791ec36 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:16.285415 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6feba129-d52c-46cf-b03d-6319f791ec36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:16.293151 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 693/1396] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:16.349222 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56d4e2-6fc6-4d02-822e-d21e56c7239f None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:16.349586 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56d4e2-6fc6-4d02-822e-d21e56c7239f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:16.349928 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56d4e2-6fc6-4d02-822e-d21e56c7239f None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:16.351384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 704/1397] 10.222.0.32 () {54 vars in 962 bytes} [Thu Jun 2 13:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:29:16.356442 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd4f18-21fe-4f1f-903d-7f15c1eddfeb None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:16.356901 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd4f18-21fe-4f1f-903d-7f15c1eddfeb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:16.357175 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd4f18-21fe-4f1f-903d-7f15c1eddfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:16.406275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-42fd4f18-21fe-4f1f-903d-7f15c1eddfeb None None] MFA Rules not processed for user `9e239e4e9b99433ca9d1a8db45e24b56`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:16.407673 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-42fd4f18-21fe-4f1f-903d-7f15c1eddfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:16.467731 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 694/1398] 10.222.0.32 () {58 vars in 1059 bytes} [Thu Jun 2 13:29:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:16.475498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56d4e2-6fc6-4d02-822e-d21e56c7239f None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:16.486988 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56d4e2-6fc6-4d02-822e-d21e56c7239f None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:16.490577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb0159-57ce-479b-9045-a67bdf9a71c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e239e4e9b99433ca9d1a8db45e24b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:16.491207 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb0159-57ce-479b-9045-a67bdf9a71c0 service glance] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:16.491495 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb0159-57ce-479b-9045-a67bdf9a71c0 service glance] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:16.491771 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb0159-57ce-479b-9045-a67bdf9a71c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:16.501535 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb0159-57ce-479b-9045-a67bdf9a71c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:16.502962 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb0159-57ce-479b-9045-a67bdf9a71c0 service glance] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:16.512896 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 705/1399] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:29:16.853132 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6f416-dd76-4770-82ce-4f0241967de8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:16.853421 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6f416-dd76-4770-82ce-4f0241967de8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:16.853699 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6f416-dd76-4770-82ce-4f0241967de8 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:16.855096 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 695/1400] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:29:16.860929 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ce8a9-7912-460f-9665-52024f94760a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:16.861266 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ce8a9-7912-460f-9665-52024f94760a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:16.861548 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ce8a9-7912-460f-9665-52024f94760a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:16.879327 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-4a1ce8a9-7912-460f-9665-52024f94760a None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:16.880491 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4a1ce8a9-7912-460f-9665-52024f94760a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:16.888512 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 706/1401] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:16.932728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6f416-dd76-4770-82ce-4f0241967de8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:16.946888 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6f416-dd76-4770-82ce-4f0241967de8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:16.952158 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d726fc-70c9-4ac1-8956-c39b42d5322d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:16.952819 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d726fc-70c9-4ac1-8956-c39b42d5322d service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:16.953103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d726fc-70c9-4ac1-8956-c39b42d5322d service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:16.953376 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d726fc-70c9-4ac1-8956-c39b42d5322d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:16.962820 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d726fc-70c9-4ac1-8956-c39b42d5322d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:16.964562 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d726fc-70c9-4ac1-8956-c39b42d5322d service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:16.974865 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 696/1402] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:17.043245 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104b192-b5c7-4cbf-ac22-1e43b0ead961 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:17.043544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104b192-b5c7-4cbf-ac22-1e43b0ead961 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:17.043827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104b192-b5c7-4cbf-ac22-1e43b0ead961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:17.099604 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-9104b192-b5c7-4cbf-ac22-1e43b0ead961 None None] MFA Rules not processed for user `bbcd5ba866b84d099d183fe19ba61a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:17.100875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9104b192-b5c7-4cbf-ac22-1e43b0ead961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:17.170157 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 707/1403] 10.222.0.32 () {58 vars in 1009 bytes} [Thu Jun 2 13:29:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:17.215899 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae031ea-5160-495a-a008-5c15c069b236 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:17.216292 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae031ea-5160-495a-a008-5c15c069b236 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:17.216663 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae031ea-5160-495a-a008-5c15c069b236 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:17.218181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 697/1404] 10.222.0.32 () {54 vars in 942 bytes} [Thu Jun 2 13:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:29:17.226097 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a7a24-8c7b-481d-b0db-874365a910b9 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:17.226393 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a7a24-8c7b-481d-b0db-874365a910b9 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:17.226678 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a7a24-8c7b-481d-b0db-874365a910b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:17.274279 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-be9a7a24-8c7b-481d-b0db-874365a910b9 None None] MFA Rules not processed for user `3aea97e7b39448a283032f662142b6e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:17.275476 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-be9a7a24-8c7b-481d-b0db-874365a910b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:17.307961 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:17.347433 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 708/1405] 10.222.0.32 () {58 vars in 1039 bytes} [Thu Jun 2 13:29:17 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:17.356774 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae031ea-5160-495a-a008-5c15c069b236 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:17.370788 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae031ea-5160-495a-a008-5c15c069b236 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:17.376248 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922463fa-59f3-46fa-b4c2-091396226390 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aea97e7b39448a283032f662142b6e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:17.376917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922463fa-59f3-46fa-b4c2-091396226390 service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:17.377202 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922463fa-59f3-46fa-b4c2-091396226390 service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:17.377482 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922463fa-59f3-46fa-b4c2-091396226390 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:17.385607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922463fa-59f3-46fa-b4c2-091396226390 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:17.387203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922463fa-59f3-46fa-b4c2-091396226390 service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:17.395867 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 698/1406] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Jun 2 13:29:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:29:19.260843 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af11ee-62be-4cd0-8449-d9991a6c2cb3 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:19.261371 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af11ee-62be-4cd0-8449-d9991a6c2cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:19.261371 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af11ee-62be-4cd0-8449-d9991a6c2cb3 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:19.262810 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 709/1407] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:29:19.268535 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7032490-a720-43af-82a9-4073201ff62a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:19.269063 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7032490-a720-43af-82a9-4073201ff62a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:19.269063 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7032490-a720-43af-82a9-4073201ff62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:19.288114 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d7032490-a720-43af-82a9-4073201ff62a None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:19.289363 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d7032490-a720-43af-82a9-4073201ff62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:19.300364 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 699/1408] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:19.341050 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af11ee-62be-4cd0-8449-d9991a6c2cb3 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:19.356017 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af11ee-62be-4cd0-8449-d9991a6c2cb3 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:19.361513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257b94c-dd35-4a29-8361-1d27da8d0e09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:19.362354 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257b94c-dd35-4a29-8361-1d27da8d0e09 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:19.362637 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257b94c-dd35-4a29-8361-1d27da8d0e09 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:19.362913 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257b94c-dd35-4a29-8361-1d27da8d0e09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:19.373497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257b94c-dd35-4a29-8361-1d27da8d0e09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:19.375082 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257b94c-dd35-4a29-8361-1d27da8d0e09 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:19.384952 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 710/1409] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:29.283138 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=55 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:29.384006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=21 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:41.059711 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73315b-04f9-462c-b510-ce68e9a8be12 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:41.060645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73315b-04f9-462c-b510-ce68e9a8be12 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:41.060938 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73315b-04f9-462c-b510-ce68e9a8be12 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:41.062996 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 700/1410] 10.222.0.32 () {54 vars in 918 bytes} [Thu Jun 2 13:29:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:29:41.068339 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb7ab0-5581-43d7-8990-950b6f243220 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:41.068805 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb7ab0-5581-43d7-8990-950b6f243220 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:41.068919 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb7ab0-5581-43d7-8990-950b6f243220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:41.087805 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-9cbb7ab0-5581-43d7-8990-950b6f243220 None None] MFA Rules not processed for user `24410ef5e78042c79c5b4a0d78b56258`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:41.089037 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9cbb7ab0-5581-43d7-8990-950b6f243220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:41.097384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 711/1411] 10.222.0.32 () {58 vars in 1015 bytes} [Thu Jun 2 13:29:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:41.111670 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd97fe8-4e51-40d8-ab01-561dc2405a5d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:41.111957 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd97fe8-4e51-40d8-ab01-561dc2405a5d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:41.112233 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd97fe8-4e51-40d8-ab01-561dc2405a5d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:41.113591 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 701/1412] 10.222.0.32 () {54 vars in 918 bytes} [Thu Jun 2 13:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:29:41.118113 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0acf6-fcc0-4bcf-a00e-778418346eff None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:41.118399 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0acf6-fcc0-4bcf-a00e-778418346eff None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:41.118674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0acf6-fcc0-4bcf-a00e-778418346eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:41.136844 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-fdd0acf6-fcc0-4bcf-a00e-778418346eff None None] MFA Rules not processed for user `b2e5d9f3c4e04ca3bf52b28b67d2a4d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:41.138003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fdd0acf6-fcc0-4bcf-a00e-778418346eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:41.146789 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 712/1413] 10.222.0.32 () {58 vars in 1015 bytes} [Thu Jun 2 13:29:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:43.816477 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54f80d-5038-4898-b295-1f559b74ff0f None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:43.817043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54f80d-5038-4898-b295-1f559b74ff0f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:43.817043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54f80d-5038-4898-b295-1f559b74ff0f None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:43.818368 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:29:43.824152 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abbbce-eb8a-4e7a-93aa-16e23ea36d48 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:43.824600 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abbbce-eb8a-4e7a-93aa-16e23ea36d48 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:43.824744 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abbbce-eb8a-4e7a-93aa-16e23ea36d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:43.842093 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-66abbbce-eb8a-4e7a-93aa-16e23ea36d48 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:43.843819 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-66abbbce-eb8a-4e7a-93aa-16e23ea36d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:43.851383 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:43.894362 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54f80d-5038-4898-b295-1f559b74ff0f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:43.909970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54f80d-5038-4898-b295-1f559b74ff0f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:43.915264 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf399f6f-5ec2-4160-8f72-b38ffdf31548 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:43.915888 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf399f6f-5ec2-4160-8f72-b38ffdf31548 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:43.916167 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf399f6f-5ec2-4160-8f72-b38ffdf31548 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:43.916471 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf399f6f-5ec2-4160-8f72-b38ffdf31548 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:43.924957 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf399f6f-5ec2-4160-8f72-b38ffdf31548 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:43.926522 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf399f6f-5ec2-4160-8f72-b38ffdf31548 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:43.935594 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 703/1416] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:44.947730 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1bba3-da3a-4d70-b388-78821c97fcd4 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:44.948190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1bba3-da3a-4d70-b388-78821c97fcd4 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:44.948335 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1bba3-da3a-4d70-b388-78821c97fcd4 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:44.949708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:29:44.955048 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1331d-b904-4d09-9994-7eea66a3338b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:44.955476 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1331d-b904-4d09-9994-7eea66a3338b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:44.955610 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1331d-b904-4d09-9994-7eea66a3338b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:44.973650 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-24e1331d-b904-4d09-9994-7eea66a3338b None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:44.974882 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-24e1331d-b904-4d09-9994-7eea66a3338b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:44.983099 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:45.143087 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1bba3-da3a-4d70-b388-78821c97fcd4 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:45.157515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1bba3-da3a-4d70-b388-78821c97fcd4 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:45.162742 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fdda8-27be-4a81-8c10-4104372fab7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:45.163360 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fdda8-27be-4a81-8c10-4104372fab7a service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:45.163641 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fdda8-27be-4a81-8c10-4104372fab7a service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:45.163914 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fdda8-27be-4a81-8c10-4104372fab7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:45.172316 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47fdda8-27be-4a81-8c10-4104372fab7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:45.173886 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47fdda8-27be-4a81-8c10-4104372fab7a service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:45.182902 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 715/1419] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:46.108190 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95624299-10a1-42b4-8b85-e90c5f6b848f None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:46.108745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95624299-10a1-42b4-8b85-e90c5f6b848f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:46.108858 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95624299-10a1-42b4-8b85-e90c5f6b848f None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:46.110168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:29:46.115072 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2672e8-c502-4b95-8668-01185e710370 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:46.115518 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2672e8-c502-4b95-8668-01185e710370 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:46.115617 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2672e8-c502-4b95-8668-01185e710370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:46.134755 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-4d2672e8-c502-4b95-8668-01185e710370 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:46.135948 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4d2672e8-c502-4b95-8668-01185e710370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:46.144322 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:46.291184 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95624299-10a1-42b4-8b85-e90c5f6b848f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:46.305476 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95624299-10a1-42b4-8b85-e90c5f6b848f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:46.310700 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6592b-1aeb-4d97-906b-0670e4784df6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:46.311327 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6592b-1aeb-4d97-906b-0670e4784df6 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:46.312146 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6592b-1aeb-4d97-906b-0670e4784df6 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:46.312453 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6592b-1aeb-4d97-906b-0670e4784df6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:46.320247 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6592b-1aeb-4d97-906b-0670e4784df6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:46.321912 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6592b-1aeb-4d97-906b-0670e4784df6 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:46.331025 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 706/1422] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:47.222286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d16188-65a6-4dce-a877-adafe1d322db None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:47.222826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d16188-65a6-4dce-a877-adafe1d322db None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:47.222826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d16188-65a6-4dce-a877-adafe1d322db None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:47.224195 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:29:47.229103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68421c65-86d0-41c1-a6d4-cfe6b556fc2f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:47.229558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68421c65-86d0-41c1-a6d4-cfe6b556fc2f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:47.229695 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68421c65-86d0-41c1-a6d4-cfe6b556fc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:47.247544 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-68421c65-86d0-41c1-a6d4-cfe6b556fc2f None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:47.248776 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-68421c65-86d0-41c1-a6d4-cfe6b556fc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:47.256592 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:29:47.403333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d16188-65a6-4dce-a877-adafe1d322db None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:47.418043 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d16188-65a6-4dce-a877-adafe1d322db None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:47.423957 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f66126-06a5-4043-bf6c-76f5ae940089 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:47.424608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f66126-06a5-4043-bf6c-76f5ae940089 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:47.424898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f66126-06a5-4043-bf6c-76f5ae940089 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:47.425172 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f66126-06a5-4043-bf6c-76f5ae940089 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:47.433086 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f66126-06a5-4043-bf6c-76f5ae940089 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:47.434656 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f66126-06a5-4043-bf6c-76f5ae940089 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:47.443822 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 718/1425] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:48.339199 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e89d1-c610-49a3-bc3c-8d79d9569b78 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:48.339767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e89d1-c610-49a3-bc3c-8d79d9569b78 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:48.340058 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e89d1-c610-49a3-bc3c-8d79d9569b78 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:48.341479 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:29:48.346387 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50906916-a2ad-4054-95a8-827b8d774bb1 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:48.346882 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50906916-a2ad-4054-95a8-827b8d774bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:48.346989 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50906916-a2ad-4054-95a8-827b8d774bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:48.364537 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-50906916-a2ad-4054-95a8-827b8d774bb1 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:48.365723 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-50906916-a2ad-4054-95a8-827b8d774bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:48.373432 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:48.520101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e89d1-c610-49a3-bc3c-8d79d9569b78 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:48.534236 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e89d1-c610-49a3-bc3c-8d79d9569b78 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:48.539570 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4937d58-e3c2-4135-bb20-4a6c81b2dfe1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:48.540221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4937d58-e3c2-4135-bb20-4a6c81b2dfe1 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:48.540525 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4937d58-e3c2-4135-bb20-4a6c81b2dfe1 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:48.540799 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4937d58-e3c2-4135-bb20-4a6c81b2dfe1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:48.549203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4937d58-e3c2-4135-bb20-4a6c81b2dfe1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:48.550771 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4937d58-e3c2-4135-bb20-4a6c81b2dfe1 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:48.559895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 709/1428] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:49.395557 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f659c-94db-4b07-bb73-3d1742ba8ea6 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:49.396105 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f659c-94db-4b07-bb73-3d1742ba8ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:49.396105 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f659c-94db-4b07-bb73-3d1742ba8ea6 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:49.397583 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:29:49.402513 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b5979-85de-4376-8b01-f434489d6b34 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:49.402935 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b5979-85de-4376-8b01-f434489d6b34 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:49.403078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b5979-85de-4376-8b01-f434489d6b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:49.421667 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6b2b5979-85de-4376-8b01-f434489d6b34 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:49.422871 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6b2b5979-85de-4376-8b01-f434489d6b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:49.431657 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:49.579808 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f659c-94db-4b07-bb73-3d1742ba8ea6 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:49.594127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f659c-94db-4b07-bb73-3d1742ba8ea6 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:49.599422 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67098ade-924a-4e24-a710-42d93ca1db25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:49.600068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67098ade-924a-4e24-a710-42d93ca1db25 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:49.600374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67098ade-924a-4e24-a710-42d93ca1db25 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:49.600652 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67098ade-924a-4e24-a710-42d93ca1db25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:49.608539 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67098ade-924a-4e24-a710-42d93ca1db25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:49.610147 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67098ade-924a-4e24-a710-42d93ca1db25 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:49.619271 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 721/1431] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:50.464193 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65096f73-116a-413f-902a-32c217f88d2b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:50.464795 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65096f73-116a-413f-902a-32c217f88d2b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:50.464795 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65096f73-116a-413f-902a-32c217f88d2b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:50.466178 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:29:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:29:50.471297 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fb571-eef5-40cf-9898-831b4d09ccd8 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:50.471729 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fb571-eef5-40cf-9898-831b4d09ccd8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:50.471845 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fb571-eef5-40cf-9898-831b4d09ccd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:50.489569 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6e4fb571-eef5-40cf-9898-831b4d09ccd8 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:50.490752 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6e4fb571-eef5-40cf-9898-831b4d09ccd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:50.498446 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:29:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:50.644358 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65096f73-116a-413f-902a-32c217f88d2b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:50.659233 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65096f73-116a-413f-902a-32c217f88d2b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:50.664638 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977ae3d-55eb-43c5-9a25-0424a36ea2b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:50.665274 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977ae3d-55eb-43c5-9a25-0424a36ea2b2 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:50.665560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977ae3d-55eb-43c5-9a25-0424a36ea2b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:50.665841 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977ae3d-55eb-43c5-9a25-0424a36ea2b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:50.674648 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977ae3d-55eb-43c5-9a25-0424a36ea2b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:50.676237 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977ae3d-55eb-43c5-9a25-0424a36ea2b2 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:50.685675 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 712/1434] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:51.525690 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9ebf9-a309-40b9-8172-c7eaf3b899f7 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:51.526273 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9ebf9-a309-40b9-8172-c7eaf3b899f7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:51.526273 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9ebf9-a309-40b9-8172-c7eaf3b899f7 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:51.527598 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:29:51.532456 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03002b11-b512-48f5-b8e9-b0d24157e33b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:51.532890 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03002b11-b512-48f5-b8e9-b0d24157e33b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:51.533015 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03002b11-b512-48f5-b8e9-b0d24157e33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:51.551123 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-03002b11-b512-48f5-b8e9-b0d24157e33b None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:51.552351 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-03002b11-b512-48f5-b8e9-b0d24157e33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:51.559986 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:51.706907 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9ebf9-a309-40b9-8172-c7eaf3b899f7 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:51.721293 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9ebf9-a309-40b9-8172-c7eaf3b899f7 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:51.726646 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf244d3-704f-4820-8e84-5cbf4fca3076 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:51.727269 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf244d3-704f-4820-8e84-5cbf4fca3076 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:51.727554 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf244d3-704f-4820-8e84-5cbf4fca3076 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:51.727831 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf244d3-704f-4820-8e84-5cbf4fca3076 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:51.736291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf244d3-704f-4820-8e84-5cbf4fca3076 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:51.737879 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf244d3-704f-4820-8e84-5cbf4fca3076 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:51.747025 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 724/1437] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:52.584967 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960d805-f296-4afb-8c41-8b7454bc7731 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:52.585509 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960d805-f296-4afb-8c41-8b7454bc7731 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:52.585509 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960d805-f296-4afb-8c41-8b7454bc7731 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:52.586814 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:29:52.591673 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72446f-4d8e-4210-9c7b-6886f175cc4e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:52.592109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72446f-4d8e-4210-9c7b-6886f175cc4e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:52.592224 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72446f-4d8e-4210-9c7b-6886f175cc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:52.609837 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6a72446f-4d8e-4210-9c7b-6886f175cc4e None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:52.611029 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6a72446f-4d8e-4210-9c7b-6886f175cc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:52.618696 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:52.767982 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960d805-f296-4afb-8c41-8b7454bc7731 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:52.782112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960d805-f296-4afb-8c41-8b7454bc7731 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:52.787384 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519cdfd-9296-46b9-8942-1b7738fea0a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:52.788009 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519cdfd-9296-46b9-8942-1b7738fea0a4 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:52.788293 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519cdfd-9296-46b9-8942-1b7738fea0a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:52.788597 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519cdfd-9296-46b9-8942-1b7738fea0a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:52.796616 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519cdfd-9296-46b9-8942-1b7738fea0a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:52.798199 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519cdfd-9296-46b9-8942-1b7738fea0a4 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:52.807386 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 715/1440] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:54.899283 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9498a5-27dc-4412-9081-dab557b3dadf None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:54.899817 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9498a5-27dc-4412-9081-dab557b3dadf None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:54.899817 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9498a5-27dc-4412-9081-dab557b3dadf None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:54.901160 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:29:54.906545 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee4441-0b2e-4f98-9383-17e8399a8329 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:54.906953 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee4441-0b2e-4f98-9383-17e8399a8329 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:54.907140 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee4441-0b2e-4f98-9383-17e8399a8329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:54.924474 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a2ee4441-0b2e-4f98-9383-17e8399a8329 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:54.925665 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a2ee4441-0b2e-4f98-9383-17e8399a8329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:54.933348 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:54.972617 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9498a5-27dc-4412-9081-dab557b3dadf None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:54.974298 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1a9498a5-27dc-4412-9081-dab557b3dadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:54.986953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9498a5-27dc-4412-9081-dab557b3dadf None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:54.990483 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ea3ae-ae62-45cb-bece-237a486e1c0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:54.991110 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ea3ae-ae62-45cb-bece-237a486e1c0a service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:54.991397 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ea3ae-ae62-45cb-bece-237a486e1c0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:54.991677 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ea3ae-ae62-45cb-bece-237a486e1c0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:55.000956 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ea3ae-ae62-45cb-bece-237a486e1c0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:55.002379 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ea3ae-ae62-45cb-bece-237a486e1c0a service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:55.011936 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 727/1443] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:57.409391 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0dc4a-7505-4f8f-8bba-6a4d0671c835 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:57.409981 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0dc4a-7505-4f8f-8bba-6a4d0671c835 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:57.409981 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0dc4a-7505-4f8f-8bba-6a4d0671c835 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:57.411300 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:29:57.416618 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0c9b7-e542-41b0-8b90-672c5399c981 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:57.417051 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0c9b7-e542-41b0-8b90-672c5399c981 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:57.417170 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0c9b7-e542-41b0-8b90-672c5399c981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:57.434413 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6aa0c9b7-e542-41b0-8b90-672c5399c981 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:29:57.435612 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6aa0c9b7-e542-41b0-8b90-672c5399c981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:29:57.443847 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:29:57.481673 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0dc4a-7505-4f8f-8bba-6a4d0671c835 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:29:57.492663 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0dc4a-7505-4f8f-8bba-6a4d0671c835 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:29:57.496072 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167cff0-f023-432d-9967-349aac5310af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:29:57.496723 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167cff0-f023-432d-9967-349aac5310af service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:29:57.497010 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167cff0-f023-432d-9967-349aac5310af service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:29:57.497286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167cff0-f023-432d-9967-349aac5310af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:29:57.506574 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4167cff0-f023-432d-9967-349aac5310af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:29:57.507996 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4167cff0-f023-432d-9967-349aac5310af service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:29:57.517210 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 718/1446] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:29:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:30:00.118296 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d249ba-0da4-4476-8523-e1eb259391c1 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:00.118863 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d249ba-0da4-4476-8523-e1eb259391c1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:00.118863 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d249ba-0da4-4476-8523-e1eb259391c1 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:00.120243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:30:00.125672 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ac43f-3027-43ea-8019-fae8d79f3e3e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:00.126102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ac43f-3027-43ea-8019-fae8d79f3e3e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:00.126231 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ac43f-3027-43ea-8019-fae8d79f3e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:00.143542 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-647ac43f-3027-43ea-8019-fae8d79f3e3e None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:30:00.144764 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-647ac43f-3027-43ea-8019-fae8d79f3e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:00.152440 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:30:00.191640 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d249ba-0da4-4476-8523-e1eb259391c1 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:00.202127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d249ba-0da4-4476-8523-e1eb259391c1 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:00.205620 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4143ee-59c3-4922-9f43-765e6d1e1ee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:00.206244 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4143ee-59c3-4922-9f43-765e6d1e1ee0 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:00.206528 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4143ee-59c3-4922-9f43-765e6d1e1ee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:00.206805 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4143ee-59c3-4922-9f43-765e6d1e1ee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:00.215847 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4143ee-59c3-4922-9f43-765e6d1e1ee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:00.217810 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4143ee-59c3-4922-9f43-765e6d1e1ee0 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:00.226972 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 730/1449] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:30:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:30:02.572537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9d853-a16a-4350-ae24-641704303e25 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:02.573152 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9d853-a16a-4350-ae24-641704303e25 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:02.573152 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9d853-a16a-4350-ae24-641704303e25 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:02.574505 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:30:02.579715 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a312dfd-19b9-4f14-afde-8e0957ecea30 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:02.580154 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a312dfd-19b9-4f14-afde-8e0957ecea30 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:02.580279 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a312dfd-19b9-4f14-afde-8e0957ecea30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:02.598315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-5a312dfd-19b9-4f14-afde-8e0957ecea30 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:30:02.599496 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5a312dfd-19b9-4f14-afde-8e0957ecea30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:02.607175 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:30:02.645449 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9d853-a16a-4350-ae24-641704303e25 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:02.656610 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9d853-a16a-4350-ae24-641704303e25 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:02.660078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44008f6-c5e0-4a3a-b2a7-c6ebc79cacba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:02.660751 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44008f6-c5e0-4a3a-b2a7-c6ebc79cacba service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:02.661034 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44008f6-c5e0-4a3a-b2a7-c6ebc79cacba service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:02.661309 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44008f6-c5e0-4a3a-b2a7-c6ebc79cacba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:02.670764 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44008f6-c5e0-4a3a-b2a7-c6ebc79cacba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:02.672187 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44008f6-c5e0-4a3a-b2a7-c6ebc79cacba service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:02.681463 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 721/1452] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:30:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:30:05.052954 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b94541-a246-4817-84a5-553254d7cca8 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:05.053485 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b94541-a246-4817-84a5-553254d7cca8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:05.053582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b94541-a246-4817-84a5-553254d7cca8 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:05.054950 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:30:05.060261 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374b62e-84c7-4b7e-a8c1-66eafa1e40f0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:05.060729 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374b62e-84c7-4b7e-a8c1-66eafa1e40f0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:05.060885 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374b62e-84c7-4b7e-a8c1-66eafa1e40f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:05.078697 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8374b62e-84c7-4b7e-a8c1-66eafa1e40f0 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:30:05.079896 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8374b62e-84c7-4b7e-a8c1-66eafa1e40f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:05.087903 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:30:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:30:05.125559 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b94541-a246-4817-84a5-553254d7cca8 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:05.136045 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b94541-a246-4817-84a5-553254d7cca8 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:05.140127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c15ba5-71e3-40c1-bbdc-3322e95f9b0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:05.140785 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c15ba5-71e3-40c1-bbdc-3322e95f9b0b service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:05.141070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c15ba5-71e3-40c1-bbdc-3322e95f9b0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:05.141346 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c15ba5-71e3-40c1-bbdc-3322e95f9b0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:05.150092 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c15ba5-71e3-40c1-bbdc-3322e95f9b0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:05.151510 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c15ba5-71e3-40c1-bbdc-3322e95f9b0b service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:05.161373 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 733/1455] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:30:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:30:07.497252 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685fe5b-fee0-4465-80de-e0791a0e5a72 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:07.497871 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685fe5b-fee0-4465-80de-e0791a0e5a72 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:07.497871 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685fe5b-fee0-4465-80de-e0791a0e5a72 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:07.499713 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:30:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:30:07.504969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be879d-9d81-4fd3-b561-caa39e2e9e88 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:07.505374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be879d-9d81-4fd3-b561-caa39e2e9e88 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:07.505542 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be879d-9d81-4fd3-b561-caa39e2e9e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:07.522776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f7be879d-9d81-4fd3-b561-caa39e2e9e88 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:30:07.523965 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f7be879d-9d81-4fd3-b561-caa39e2e9e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:07.531683 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:30:07.569991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685fe5b-fee0-4465-80de-e0791a0e5a72 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:07.580513 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685fe5b-fee0-4465-80de-e0791a0e5a72 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:07.583944 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f173e42-a7b7-4842-b3fe-8c65ffd81379 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:07.584873 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f173e42-a7b7-4842-b3fe-8c65ffd81379 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:07.585152 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f173e42-a7b7-4842-b3fe-8c65ffd81379 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:07.585428 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f173e42-a7b7-4842-b3fe-8c65ffd81379 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:07.594553 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f173e42-a7b7-4842-b3fe-8c65ffd81379 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:07.595975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f173e42-a7b7-4842-b3fe-8c65ffd81379 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:07.605223 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 724/1458] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:30:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:30:09.887174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5157262-26c7-4e9f-89a7-f0650f9a61a2 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:09.887708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5157262-26c7-4e9f-89a7-f0650f9a61a2 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:09.887708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5157262-26c7-4e9f-89a7-f0650f9a61a2 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:09.889679 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:30:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:30:09.894866 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e0ee4-e0d7-4cb6-b0ac-70e67650f904 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:09.895279 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e0ee4-e0d7-4cb6-b0ac-70e67650f904 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:09.895434 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e0ee4-e0d7-4cb6-b0ac-70e67650f904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:09.901448 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=70 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:09.914582 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1e5e0ee4-e0d7-4cb6-b0ac-70e67650f904 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:30:09.915771 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1e5e0ee4-e0d7-4cb6-b0ac-70e67650f904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:09.923469 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:30:09.961609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5157262-26c7-4e9f-89a7-f0650f9a61a2 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:09.967054 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=73 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:09.973021 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5157262-26c7-4e9f-89a7-f0650f9a61a2 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:09.976667 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a47f7e-1e49-4488-ad48-85b228549dcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:09.977381 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a47f7e-1e49-4488-ad48-85b228549dcb service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:09.977672 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a47f7e-1e49-4488-ad48-85b228549dcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:09.977952 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a47f7e-1e49-4488-ad48-85b228549dcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:09.987517 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a47f7e-1e49-4488-ad48-85b228549dcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:09.989020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a47f7e-1e49-4488-ad48-85b228549dcb service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:09.999247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 736/1461] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:30:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:30:12.272289 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64ce00-130e-4e15-925e-4e2371811af8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:12.272898 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64ce00-130e-4e15-925e-4e2371811af8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:12.272998 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64ce00-130e-4e15-925e-4e2371811af8 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:12.274335 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:30:12.279510 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8f3c9-8ab1-4dbe-9ee3-f58e390cded7 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:12.279939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8f3c9-8ab1-4dbe-9ee3-f58e390cded7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:12.280070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8f3c9-8ab1-4dbe-9ee3-f58e390cded7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:12.297373 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-24c8f3c9-8ab1-4dbe-9ee3-f58e390cded7 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:30:12.298562 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-24c8f3c9-8ab1-4dbe-9ee3-f58e390cded7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:12.306523 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:30:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:30:12.344194 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64ce00-130e-4e15-925e-4e2371811af8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:12.355153 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64ce00-130e-4e15-925e-4e2371811af8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:12.358765 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634cb03a-6b69-4750-8404-181944bc3394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:12.359406 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cb03a-6b69-4750-8404-181944bc3394 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:12.359684 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cb03a-6b69-4750-8404-181944bc3394 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:12.359955 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cb03a-6b69-4750-8404-181944bc3394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:12.368878 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634cb03a-6b69-4750-8404-181944bc3394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:12.370297 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634cb03a-6b69-4750-8404-181944bc3394 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:12.379885 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 727/1464] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:30:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:30:14.633894 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfe97e-382f-4b06-97db-a296a04eab7f None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:14.634461 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfe97e-382f-4b06-97db-a296a04eab7f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:14.634461 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfe97e-382f-4b06-97db-a296a04eab7f None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:14.635821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:30:14.641370 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b05589-ef7a-46e1-847d-aee70c312052 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:14.641832 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b05589-ef7a-46e1-847d-aee70c312052 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:14.641928 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b05589-ef7a-46e1-847d-aee70c312052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:14.661766 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d3b05589-ef7a-46e1-847d-aee70c312052 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:30:14.662970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d3b05589-ef7a-46e1-847d-aee70c312052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:14.671201 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:30:14.707473 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bfe97e-382f-4b06-97db-a296a04eab7f None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:14.719021 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bfe97e-382f-4b06-97db-a296a04eab7f None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:14.722528 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ff4ad-02d3-4ba1-b22b-31c2bc08abdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:14.723133 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ff4ad-02d3-4ba1-b22b-31c2bc08abdf service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:14.723419 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ff4ad-02d3-4ba1-b22b-31c2bc08abdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:14.723696 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ff4ad-02d3-4ba1-b22b-31c2bc08abdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:14.732369 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ff4ad-02d3-4ba1-b22b-31c2bc08abdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:14.733789 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ff4ad-02d3-4ba1-b22b-31c2bc08abdf service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:14.742932 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 739/1467] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:30:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:30:16.972666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d5e01-d7d0-4188-b5f3-98d933bcb139 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:16.973292 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d5e01-d7d0-4188-b5f3-98d933bcb139 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:16.973292 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d5e01-d7d0-4188-b5f3-98d933bcb139 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:16.974585 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:30:16.979813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6609b2-00ea-4a1e-bacc-a193fae0243d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:16.980254 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6609b2-00ea-4a1e-bacc-a193fae0243d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:16.980527 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6609b2-00ea-4a1e-bacc-a193fae0243d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:16.998730 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-5e6609b2-00ea-4a1e-bacc-a193fae0243d None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:30:16.999904 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5e6609b2-00ea-4a1e-bacc-a193fae0243d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:17.007821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:30:17.043583 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d5e01-d7d0-4188-b5f3-98d933bcb139 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:17.054752 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d5e01-d7d0-4188-b5f3-98d933bcb139 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:17.058268 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b3e6e-e0ce-457b-a013-6f64c84c9156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:17.058895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b3e6e-e0ce-457b-a013-6f64c84c9156 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:17.059178 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b3e6e-e0ce-457b-a013-6f64c84c9156 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:17.059455 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b3e6e-e0ce-457b-a013-6f64c84c9156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:17.068769 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b3e6e-e0ce-457b-a013-6f64c84c9156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:17.070198 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b3e6e-e0ce-457b-a013-6f64c84c9156 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:17.079331 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 730/1470] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:30:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:30:26.993214 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=17 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:27.075305 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=17 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:48.734984 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232ae52-49ac-4a66-816e-2e5d5d70c7d0 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:48.735596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232ae52-49ac-4a66-816e-2e5d5d70c7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:48.735596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232ae52-49ac-4a66-816e-2e5d5d70c7d0 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:48.736925 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 741/1471] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:30:48.742170 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ceac4-2381-433c-98bf-28c587badd69 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:48.742577 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ceac4-2381-433c-98bf-28c587badd69 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:48.742733 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ceac4-2381-433c-98bf-28c587badd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:48.760768 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-343ceac4-2381-433c-98bf-28c587badd69 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:30:48.761974 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-343ceac4-2381-433c-98bf-28c587badd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:48.769640 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 731/1472] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:30:48.815557 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c5fc2-d790-4a8f-8167-45821bf59e67 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:48.815846 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c5fc2-d790-4a8f-8167-45821bf59e67 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:48.816120 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c5fc2-d790-4a8f-8167-45821bf59e67 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:48.817497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 742/1473] 10.222.0.32 () {54 vars in 962 bytes} [Thu Jun 2 13:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:30:48.822168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ec599-14ed-4733-b7ac-693a94b4a30d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:48.822462 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ec599-14ed-4733-b7ac-693a94b4a30d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:48.822746 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ec599-14ed-4733-b7ac-693a94b4a30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:48.841156 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-552ec599-14ed-4733-b7ac-693a94b4a30d None None] MFA Rules not processed for user `9e239e4e9b99433ca9d1a8db45e24b56`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:30:48.842331 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-552ec599-14ed-4733-b7ac-693a94b4a30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:48.848935 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 732/1474] 10.222.0.32 () {58 vars in 1059 bytes} [Thu Jun 2 13:30:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:30:48.856573 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c5fc2-d790-4a8f-8167-45821bf59e67 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:48.866919 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c5fc2-d790-4a8f-8167-45821bf59e67 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:48.870389 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca14d80-064a-410d-a194-f1da434ba92c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e239e4e9b99433ca9d1a8db45e24b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:48.871000 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca14d80-064a-410d-a194-f1da434ba92c service glance] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:48.871282 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca14d80-064a-410d-a194-f1da434ba92c service glance] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:48.871557 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca14d80-064a-410d-a194-f1da434ba92c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:48.880156 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca14d80-064a-410d-a194-f1da434ba92c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:48.881602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca14d80-064a-410d-a194-f1da434ba92c service glance] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:48.890827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 743/1475] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:30:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:30:51.249564 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fad40-894c-43ea-8a2a-d6a1adabfa61 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:51.250126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fad40-894c-43ea-8a2a-d6a1adabfa61 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:51.250126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fad40-894c-43ea-8a2a-d6a1adabfa61 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:51.251465 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 733/1476] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:30:51.256631 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e4514-edf2-4eeb-a748-ba37f9a406d6 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:51.257084 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e4514-edf2-4eeb-a748-ba37f9a406d6 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:51.257201 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e4514-edf2-4eeb-a748-ba37f9a406d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:51.275716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-656e4514-edf2-4eeb-a748-ba37f9a406d6 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:30:51.276871 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-656e4514-edf2-4eeb-a748-ba37f9a406d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:51.284615 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 744/1477] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:30:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:30:51.307836 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fad40-894c-43ea-8a2a-d6a1adabfa61 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:51.320504 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fad40-894c-43ea-8a2a-d6a1adabfa61 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:51.325490 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d45f6-f5ee-406f-8769-d97412585092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:51.326120 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d45f6-f5ee-406f-8769-d97412585092 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:51.326397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d45f6-f5ee-406f-8769-d97412585092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:51.326669 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d45f6-f5ee-406f-8769-d97412585092 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:51.327391 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d45f6-f5ee-406f-8769-d97412585092 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:51.329142 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: WARNING py.warnings [None req-3c5d45f6-f5ee-406f-8769-d97412585092 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:30:51.329142 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: warnings.warn(msg) Jun 02 13:30:51.329142 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: Jun 02 13:30:51.330259 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d45f6-f5ee-406f-8769-d97412585092 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:51.348893 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 734/1478] 10.222.0.32 () {56 vars in 1108 bytes} [Thu Jun 2 13:30:51 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:30:53.605241 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448163d1-c6ac-4536-8b3e-f14ac6e9ba40 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:53.605796 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448163d1-c6ac-4536-8b3e-f14ac6e9ba40 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:53.605796 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448163d1-c6ac-4536-8b3e-f14ac6e9ba40 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:53.607173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 745/1479] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:30:53.612280 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda0ba4-2baf-43c2-ae65-014d8b5a9947 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:53.612732 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda0ba4-2baf-43c2-ae65-014d8b5a9947 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:53.612868 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda0ba4-2baf-43c2-ae65-014d8b5a9947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:53.630699 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9bda0ba4-2baf-43c2-ae65-014d8b5a9947 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:30:53.631878 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9bda0ba4-2baf-43c2-ae65-014d8b5a9947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:53.640103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 735/1480] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:30:53.682990 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448163d1-c6ac-4536-8b3e-f14ac6e9ba40 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:53.697079 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448163d1-c6ac-4536-8b3e-f14ac6e9ba40 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:53.703070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab6eb3-cfd2-4915-bef4-5dd9b8556613 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:53.703702 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab6eb3-cfd2-4915-bef4-5dd9b8556613 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:53.703990 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab6eb3-cfd2-4915-bef4-5dd9b8556613 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:53.704267 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab6eb3-cfd2-4915-bef4-5dd9b8556613 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:53.712647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab6eb3-cfd2-4915-bef4-5dd9b8556613 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:53.714314 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab6eb3-cfd2-4915-bef4-5dd9b8556613 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:53.724059 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 746/1481] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:30:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:30:56.137558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39432b3-acce-4a0b-a192-331c7e94963d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:56.138117 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39432b3-acce-4a0b-a192-331c7e94963d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:56.138117 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39432b3-acce-4a0b-a192-331c7e94963d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:56.139479 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 736/1482] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:30:56.144656 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c37a6c-137d-483e-9ef4-14a7e9b69c7a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:56.145093 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c37a6c-137d-483e-9ef4-14a7e9b69c7a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:56.145564 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c37a6c-137d-483e-9ef4-14a7e9b69c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:56.163051 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d2c37a6c-137d-483e-9ef4-14a7e9b69c7a None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:30:56.164255 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d2c37a6c-137d-483e-9ef4-14a7e9b69c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:56.172553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 747/1483] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:30:56.208740 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39432b3-acce-4a0b-a192-331c7e94963d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:56.219831 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39432b3-acce-4a0b-a192-331c7e94963d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:56.223297 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9387cf-4fd5-4efe-9a99-13e645bf1e1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:56.223920 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9387cf-4fd5-4efe-9a99-13e645bf1e1e service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:56.224197 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9387cf-4fd5-4efe-9a99-13e645bf1e1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:56.224500 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9387cf-4fd5-4efe-9a99-13e645bf1e1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:56.233561 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9387cf-4fd5-4efe-9a99-13e645bf1e1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:56.234985 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9387cf-4fd5-4efe-9a99-13e645bf1e1e service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:56.244442 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 737/1484] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:30:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:30:58.513466 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fff3c-15e1-494b-bcbc-35735cd277f5 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:58.514050 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fff3c-15e1-494b-bcbc-35735cd277f5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:58.514050 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fff3c-15e1-494b-bcbc-35735cd277f5 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:58.515383 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 748/1485] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:30:58.520551 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684afe8d-427a-4c10-baad-6ab26689ad17 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:58.520966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684afe8d-427a-4c10-baad-6ab26689ad17 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:58.521115 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684afe8d-427a-4c10-baad-6ab26689ad17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:58.539180 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-684afe8d-427a-4c10-baad-6ab26689ad17 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:30:58.540404 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-684afe8d-427a-4c10-baad-6ab26689ad17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:30:58.548025 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 738/1486] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:30:58.586216 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fff3c-15e1-494b-bcbc-35735cd277f5 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:30:58.596838 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fff3c-15e1-494b-bcbc-35735cd277f5 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:30:58.600284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78682443-1619-436f-8a9f-fe6695eb3638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:30:58.600926 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78682443-1619-436f-8a9f-fe6695eb3638 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:30:58.601207 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78682443-1619-436f-8a9f-fe6695eb3638 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:30:58.601482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78682443-1619-436f-8a9f-fe6695eb3638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:30:58.610114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78682443-1619-436f-8a9f-fe6695eb3638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:30:58.611518 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78682443-1619-436f-8a9f-fe6695eb3638 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:30:58.621146 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 749/1487] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:30:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:31:00.934637 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d938fa-782e-4e87-94ea-2aa76856af44 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:00.935205 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d938fa-782e-4e87-94ea-2aa76856af44 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:00.935205 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d938fa-782e-4e87-94ea-2aa76856af44 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:00.936620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 739/1488] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:00.942009 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03a0b0-5127-4536-8b97-c077f9ab7e5a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:00.942445 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03a0b0-5127-4536-8b97-c077f9ab7e5a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:00.942552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03a0b0-5127-4536-8b97-c077f9ab7e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:00.960131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3f03a0b0-5127-4536-8b97-c077f9ab7e5a None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:00.961346 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3f03a0b0-5127-4536-8b97-c077f9ab7e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:00.969465 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 750/1489] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:31:01.008546 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d938fa-782e-4e87-94ea-2aa76856af44 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:01.019217 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d938fa-782e-4e87-94ea-2aa76856af44 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:01.022681 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b90eb-892f-4ff9-ae7c-e249ce7256d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:01.023306 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b90eb-892f-4ff9-ae7c-e249ce7256d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:01.023614 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b90eb-892f-4ff9-ae7c-e249ce7256d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:01.023888 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b90eb-892f-4ff9-ae7c-e249ce7256d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:01.033118 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b90eb-892f-4ff9-ae7c-e249ce7256d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:01.034536 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b90eb-892f-4ff9-ae7c-e249ce7256d2 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:01.044400 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 740/1490] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:31:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:31:03.440133 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b6de6-13e3-4973-80a1-d3ac89743571 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:03.440775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b6de6-13e3-4973-80a1-d3ac89743571 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:03.440775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b6de6-13e3-4973-80a1-d3ac89743571 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:03.442103 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 751/1491] 10.222.0.32 () {54 vars in 926 bytes} [Thu Jun 2 13:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:03.447481 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c511a13-f98b-4b00-8c45-62aff15d838a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:03.447891 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c511a13-f98b-4b00-8c45-62aff15d838a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:03.448083 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c511a13-f98b-4b00-8c45-62aff15d838a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:03.466182 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4c511a13-f98b-4b00-8c45-62aff15d838a None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:03.467369 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4c511a13-f98b-4b00-8c45-62aff15d838a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:03.475297 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 741/1492] 10.222.0.32 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:31:03.514412 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b6de6-13e3-4973-80a1-d3ac89743571 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:03.524966 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b6de6-13e3-4973-80a1-d3ac89743571 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:03.528575 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd4b61-5449-47b8-aaf9-1262a5a38e29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:03.529197 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd4b61-5449-47b8-aaf9-1262a5a38e29 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:03.529479 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd4b61-5449-47b8-aaf9-1262a5a38e29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:03.529753 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd4b61-5449-47b8-aaf9-1262a5a38e29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:03.538397 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd4b61-5449-47b8-aaf9-1262a5a38e29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:03.539845 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd4b61-5449-47b8-aaf9-1262a5a38e29 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:03.549562 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 752/1493] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:31:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:31:13.461159 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=33 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:13.545474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=33 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:28.136732 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fc034-ab25-4273-af6f-7ab7532d2f91 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:28.137299 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fc034-ab25-4273-af6f-7ab7532d2f91 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:28.137299 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fc034-ab25-4273-af6f-7ab7532d2f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:28.155265 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a52fc034-ab25-4273-af6f-7ab7532d2f91 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:28.156496 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a52fc034-ab25-4273-af6f-7ab7532d2f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:28.164747 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 742/1494] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:32:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:28.172421 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869477c1-fe62-470a-9d33-5eecf132d896 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:28.172901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869477c1-fe62-470a-9d33-5eecf132d896 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:28.172997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869477c1-fe62-470a-9d33-5eecf132d896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:28.190916 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-869477c1-fe62-470a-9d33-5eecf132d896 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:28.192090 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-869477c1-fe62-470a-9d33-5eecf132d896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:28.199786 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 753/1495] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:32:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:28.204128 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fc034-ab25-4273-af6f-7ab7532d2f91 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:28.214429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fc034-ab25-4273-af6f-7ab7532d2f91 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:28.218949 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32eeb0-f896-49db-a767-e742eb229d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:28.219596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32eeb0-f896-49db-a767-e742eb229d13 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:28.219881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32eeb0-f896-49db-a767-e742eb229d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:28.220159 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32eeb0-f896-49db-a767-e742eb229d13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:28.220923 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32eeb0-f896-49db-a767-e742eb229d13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:28.221238 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32eeb0-f896-49db-a767-e742eb229d13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:28.222257 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: WARNING py.warnings [None req-4f32eeb0-f896-49db-a767-e742eb229d13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:32:28.222257 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: warnings.warn(msg) Jun 02 13:32:28.222257 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: Jun 02 13:32:28.223148 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32eeb0-f896-49db-a767-e742eb229d13 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:28.235430 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 743/1496] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:28.243532 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869477c1-fe62-470a-9d33-5eecf132d896 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:28.252519 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869477c1-fe62-470a-9d33-5eecf132d896 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:28.257041 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f960b0-7dda-41c9-8333-f2ad296f81d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:28.257681 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f960b0-7dda-41c9-8333-f2ad296f81d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:28.257964 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f960b0-7dda-41c9-8333-f2ad296f81d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:28.258242 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f960b0-7dda-41c9-8333-f2ad296f81d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:28.258936 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f960b0-7dda-41c9-8333-f2ad296f81d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:28.260703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: WARNING py.warnings [None req-c5f960b0-7dda-41c9-8333-f2ad296f81d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:32:28.260703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: warnings.warn(msg) Jun 02 13:32:28.260703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: Jun 02 13:32:28.261891 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f960b0-7dda-41c9-8333-f2ad296f81d1 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:28.296574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 754/1497] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:32:28 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:32:28.300738 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32eeb0-f896-49db-a767-e742eb229d13 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:28.310549 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32eeb0-f896-49db-a767-e742eb229d13 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:28.365363 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff17b9-0279-426a-ba05-1919bc0d3737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:28.366052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff17b9-0279-426a-ba05-1919bc0d3737 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:28.366337 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff17b9-0279-426a-ba05-1919bc0d3737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:28.366617 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff17b9-0279-426a-ba05-1919bc0d3737 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:28.367316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff17b9-0279-426a-ba05-1919bc0d3737 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:28.368356 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: WARNING py.warnings [None req-70ff17b9-0279-426a-ba05-1919bc0d3737 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:32:28.368356 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: warnings.warn(msg) Jun 02 13:32:28.368356 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: Jun 02 13:32:28.369557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff17b9-0279-426a-ba05-1919bc0d3737 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:28.388617 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 744/1498] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:32:28 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:32:28.392687 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f960b0-7dda-41c9-8333-f2ad296f81d1 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:28.403348 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f960b0-7dda-41c9-8333-f2ad296f81d1 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:28.407881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a959c-731a-4746-897e-9005daa9b93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:28.408567 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a959c-731a-4746-897e-9005daa9b93a admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:28.408856 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a959c-731a-4746-897e-9005daa9b93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:28.409136 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a959c-731a-4746-897e-9005daa9b93a admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:28.409862 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a959c-731a-4746-897e-9005daa9b93a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:28.410871 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: WARNING py.warnings [None req-a63a959c-731a-4746-897e-9005daa9b93a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:32:28.410871 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: warnings.warn(msg) Jun 02 13:32:28.410871 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: Jun 02 13:32:28.411749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a959c-731a-4746-897e-9005daa9b93a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:28.424867 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 755/1499] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:32:28.428673 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff17b9-0279-426a-ba05-1919bc0d3737 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:28.438235 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff17b9-0279-426a-ba05-1919bc0d3737 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:28.442851 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3386c-fd22-4b0b-9b84-939ffbe6d5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:28.443521 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3386c-fd22-4b0b-9b84-939ffbe6d5dc admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:28.443811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3386c-fd22-4b0b-9b84-939ffbe6d5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:28.444135 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3386c-fd22-4b0b-9b84-939ffbe6d5dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:28.444897 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3386c-fd22-4b0b-9b84-939ffbe6d5dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:28.445909 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: WARNING py.warnings [None req-e3a3386c-fd22-4b0b-9b84-939ffbe6d5dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:32:28.445909 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: warnings.warn(msg) Jun 02 13:32:28.445909 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: Jun 02 13:32:28.446787 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3386c-fd22-4b0b-9b84-939ffbe6d5dc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:28.460750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 745/1500] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:32:28.464562 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a959c-731a-4746-897e-9005daa9b93a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:28.474080 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a959c-731a-4746-897e-9005daa9b93a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:28.479152 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bbf817-9cd8-4ed8-a4a3-810cd484f791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:28.480015 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbf817-9cd8-4ed8-a4a3-810cd484f791 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:28.480314 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbf817-9cd8-4ed8-a4a3-810cd484f791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:28.480618 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbf817-9cd8-4ed8-a4a3-810cd484f791 admin admin] PATH_INFO: `/v3/projects/e32b34d047cc46e5ab4d3951b209ba05/users/9d13ea8583724e7898cd643bd52c201b/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:28.495098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bbf817-9cd8-4ed8-a4a3-810cd484f791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e32b34d047cc46e5ab4d3951b209ba05, user_id=9d13ea8583724e7898cd643bd52c201b, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:28.496123 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: WARNING py.warnings [None req-a1bbf817-9cd8-4ed8-a4a3-810cd484f791 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:32:28.496123 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: warnings.warn(msg) Jun 02 13:32:28.496123 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: Jun 02 13:32:28.498077 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bbf817-9cd8-4ed8-a4a3-810cd484f791 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:28.511024 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 756/1501] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:32:28 2022] PUT /identity/v3/projects/e32b34d047cc46e5ab4d3951b209ba05/users/9d13ea8583724e7898cd643bd52c201b/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:32:28.524103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dbaf7-d621-44ef-a9b1-fd343520038e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:28.524424 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dbaf7-d621-44ef-a9b1-fd343520038e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:28.524703 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dbaf7-d621-44ef-a9b1-fd343520038e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:28.550551 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-631dbaf7-d621-44ef-a9b1-fd343520038e None None] MFA Rules not processed for user `9d13ea8583724e7898cd643bd52c201b`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:28.551674 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-631dbaf7-d621-44ef-a9b1-fd343520038e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:28.614048 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 746/1502] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:32:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:32:28.627266 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a145cc5-5e68-482e-8d5f-6f63bf11bbdb None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:28.627559 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a145cc5-5e68-482e-8d5f-6f63bf11bbdb None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:28.627840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a145cc5-5e68-482e-8d5f-6f63bf11bbdb None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:28.629236 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 757/1503] 10.222.0.32 () {54 vars in 963 bytes} [Thu Jun 2 13:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:28.634582 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c474ff-4317-4d68-bce7-426be3fbea3f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:28.634869 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c474ff-4317-4d68-bce7-426be3fbea3f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:28.635145 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c474ff-4317-4d68-bce7-426be3fbea3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:28.653018 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-55c474ff-4317-4d68-bce7-426be3fbea3f None None] MFA Rules not processed for user `09a1e517aa87428ebdb1e54671a8d93d`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:28.654186 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-55c474ff-4317-4d68-bce7-426be3fbea3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:28.695484 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:28.703422 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 747/1504] 10.222.0.32 () {58 vars in 1060 bytes} [Thu Jun 2 13:32:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:28.711700 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a145cc5-5e68-482e-8d5f-6f63bf11bbdb None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:28.722094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a145cc5-5e68-482e-8d5f-6f63bf11bbdb None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:28.725640 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8bff87-05e1-4555-886e-e79c6a652fe6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:28.726257 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bff87-05e1-4555-886e-e79c6a652fe6 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:28.726542 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bff87-05e1-4555-886e-e79c6a652fe6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:28.726818 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bff87-05e1-4555-886e-e79c6a652fe6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:28.734854 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8bff87-05e1-4555-886e-e79c6a652fe6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:28.736272 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8bff87-05e1-4555-886e-e79c6a652fe6 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:28.744903 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 758/1505] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:32:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:32:28.785960 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d900d4-02c7-4f08-962a-d049cb42e8a6 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:28.786250 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d900d4-02c7-4f08-962a-d049cb42e8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:28.786528 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d900d4-02c7-4f08-962a-d049cb42e8a6 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:28.787970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 748/1506] 10.222.0.32 () {52 vars in 829 bytes} [Thu Jun 2 13:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:28.791513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8bff87-05e1-4555-886e-e79c6a652fe6 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:28.852417 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8bff87-05e1-4555-886e-e79c6a652fe6 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:28.856958 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d707cb-e2c9-4ea2-896e-ab79155cb5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:28.857818 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d707cb-e2c9-4ea2-896e-ab79155cb5cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:28.858102 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d707cb-e2c9-4ea2-896e-ab79155cb5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:28.858402 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d707cb-e2c9-4ea2-896e-ab79155cb5cc admin admin] PATH_INFO: `/v3/users/9d13ea8583724e7898cd643bd52c201b` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:28.859591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d707cb-e2c9-4ea2-896e-ab79155cb5cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d13ea8583724e7898cd643bd52c201b)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:28.860642 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: WARNING py.warnings [None req-20d707cb-e2c9-4ea2-896e-ab79155cb5cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:32:28.860642 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: warnings.warn(msg) Jun 02 13:32:28.860642 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: Jun 02 13:32:28.861840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d707cb-e2c9-4ea2-896e-ab79155cb5cc admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:28.929297 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-20d707cb-e2c9-4ea2-896e-ab79155cb5cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d13ea8583724e7898cd643bd52c201b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:28.941053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-20d707cb-e2c9-4ea2-896e-ab79155cb5cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d13ea8583724e7898cd643bd52c201b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:28.941712 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-20d707cb-e2c9-4ea2-896e-ab79155cb5cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d13ea8583724e7898cd643bd52c201b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:28.960507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-20d707cb-e2c9-4ea2-896e-ab79155cb5cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d13ea8583724e7898cd643bd52c201b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:28.964359 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:28.969532 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-20d707cb-e2c9-4ea2-896e-ab79155cb5cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d13ea8583724e7898cd643bd52c201b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:28.976742 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 759/1507] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:32:28 2022] DELETE /identity/v3/users/9d13ea8583724e7898cd643bd52c201b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:32:28.981506 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68f9f6-f4d7-4d81-884d-c6085b125202 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:28.981791 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68f9f6-f4d7-4d81-884d-c6085b125202 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:28.982067 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68f9f6-f4d7-4d81-884d-c6085b125202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:28.999458 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1c68f9f6-f4d7-4d81-884d-c6085b125202 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:29.000665 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1c68f9f6-f4d7-4d81-884d-c6085b125202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:29.062010 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 749/1508] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:32:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:32:29.072058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d707cb-e2c9-4ea2-896e-ab79155cb5cc admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:29.073617 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-20d707cb-e2c9-4ea2-896e-ab79155cb5cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:29.132203 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d707cb-e2c9-4ea2-896e-ab79155cb5cc admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:29.136021 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e1933-854f-48f1-a07a-27166b808dcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:29.136742 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e1933-854f-48f1-a07a-27166b808dcb service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:29.137033 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e1933-854f-48f1-a07a-27166b808dcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:29.137338 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e1933-854f-48f1-a07a-27166b808dcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:29.146359 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e1933-854f-48f1-a07a-27166b808dcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:29.147801 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e1933-854f-48f1-a07a-27166b808dcb service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:29.157214 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 760/1509] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:32:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:32:29.477007 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68f9f6-f4d7-4d81-884d-c6085b125202 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:29.478934 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1c68f9f6-f4d7-4d81-884d-c6085b125202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:29.491647 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68f9f6-f4d7-4d81-884d-c6085b125202 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:29.496221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c829c-0b24-4d08-a281-834a8d93c806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:29.497156 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c829c-0b24-4d08-a281-834a8d93c806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:29.497414 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c829c-0b24-4d08-a281-834a8d93c806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:29.497742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c829c-0b24-4d08-a281-834a8d93c806 admin admin] PATH_INFO: `/v3/projects/e32b34d047cc46e5ab4d3951b209ba05` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:29.498973 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c829c-0b24-4d08-a281-834a8d93c806 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e32b34d047cc46e5ab4d3951b209ba05)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:29.499998 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: WARNING py.warnings [None req-761c829c-0b24-4d08-a281-834a8d93c806 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:32:29.499998 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: warnings.warn(msg) Jun 02 13:32:29.499998 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: Jun 02 13:32:29.501232 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c829c-0b24-4d08-a281-834a8d93c806 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:29.561341 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-761c829c-0b24-4d08-a281-834a8d93c806 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e32b34d047cc46e5ab4d3951b209ba05', 'request_id': 'req-761c829c-0b24-4d08-a281-834a8d93c806'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:29.567280 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-761c829c-0b24-4d08-a281-834a8d93c806 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e32b34d047cc46e5ab4d3951b209ba05', 'request_id': 'req-761c829c-0b24-4d08-a281-834a8d93c806'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:29.576654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-761c829c-0b24-4d08-a281-834a8d93c806 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e32b34d047cc46e5ab4d3951b209ba05', 'request_id': 'req-761c829c-0b24-4d08-a281-834a8d93c806'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:29.594908 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-761c829c-0b24-4d08-a281-834a8d93c806 admin admin] The token cache is being invalidate because project e32b34d047cc46e5ab4d3951b209ba05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:32:29.595200 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-761c829c-0b24-4d08-a281-834a8d93c806 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:29.595938 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-761c829c-0b24-4d08-a281-834a8d93c806 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:32:29.597507 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 750/1510] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:32:29 2022] DELETE /identity/v3/projects/e32b34d047cc46e5ab4d3951b209ba05 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:32:39.153095 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:39.591898 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:07.239891 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09c37d-ebf1-4df1-bfbc-81a6241f8a09 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:07.240516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09c37d-ebf1-4df1-bfbc-81a6241f8a09 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:07.240516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09c37d-ebf1-4df1-bfbc-81a6241f8a09 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:07.241851 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:07.247138 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80dce5-cabd-4f70-8ce6-51ea54dd772c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:07.247548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80dce5-cabd-4f70-8ce6-51ea54dd772c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:07.247709 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80dce5-cabd-4f70-8ce6-51ea54dd772c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:07.266102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0b80dce5-cabd-4f70-8ce6-51ea54dd772c None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:07.267238 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0b80dce5-cabd-4f70-8ce6-51ea54dd772c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:07.325010 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:34:07.491167 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09c37d-ebf1-4df1-bfbc-81a6241f8a09 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:07.492874 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0e09c37d-ebf1-4df1-bfbc-81a6241f8a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:07.565867 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09c37d-ebf1-4df1-bfbc-81a6241f8a09 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:07.571285 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56a0b4-d41d-47f6-9c1c-498f99e494b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:07.571932 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56a0b4-d41d-47f6-9c1c-498f99e494b3 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:07.572234 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56a0b4-d41d-47f6-9c1c-498f99e494b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:07.572538 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56a0b4-d41d-47f6-9c1c-498f99e494b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:07.580474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b56a0b4-d41d-47f6-9c1c-498f99e494b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:07.582327 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b56a0b4-d41d-47f6-9c1c-498f99e494b3 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:07.591509 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 762/1513] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:34:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:34:08.467873 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dc037-05fd-40d5-99f8-0689b4f3502e None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:08.468465 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dc037-05fd-40d5-99f8-0689b4f3502e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:08.468465 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dc037-05fd-40d5-99f8-0689b4f3502e None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:08.469837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 752/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:08.474563 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda1c72-54d7-4b08-bc9d-14bc4e860379 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:08.474976 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda1c72-54d7-4b08-bc9d-14bc4e860379 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:08.475131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda1c72-54d7-4b08-bc9d-14bc4e860379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:08.493424 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-0dda1c72-54d7-4b08-bc9d-14bc4e860379 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:08.495169 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0dda1c72-54d7-4b08-bc9d-14bc4e860379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:08.502978 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 763/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:34:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:34:08.649935 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dc037-05fd-40d5-99f8-0689b4f3502e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:08.664762 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dc037-05fd-40d5-99f8-0689b4f3502e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:08.670748 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7304e51-ebeb-4fb7-8dc4-190d2db1a3cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:08.671379 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7304e51-ebeb-4fb7-8dc4-190d2db1a3cc service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:08.671682 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7304e51-ebeb-4fb7-8dc4-190d2db1a3cc service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:08.671941 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7304e51-ebeb-4fb7-8dc4-190d2db1a3cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:08.680038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7304e51-ebeb-4fb7-8dc4-190d2db1a3cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:08.681695 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7304e51-ebeb-4fb7-8dc4-190d2db1a3cc service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:08.690937 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 753/1516] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:34:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:34:09.651846 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9d63b-7e18-48d4-901e-6ae3b949cbeb None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:09.652507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9d63b-7e18-48d4-901e-6ae3b949cbeb None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:09.652507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9d63b-7e18-48d4-901e-6ae3b949cbeb None None] PATH_INFO: `/v3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:09.653757 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 764/1517] 10.222.0.47 () {54 vars in 925 bytes} [Thu Jun 2 13:34:09 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:09.662505 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7def3-aafd-4f03-b259-e3abcfb6eb1e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:09.662893 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7def3-aafd-4f03-b259-e3abcfb6eb1e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:09.663067 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7def3-aafd-4f03-b259-e3abcfb6eb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:09.682524 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-72c7def3-aafd-4f03-b259-e3abcfb6eb1e None None] MFA Rules not processed for user `24410ef5e78042c79c5b4a0d78b56258`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:09.683730 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-72c7def3-aafd-4f03-b259-e3abcfb6eb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:09.747682 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 754/1518] 10.222.0.47 () {58 vars in 1015 bytes} [Thu Jun 2 13:34:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:34:18.488212 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=37 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:19.738832 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=62 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:19.845669 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad8b05-e6d7-4536-912e-4f60222b80f3 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:19.846369 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad8b05-e6d7-4536-912e-4f60222b80f3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:19.846369 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad8b05-e6d7-4536-912e-4f60222b80f3 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:19.848080 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 765/1519] 10.222.0.32 () {54 vars in 960 bytes} [Thu Jun 2 13:34:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:19.854195 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d46258-286b-4c9e-b79c-3e55c5410dc5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:19.854619 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d46258-286b-4c9e-b79c-3e55c5410dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:19.854986 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d46258-286b-4c9e-b79c-3e55c5410dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:19.873496 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a5d46258-286b-4c9e-b79c-3e55c5410dc5 None None] MFA Rules not processed for user `24410ef5e78042c79c5b4a0d78b56258`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:19.874942 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a5d46258-286b-4c9e-b79c-3e55c5410dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:19.883459 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 755/1520] 10.222.0.32 () {58 vars in 1057 bytes} [Thu Jun 2 13:34:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:34:19.890905 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad8b05-e6d7-4536-912e-4f60222b80f3 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:19.904923 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad8b05-e6d7-4536-912e-4f60222b80f3 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:19.909999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8d686-e778-4409-a041-a5f72c312b9b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24410ef5e78042c79c5b4a0d78b56258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:19.910665 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8d686-e778-4409-a041-a5f72c312b9b service placement] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:19.910949 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8d686-e778-4409-a041-a5f72c312b9b service placement] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:19.911227 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8d686-e778-4409-a041-a5f72c312b9b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:19.920727 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8d686-e778-4409-a041-a5f72c312b9b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:19.922305 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8d686-e778-4409-a041-a5f72c312b9b service placement] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:19.931996 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 766/1521] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:34:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:34:19.964278 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5fe95-c093-4909-9612-6e1c065889bd None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:19.964591 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5fe95-c093-4909-9612-6e1c065889bd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:19.964868 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5fe95-c093-4909-9612-6e1c065889bd None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:19.966228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:34:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:19.971360 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b9bd9-cd99-4e25-b923-53637faf77ff None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:19.971657 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b9bd9-cd99-4e25-b923-53637faf77ff None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:19.971936 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b9bd9-cd99-4e25-b923-53637faf77ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:19.990658 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c59b9bd9-cd99-4e25-b923-53637faf77ff None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:19.991763 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c59b9bd9-cd99-4e25-b923-53637faf77ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:19.999766 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:34:20.151840 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5fe95-c093-4909-9612-6e1c065889bd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:20.166942 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5fe95-c093-4909-9612-6e1c065889bd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:20.172321 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73085ce-8a5f-42e7-b259-dfa25aabb403 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:20.172967 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73085ce-8a5f-42e7-b259-dfa25aabb403 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:20.173257 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73085ce-8a5f-42e7-b259-dfa25aabb403 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:20.173536 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73085ce-8a5f-42e7-b259-dfa25aabb403 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:20.181716 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73085ce-8a5f-42e7-b259-dfa25aabb403 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:20.183311 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73085ce-8a5f-42e7-b259-dfa25aabb403 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:20.192979 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 757/1524] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:34:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:34:21.064704 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f264641-1778-424f-b621-8590d35e0edc None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:21.065208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f264641-1778-424f-b621-8590d35e0edc None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:21.065325 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f264641-1778-424f-b621-8590d35e0edc None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:21.066684 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:21.071368 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81a151-6cac-4b5f-80c2-3e961ae79153 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:21.072349 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81a151-6cac-4b5f-80c2-3e961ae79153 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:21.072465 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81a151-6cac-4b5f-80c2-3e961ae79153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:21.090811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-fe81a151-6cac-4b5f-80c2-3e961ae79153 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:21.091989 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fe81a151-6cac-4b5f-80c2-3e961ae79153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:21.099616 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:34:21.247233 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f264641-1778-424f-b621-8590d35e0edc None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:21.261963 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f264641-1778-424f-b621-8590d35e0edc None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:21.267509 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cddbf-f29f-4a3b-8e56-87f416630e4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:21.268136 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cddbf-f29f-4a3b-8e56-87f416630e4f service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:21.268467 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cddbf-f29f-4a3b-8e56-87f416630e4f service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:21.268749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cddbf-f29f-4a3b-8e56-87f416630e4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:21.279116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70cddbf-f29f-4a3b-8e56-87f416630e4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:21.281539 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70cddbf-f29f-4a3b-8e56-87f416630e4f service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:21.291467 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 769/1527] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:34:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:34:25.315840 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4d839-5c44-4b8d-8d7e-3d8a210f76ee None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:25.316391 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4d839-5c44-4b8d-8d7e-3d8a210f76ee None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:25.316514 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4d839-5c44-4b8d-8d7e-3d8a210f76ee None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:25.317826 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:25.323185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbe46b-ae13-49ae-9932-451dfc5ce634 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:25.323607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbe46b-ae13-49ae-9932-451dfc5ce634 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:25.323759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbe46b-ae13-49ae-9932-451dfc5ce634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:25.341923 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-bbfbe46b-ae13-49ae-9932-451dfc5ce634 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:25.343126 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bbfbe46b-ae13-49ae-9932-451dfc5ce634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:25.350952 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:34:25.387252 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4d839-5c44-4b8d-8d7e-3d8a210f76ee None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:25.389004 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fbb4d839-5c44-4b8d-8d7e-3d8a210f76ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:25.445672 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4d839-5c44-4b8d-8d7e-3d8a210f76ee None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:25.449166 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2c943-dba6-413b-b2b8-ae153346c147 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:25.449798 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2c943-dba6-413b-b2b8-ae153346c147 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:25.450084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2c943-dba6-413b-b2b8-ae153346c147 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:25.450362 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2c943-dba6-413b-b2b8-ae153346c147 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:25.459380 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab2c943-dba6-413b-b2b8-ae153346c147 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:25.460857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab2c943-dba6-413b-b2b8-ae153346c147 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:25.470589 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 760/1530] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:34:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:34:27.697939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa92eab-864e-4c3f-bd97-e5631b6ab652 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:27.698517 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa92eab-864e-4c3f-bd97-e5631b6ab652 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:27.698517 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa92eab-864e-4c3f-bd97-e5631b6ab652 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:27.699873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:34:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:27.705114 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7900ba-0066-4401-8dfe-4bd5f64dccf1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:27.705538 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7900ba-0066-4401-8dfe-4bd5f64dccf1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:27.705682 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7900ba-0066-4401-8dfe-4bd5f64dccf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:27.724167 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ca7900ba-0066-4401-8dfe-4bd5f64dccf1 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:27.725399 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ca7900ba-0066-4401-8dfe-4bd5f64dccf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:27.733113 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:34:27.768840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa92eab-864e-4c3f-bd97-e5631b6ab652 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:27.779885 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa92eab-864e-4c3f-bd97-e5631b6ab652 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:27.783578 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab7c8f-523e-4110-8285-eb4dc99ac669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:27.784222 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab7c8f-523e-4110-8285-eb4dc99ac669 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:27.784541 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab7c8f-523e-4110-8285-eb4dc99ac669 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:27.784826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab7c8f-523e-4110-8285-eb4dc99ac669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:27.794100 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab7c8f-523e-4110-8285-eb4dc99ac669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:27.795538 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab7c8f-523e-4110-8285-eb4dc99ac669 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:27.804928 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 772/1533] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:34:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:34:31.561863 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff399c4-750f-44d5-9b6b-08106d95fdef None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:31.562431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff399c4-750f-44d5-9b6b-08106d95fdef None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:31.562431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff399c4-750f-44d5-9b6b-08106d95fdef None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:31.563767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:31.568940 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c96c1b-96fd-4bad-b597-1a11b98cb498 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:31.569366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c96c1b-96fd-4bad-b597-1a11b98cb498 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:31.569505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c96c1b-96fd-4bad-b597-1a11b98cb498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:31.588074 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d1c96c1b-96fd-4bad-b597-1a11b98cb498 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:31.589335 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d1c96c1b-96fd-4bad-b597-1a11b98cb498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:31.597019 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:34:31.862852 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff399c4-750f-44d5-9b6b-08106d95fdef None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:31.864582 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3ff399c4-750f-44d5-9b6b-08106d95fdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:31.922975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff399c4-750f-44d5-9b6b-08106d95fdef None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:31.926476 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbc604-5279-4a98-b324-e3b6ea4b957a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:31.927111 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbc604-5279-4a98-b324-e3b6ea4b957a service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:31.927396 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbc604-5279-4a98-b324-e3b6ea4b957a service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:31.927674 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbc604-5279-4a98-b324-e3b6ea4b957a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:31.936589 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bbc604-5279-4a98-b324-e3b6ea4b957a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:31.938035 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bbc604-5279-4a98-b324-e3b6ea4b957a service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:31.948054 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 763/1536] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:34:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:34:34.173916 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7fcd6-5c99-4cfa-8aa6-3d136247157f None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:34.174462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7fcd6-5c99-4cfa-8aa6-3d136247157f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:34.174462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7fcd6-5c99-4cfa-8aa6-3d136247157f None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:34.175845 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:34.181829 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82c5ca-88c6-4a7b-9c4b-3dc03b416b8c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:34.182286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82c5ca-88c6-4a7b-9c4b-3dc03b416b8c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:34.182386 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82c5ca-88c6-4a7b-9c4b-3dc03b416b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:34.200273 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0c82c5ca-88c6-4a7b-9c4b-3dc03b416b8c None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:34.201505 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0c82c5ca-88c6-4a7b-9c4b-3dc03b416b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:34.209631 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:34:34.475030 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7fcd6-5c99-4cfa-8aa6-3d136247157f None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:34.476732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2ba7fcd6-5c99-4cfa-8aa6-3d136247157f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:34.490079 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7fcd6-5c99-4cfa-8aa6-3d136247157f None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:34.493612 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560ee36-0783-4850-a88f-b72b1dc89c4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:34.494240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560ee36-0783-4850-a88f-b72b1dc89c4d service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:34.494525 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560ee36-0783-4850-a88f-b72b1dc89c4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:34.494805 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560ee36-0783-4850-a88f-b72b1dc89c4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:34.503545 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560ee36-0783-4850-a88f-b72b1dc89c4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:34.505007 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560ee36-0783-4850-a88f-b72b1dc89c4d service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:34.514190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 775/1539] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:34:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:34:44.195061 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=70 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:44.510675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=33 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:04.860826 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1376c4-c69f-4878-85eb-01e05712787d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:04.862021 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1376c4-c69f-4878-85eb-01e05712787d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:04.862525 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1376c4-c69f-4878-85eb-01e05712787d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:04.863464 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63ef55-e434-48c6-a594-86ca064f81b2 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:04.863913 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63ef55-e434-48c6-a594-86ca064f81b2 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:04.864104 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63ef55-e434-48c6-a594-86ca064f81b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:04.895523 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-bb63ef55-e434-48c6-a594-86ca064f81b2 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:04.896767 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bb63ef55-e434-48c6-a594-86ca064f81b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:04.898390 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-fc1376c4-c69f-4878-85eb-01e05712787d None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:04.904322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fc1376c4-c69f-4878-85eb-01e05712787d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:04.912398 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 765/1540] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:04.913746 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 776/1541] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 02 13:36:04.920716 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52cbe4-dc57-4f36-b874-13dcd0c85b09 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:04.921060 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52cbe4-dc57-4f36-b874-13dcd0c85b09 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:04.921512 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52cbe4-dc57-4f36-b874-13dcd0c85b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:04.923033 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c6299-17f2-4a06-b428-be844811bfbc None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:04.923488 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c6299-17f2-4a06-b428-be844811bfbc None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:04.923775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c6299-17f2-4a06-b428-be844811bfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:04.953258 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e24c6299-17f2-4a06-b428-be844811bfbc None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:04.954880 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e24c6299-17f2-4a06-b428-be844811bfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:04.955355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9e52cbe4-dc57-4f36-b874-13dcd0c85b09 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:04.956810 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9e52cbe4-dc57-4f36-b874-13dcd0c85b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:04.965292 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 777/1542] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:36:04.967549 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a2c4a-e020-4790-a951-b2a7ed734cce None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:04.968080 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a2c4a-e020-4790-a951-b2a7ed734cce None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:04.968701 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a2c4a-e020-4790-a951-b2a7ed734cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:04.978101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 766/1543] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:04.978960 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52cbe4-dc57-4f36-b874-13dcd0c85b09 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:04.991021 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-696a2c4a-e020-4790-a951-b2a7ed734cce None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:04.994094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-696a2c4a-e020-4790-a951-b2a7ed734cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:04.999026 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52cbe4-dc57-4f36-b874-13dcd0c85b09 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.003089 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 778/1544] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:05.004441 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a2c4a-e020-4790-a951-b2a7ed734cce None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.017389 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a2c4a-e020-4790-a951-b2a7ed734cce None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.022488 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb78508-54fa-4057-940b-f3adcef62e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.023401 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb78508-54fa-4057-940b-f3adcef62e3e admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.024078 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb78508-54fa-4057-940b-f3adcef62e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.025983 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb78508-54fa-4057-940b-f3adcef62e3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.026948 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb78508-54fa-4057-940b-f3adcef62e3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:05.027473 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e787be1-897e-4395-8d32-c42bc6d30625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.027723 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb78508-54fa-4057-940b-f3adcef62e3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.028156 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e787be1-897e-4395-8d32-c42bc6d30625 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.028480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e787be1-897e-4395-8d32-c42bc6d30625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.028761 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e787be1-897e-4395-8d32-c42bc6d30625 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.029497 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e787be1-897e-4395-8d32-c42bc6d30625 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:05.029806 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e787be1-897e-4395-8d32-c42bc6d30625 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.030217 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: WARNING py.warnings [None req-afb78508-54fa-4057-940b-f3adcef62e3e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:36:05.030217 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: warnings.warn(msg) Jun 02 13:36:05.030217 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: Jun 02 13:36:05.031408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e787be1-897e-4395-8d32-c42bc6d30625 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.031860 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb78508-54fa-4057-940b-f3adcef62e3e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.047317 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 779/1545] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:05.049663 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ee1ad-cca1-4318-85b3-89b88d25c5f9 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.050164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ee1ad-cca1-4318-85b3-89b88d25c5f9 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.050670 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ee1ad-cca1-4318-85b3-89b88d25c5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.056542 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 767/1546] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:05.063330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e787be1-897e-4395-8d32-c42bc6d30625 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.080172 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e28ee1ad-cca1-4318-85b3-89b88d25c5f9 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:05.082272 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e28ee1ad-cca1-4318-85b3-89b88d25c5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:05.086928 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e787be1-897e-4395-8d32-c42bc6d30625 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.100726 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b78e5-7809-46bb-80e7-9f0d10556df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.101288 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 780/1547] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:05.101560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b78e5-7809-46bb-80e7-9f0d10556df8 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.101851 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b78e5-7809-46bb-80e7-9f0d10556df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.102364 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b78e5-7809-46bb-80e7-9f0d10556df8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.103352 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ee1ad-cca1-4318-85b3-89b88d25c5f9 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.106100 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b78e5-7809-46bb-80e7-9f0d10556df8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.107146 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: WARNING py.warnings [None req-fd0b78e5-7809-46bb-80e7-9f0d10556df8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:36:05.107146 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: warnings.warn(msg) Jun 02 13:36:05.107146 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: Jun 02 13:36:05.112565 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b78e5-7809-46bb-80e7-9f0d10556df8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.116422 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ee1ad-cca1-4318-85b3-89b88d25c5f9 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.122812 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f5511-2bbe-472b-8e57-c8b8431f370d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.123807 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f5511-2bbe-472b-8e57-c8b8431f370d admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.124328 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f5511-2bbe-472b-8e57-c8b8431f370d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.124843 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f5511-2bbe-472b-8e57-c8b8431f370d admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.125894 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f5511-2bbe-472b-8e57-c8b8431f370d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.128502 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f5511-2bbe-472b-8e57-c8b8431f370d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.163681 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 781/1548] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:36:05 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:05.164803 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 768/1549] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:36:05 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:05.165596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238102b1-3807-425f-9e73-58fc2eebaf88 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.166021 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238102b1-3807-425f-9e73-58fc2eebaf88 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.166312 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238102b1-3807-425f-9e73-58fc2eebaf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.169074 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a675db-a0c6-43c9-8545-bb0b05a97352 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.169367 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a675db-a0c6-43c9-8545-bb0b05a97352 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.169654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a675db-a0c6-43c9-8545-bb0b05a97352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.184813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-238102b1-3807-425f-9e73-58fc2eebaf88 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:05.186002 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-238102b1-3807-425f-9e73-58fc2eebaf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:05.188623 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f0a675db-a0c6-43c9-8545-bb0b05a97352 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:05.189800 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f0a675db-a0c6-43c9-8545-bb0b05a97352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:05.246019 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 782/1550] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:05.247106 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238102b1-3807-425f-9e73-58fc2eebaf88 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.250206 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 769/1551] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:05.251472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2284c-142e-4ce6-8d6f-cd822e73a32d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.251875 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2284c-142e-4ce6-8d6f-cd822e73a32d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.252163 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2284c-142e-4ce6-8d6f-cd822e73a32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.262617 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238102b1-3807-425f-9e73-58fc2eebaf88 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.267128 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655a979-5c22-4608-97a0-e0014221e424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.267781 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655a979-5c22-4608-97a0-e0014221e424 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.268064 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655a979-5c22-4608-97a0-e0014221e424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.268366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655a979-5c22-4608-97a0-e0014221e424 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.269094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655a979-5c22-4608-97a0-e0014221e424 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:05.269428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655a979-5c22-4608-97a0-e0014221e424 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.271025 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655a979-5c22-4608-97a0-e0014221e424 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.274627 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-87c2284c-142e-4ce6-8d6f-cd822e73a32d None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:05.275817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-87c2284c-142e-4ce6-8d6f-cd822e73a32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:05.282881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 783/1552] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:05.283896 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 770/1553] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:05.284995 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d4f45-4f46-43c5-a8cb-7e7686aa46e1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.285280 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d4f45-4f46-43c5-a8cb-7e7686aa46e1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.285552 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d4f45-4f46-43c5-a8cb-7e7686aa46e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.291776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e745ec-6521-4b63-9445-99061bbe8121 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.292177 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e745ec-6521-4b63-9445-99061bbe8121 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.292406 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e745ec-6521-4b63-9445-99061bbe8121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.307516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-566d4f45-4f46-43c5-a8cb-7e7686aa46e1 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:05.308727 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-566d4f45-4f46-43c5-a8cb-7e7686aa46e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:05.310193 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-66e745ec-6521-4b63-9445-99061bbe8121 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:05.311658 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-66e745ec-6521-4b63-9445-99061bbe8121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:05.316379 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 771/1554] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:05.320606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d4f45-4f46-43c5-a8cb-7e7686aa46e1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.322806 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 784/1555] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:05.323791 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e745ec-6521-4b63-9445-99061bbe8121 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.328522 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d4f45-4f46-43c5-a8cb-7e7686aa46e1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.333556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e745ec-6521-4b63-9445-99061bbe8121 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.333803 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beecb41-24bd-40e7-9a04-e6a8795020ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.334511 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beecb41-24bd-40e7-9a04-e6a8795020ef admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.334728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beecb41-24bd-40e7-9a04-e6a8795020ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.335029 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beecb41-24bd-40e7-9a04-e6a8795020ef admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.335769 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beecb41-24bd-40e7-9a04-e6a8795020ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.337739 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beecb41-24bd-40e7-9a04-e6a8795020ef admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.338035 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d258ee-069b-4756-9303-c9fd0d01653d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.338703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d258ee-069b-4756-9303-c9fd0d01653d admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.338992 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d258ee-069b-4756-9303-c9fd0d01653d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.339268 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d258ee-069b-4756-9303-c9fd0d01653d admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.339952 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d258ee-069b-4756-9303-c9fd0d01653d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.340980 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: WARNING py.warnings [None req-28d258ee-069b-4756-9303-c9fd0d01653d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:36:05.340980 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: warnings.warn(msg) Jun 02 13:36:05.340980 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: Jun 02 13:36:05.342166 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d258ee-069b-4756-9303-c9fd0d01653d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.359574 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 772/1556] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:36:05 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:05.360850 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21a913-1971-4de4-90f2-8ce7009ae86a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.361138 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21a913-1971-4de4-90f2-8ce7009ae86a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.361414 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21a913-1971-4de4-90f2-8ce7009ae86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.366498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 785/1557] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:36:05 2022] POST /identity/v3/users => generated 283 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:05.366498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be302671-e0b0-4219-bb5d-ae56b28d454c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.366498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be302671-e0b0-4219-bb5d-ae56b28d454c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.366498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be302671-e0b0-4219-bb5d-ae56b28d454c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.380024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6b21a913-1971-4de4-90f2-8ce7009ae86a None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:05.381241 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6b21a913-1971-4de4-90f2-8ce7009ae86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:05.383964 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-be302671-e0b0-4219-bb5d-ae56b28d454c None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:05.385149 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-be302671-e0b0-4219-bb5d-ae56b28d454c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:05.389054 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 773/1558] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:05.389793 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21a913-1971-4de4-90f2-8ce7009ae86a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.393023 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 786/1559] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:05.394286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fb91f-a8fb-48b9-aa8b-05293385c6a1 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.394568 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fb91f-a8fb-48b9-aa8b-05293385c6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.394965 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fb91f-a8fb-48b9-aa8b-05293385c6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.399486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21a913-1971-4de4-90f2-8ce7009ae86a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.404013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c21b0e-6237-4896-abc2-3ad585f0725c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.404687 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c21b0e-6237-4896-abc2-3ad585f0725c admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.404969 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c21b0e-6237-4896-abc2-3ad585f0725c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.405242 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c21b0e-6237-4896-abc2-3ad585f0725c admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.405930 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c21b0e-6237-4896-abc2-3ad585f0725c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.407876 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c21b0e-6237-4896-abc2-3ad585f0725c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.412718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-1d8fb91f-a8fb-48b9-aa8b-05293385c6a1 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:05.413942 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1d8fb91f-a8fb-48b9-aa8b-05293385c6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:05.422595 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 787/1560] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:05.426196 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f17267-c41c-4550-a58c-84825fefb5ef None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.426196 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f17267-c41c-4550-a58c-84825fefb5ef None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.426196 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f17267-c41c-4550-a58c-84825fefb5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.440274 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 774/1561] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:36:05 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:05.440274 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a69a2-b723-44a4-a10c-3daf762ea356 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.440274 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a69a2-b723-44a4-a10c-3daf762ea356 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.440274 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a69a2-b723-44a4-a10c-3daf762ea356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.446601 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-58f17267-c41c-4550-a58c-84825fefb5ef None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:05.447777 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-58f17267-c41c-4550-a58c-84825fefb5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:05.456827 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-720a69a2-b723-44a4-a10c-3daf762ea356 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:05.458045 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-720a69a2-b723-44a4-a10c-3daf762ea356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:05.492321 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:05.506296 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:05.510310 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 788/1562] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:05.511052 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f17267-c41c-4550-a58c-84825fefb5ef None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.520129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f17267-c41c-4550-a58c-84825fefb5ef None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.523282 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 775/1563] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:05.524144 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a69a2-b723-44a4-a10c-3daf762ea356 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.525129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b08d2-eb70-45bd-b8da-7668c5366a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.525778 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b08d2-eb70-45bd-b8da-7668c5366a0e admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.526067 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b08d2-eb70-45bd-b8da-7668c5366a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.526364 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b08d2-eb70-45bd-b8da-7668c5366a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.527072 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b08d2-eb70-45bd-b8da-7668c5366a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.528714 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b08d2-eb70-45bd-b8da-7668c5366a0e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.533510 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a69a2-b723-44a4-a10c-3daf762ea356 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.538126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf214c-89d5-4168-b015-fd9b29c907db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.538825 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf214c-89d5-4168-b015-fd9b29c907db admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.539075 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 789/1564] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:05.539211 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf214c-89d5-4168-b015-fd9b29c907db admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.540023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf214c-89d5-4168-b015-fd9b29c907db admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.540506 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b08d2-eb70-45bd-b8da-7668c5366a0e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.540926 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf214c-89d5-4168-b015-fd9b29c907db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.542827 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf214c-89d5-4168-b015-fd9b29c907db admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.549884 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b08d2-eb70-45bd-b8da-7668c5366a0e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.555859 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 776/1565] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:05.555859 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf214c-89d5-4168-b015-fd9b29c907db admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.556116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fedbe4-069f-4163-b652-6e5b91db00a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.556116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fedbe4-069f-4163-b652-6e5b91db00a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.556116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fedbe4-069f-4163-b652-6e5b91db00a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.556116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fedbe4-069f-4163-b652-6e5b91db00a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.556682 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fedbe4-069f-4163-b652-6e5b91db00a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:05.556988 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fedbe4-069f-4163-b652-6e5b91db00a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.558560 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fedbe4-069f-4163-b652-6e5b91db00a5 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.563072 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf214c-89d5-4168-b015-fd9b29c907db admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.567527 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad17d4-fb56-4244-be9f-f3fe0140383b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.568148 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad17d4-fb56-4244-be9f-f3fe0140383b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.568464 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad17d4-fb56-4244-be9f-f3fe0140383b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.568741 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad17d4-fb56-4244-be9f-f3fe0140383b admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.569447 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad17d4-fb56-4244-be9f-f3fe0140383b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:05.569753 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad17d4-fb56-4244-be9f-f3fe0140383b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.571399 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 790/1566] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:05.571876 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad17d4-fb56-4244-be9f-f3fe0140383b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.572408 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fedbe4-069f-4163-b652-6e5b91db00a5 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.583427 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fedbe4-069f-4163-b652-6e5b91db00a5 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.588884 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 777/1567] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:05.588884 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad17d4-fb56-4244-be9f-f3fe0140383b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.591747 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79792e15-0b40-4fc5-b013-67aac5e0eccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.592414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79792e15-0b40-4fc5-b013-67aac5e0eccf admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.592699 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79792e15-0b40-4fc5-b013-67aac5e0eccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.592973 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79792e15-0b40-4fc5-b013-67aac5e0eccf admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.593696 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79792e15-0b40-4fc5-b013-67aac5e0eccf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:05.594003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79792e15-0b40-4fc5-b013-67aac5e0eccf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.595583 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79792e15-0b40-4fc5-b013-67aac5e0eccf admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.597587 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad17d4-fb56-4244-be9f-f3fe0140383b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.602176 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e86fd3-cbb7-4801-aaec-ff149103dda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.602813 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e86fd3-cbb7-4801-aaec-ff149103dda7 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.603094 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e86fd3-cbb7-4801-aaec-ff149103dda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.603369 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e86fd3-cbb7-4801-aaec-ff149103dda7 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.604048 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e86fd3-cbb7-4801-aaec-ff149103dda7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.605990 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e86fd3-cbb7-4801-aaec-ff149103dda7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.614690 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 791/1568] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:05.614690 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79792e15-0b40-4fc5-b013-67aac5e0eccf admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.624356 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79792e15-0b40-4fc5-b013-67aac5e0eccf admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.626664 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 778/1569] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:36:05 2022] POST /identity/v3/users => generated 296 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:05.628836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe347d7-f094-46b1-9090-a1acaa0235d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.629342 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e86fd3-cbb7-4801-aaec-ff149103dda7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.629523 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe347d7-f094-46b1-9090-a1acaa0235d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.629753 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe347d7-f094-46b1-9090-a1acaa0235d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.630100 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe347d7-f094-46b1-9090-a1acaa0235d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.630756 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe347d7-f094-46b1-9090-a1acaa0235d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:05.631089 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe347d7-f094-46b1-9090-a1acaa0235d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.632771 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe347d7-f094-46b1-9090-a1acaa0235d4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.639543 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e86fd3-cbb7-4801-aaec-ff149103dda7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.644206 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85296d46-37bd-4dc4-b457-0a7278126ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.644866 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85296d46-37bd-4dc4-b457-0a7278126ebb admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.645267 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85296d46-37bd-4dc4-b457-0a7278126ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.645550 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85296d46-37bd-4dc4-b457-0a7278126ebb admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.645782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 792/1570] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:05.646577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe347d7-f094-46b1-9090-a1acaa0235d4 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.653075 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85296d46-37bd-4dc4-b457-0a7278126ebb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:05.653465 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85296d46-37bd-4dc4-b457-0a7278126ebb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.655158 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85296d46-37bd-4dc4-b457-0a7278126ebb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.655920 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe347d7-f094-46b1-9090-a1acaa0235d4 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.660458 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7b691-a00c-4fd1-8dc0-2d1ea3291cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.661096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7b691-a00c-4fd1-8dc0-2d1ea3291cfa admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.661380 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7b691-a00c-4fd1-8dc0-2d1ea3291cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.661654 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7b691-a00c-4fd1-8dc0-2d1ea3291cfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.662374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c7b691-a00c-4fd1-8dc0-2d1ea3291cfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.663969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c7b691-a00c-4fd1-8dc0-2d1ea3291cfa admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.667580 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 779/1571] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:05.668636 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85296d46-37bd-4dc4-b457-0a7278126ebb admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.679549 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85296d46-37bd-4dc4-b457-0a7278126ebb admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.683324 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 793/1572] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:05.683324 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7b691-a00c-4fd1-8dc0-2d1ea3291cfa admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.685112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf230aa-2b65-46cd-b1bf-0fc4556d5cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.685754 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf230aa-2b65-46cd-b1bf-0fc4556d5cfc admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.686037 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf230aa-2b65-46cd-b1bf-0fc4556d5cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.686317 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf230aa-2b65-46cd-b1bf-0fc4556d5cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.687036 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf230aa-2b65-46cd-b1bf-0fc4556d5cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.688653 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf230aa-2b65-46cd-b1bf-0fc4556d5cfc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.690898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7b691-a00c-4fd1-8dc0-2d1ea3291cfa admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.695404 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db12be-bee4-409e-b22e-bf03316e23c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.696682 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db12be-bee4-409e-b22e-bf03316e23c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.696968 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db12be-bee4-409e-b22e-bf03316e23c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.697242 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db12be-bee4-409e-b22e-bf03316e23c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.697917 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db12be-bee4-409e-b22e-bf03316e23c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.699771 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 780/1573] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:05.699895 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db12be-bee4-409e-b22e-bf03316e23c9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.700445 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf230aa-2b65-46cd-b1bf-0fc4556d5cfc admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.710098 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf230aa-2b65-46cd-b1bf-0fc4556d5cfc admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.715257 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eab226-cf8e-47eb-8633-9921ab35bbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.715723 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eab226-cf8e-47eb-8633-9921ab35bbfa admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.716020 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eab226-cf8e-47eb-8633-9921ab35bbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.716289 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eab226-cf8e-47eb-8633-9921ab35bbfa admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.716999 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eab226-cf8e-47eb-8633-9921ab35bbfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.718957 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eab226-cf8e-47eb-8633-9921ab35bbfa admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.727326 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 794/1574] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:36:05 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:05.728190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db12be-bee4-409e-b22e-bf03316e23c9 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.745744 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 781/1575] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:36:05 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:05.746652 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eab226-cf8e-47eb-8633-9921ab35bbfa admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.795662 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db12be-bee4-409e-b22e-bf03316e23c9 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.807211 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eab226-cf8e-47eb-8633-9921ab35bbfa admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.811783 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dadc855-bd76-406f-b288-fe6cc5a164c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.812475 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadc855-bd76-406f-b288-fe6cc5a164c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.812767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadc855-bd76-406f-b288-fe6cc5a164c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.813053 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadc855-bd76-406f-b288-fe6cc5a164c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.813780 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dadc855-bd76-406f-b288-fe6cc5a164c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.815397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dadc855-bd76-406f-b288-fe6cc5a164c9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.825719 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 782/1576] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:05.826484 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dadc855-bd76-406f-b288-fe6cc5a164c9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.837915 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dadc855-bd76-406f-b288-fe6cc5a164c9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.842589 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251981c-bee6-4396-812a-94b8d1375084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.843218 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251981c-bee6-4396-812a-94b8d1375084 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.843498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251981c-bee6-4396-812a-94b8d1375084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.843773 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251981c-bee6-4396-812a-94b8d1375084 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.844491 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251981c-bee6-4396-812a-94b8d1375084 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.846379 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251981c-bee6-4396-812a-94b8d1375084 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.858810 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac9ea6-ece7-4b4a-a2d5-68d7be9ce026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.859532 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac9ea6-ece7-4b4a-a2d5-68d7be9ce026 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.859899 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac9ea6-ece7-4b4a-a2d5-68d7be9ce026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.860235 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac9ea6-ece7-4b4a-a2d5-68d7be9ce026 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.861178 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac9ea6-ece7-4b4a-a2d5-68d7be9ce026 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.864069 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac9ea6-ece7-4b4a-a2d5-68d7be9ce026 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.879964 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 783/1577] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:36:05 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:05.882398 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251981c-bee6-4396-812a-94b8d1375084 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.897356 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:05.908994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 795/1578] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:36:05 2022] POST /identity/v3/projects => generated 379 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:05.908994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac9ea6-ece7-4b4a-a2d5-68d7be9ce026 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.932136 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:05.952763 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251981c-bee6-4396-812a-94b8d1375084 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.974964 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac9ea6-ece7-4b4a-a2d5-68d7be9ce026 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.980113 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc403f97-e2ea-4416-8ddc-fefecae1ac74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.981098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc403f97-e2ea-4416-8ddc-fefecae1ac74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.981380 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc403f97-e2ea-4416-8ddc-fefecae1ac74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.981675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc403f97-e2ea-4416-8ddc-fefecae1ac74 admin admin] PATH_INFO: `/v3/projects/2ec1f7a889c54e229309d8c428f6dcfd/users/bc9c9923528b4d559266950a0509f9d9/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.996558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc403f97-e2ea-4416-8ddc-fefecae1ac74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ec1f7a889c54e229309d8c428f6dcfd, user_id=bc9c9923528b4d559266950a0509f9d9, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.999268 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc403f97-e2ea-4416-8ddc-fefecae1ac74 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.012821 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1a6a0-2133-43d8-a409-753d5551f9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.013030 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 796/1579] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:05 2022] PUT /identity/v3/projects/2ec1f7a889c54e229309d8c428f6dcfd/users/bc9c9923528b4d559266950a0509f9d9/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:06.013249 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1a6a0-2133-43d8-a409-753d5551f9b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.013515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc403f97-e2ea-4416-8ddc-fefecae1ac74 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.013650 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1a6a0-2133-43d8-a409-753d5551f9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.013877 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1a6a0-2133-43d8-a409-753d5551f9b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.014507 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1a6a0-2133-43d8-a409-753d5551f9b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.016571 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1a6a0-2133-43d8-a409-753d5551f9b4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.043510 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 784/1580] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:36:05 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:06.044355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1a6a0-2133-43d8-a409-753d5551f9b4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.077611 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc403f97-e2ea-4416-8ddc-fefecae1ac74 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.107055 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1a6a0-2133-43d8-a409-753d5551f9b4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.111649 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ec414-c0dd-4dfa-83cc-e23a1d0556e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.112318 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ec414-c0dd-4dfa-83cc-e23a1d0556e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.112606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ec414-c0dd-4dfa-83cc-e23a1d0556e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.112881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ec414-c0dd-4dfa-83cc-e23a1d0556e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.113560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ec414-c0dd-4dfa-83cc-e23a1d0556e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.115467 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ec414-c0dd-4dfa-83cc-e23a1d0556e5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.134303 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e491f-90de-4c7f-b0ac-25ff65fce73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.135118 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e491f-90de-4c7f-b0ac-25ff65fce73a admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.135395 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e491f-90de-4c7f-b0ac-25ff65fce73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.135672 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e491f-90de-4c7f-b0ac-25ff65fce73a admin admin] PATH_INFO: `/v3/projects/1c152733c0654735a480fa000e25c4c2/users/e01e44631ee14a2480b4673cf47bb0dc/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.135812 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 785/1581] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:36:06 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:06.136610 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ec414-c0dd-4dfa-83cc-e23a1d0556e5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.145816 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ec414-c0dd-4dfa-83cc-e23a1d0556e5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.151409 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e491f-90de-4c7f-b0ac-25ff65fce73a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c152733c0654735a480fa000e25c4c2, user_id=e01e44631ee14a2480b4673cf47bb0dc, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.151557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5a462-922d-4628-a1c9-93105cfcc846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.152080 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5a462-922d-4628-a1c9-93105cfcc846 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.152402 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5a462-922d-4628-a1c9-93105cfcc846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.152686 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5a462-922d-4628-a1c9-93105cfcc846 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.153362 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5a462-922d-4628-a1c9-93105cfcc846 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.154077 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e491f-90de-4c7f-b0ac-25ff65fce73a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.155254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5a462-922d-4628-a1c9-93105cfcc846 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.167341 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 797/1582] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:06 2022] PUT /identity/v3/projects/1c152733c0654735a480fa000e25c4c2/users/e01e44631ee14a2480b4673cf47bb0dc/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:06.168470 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e491f-90de-4c7f-b0ac-25ff65fce73a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.180226 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 786/1583] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:36:06 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:06.181630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5a462-922d-4628-a1c9-93105cfcc846 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.186714 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:06.191492 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5a462-922d-4628-a1c9-93105cfcc846 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.233561 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:06.237620 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e491f-90de-4c7f-b0ac-25ff65fce73a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.242560 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6f5c8-7750-469c-898b-6c401f7b7d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.243864 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6f5c8-7750-469c-898b-6c401f7b7d5a admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.244276 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6f5c8-7750-469c-898b-6c401f7b7d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.244630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6f5c8-7750-469c-898b-6c401f7b7d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.245368 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce6f5c8-7750-469c-898b-6c401f7b7d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.247012 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce6f5c8-7750-469c-898b-6c401f7b7d5a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.250879 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a88d1-db2e-4c64-8284-f091a25cd982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.251544 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a88d1-db2e-4c64-8284-f091a25cd982 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.251828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a88d1-db2e-4c64-8284-f091a25cd982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.252110 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a88d1-db2e-4c64-8284-f091a25cd982 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.252820 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a88d1-db2e-4c64-8284-f091a25cd982 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.254727 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a88d1-db2e-4c64-8284-f091a25cd982 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.256939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 798/1584] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:06.257716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6f5c8-7750-469c-898b-6c401f7b7d5a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.269854 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6f5c8-7750-469c-898b-6c401f7b7d5a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.277459 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 787/1585] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:36:06 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:06.277638 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c5784-9192-45f1-aa96-0a0d8bffa356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.277638 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c5784-9192-45f1-aa96-0a0d8bffa356 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.277638 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c5784-9192-45f1-aa96-0a0d8bffa356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.277638 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c5784-9192-45f1-aa96-0a0d8bffa356 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.277966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07c00f-a798-4ec3-a038-831c5d614b85 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.277966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07c00f-a798-4ec3-a038-831c5d614b85 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.277966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07c00f-a798-4ec3-a038-831c5d614b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.278188 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c5784-9192-45f1-aa96-0a0d8bffa356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.278609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c5784-9192-45f1-aa96-0a0d8bffa356 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.302464 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 799/1586] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:36:06 2022] POST /identity/v3/users => generated 290 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:06.302464 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c5784-9192-45f1-aa96-0a0d8bffa356 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.303742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-df07c00f-a798-4ec3-a038-831c5d614b85 None None] MFA Rules not processed for user `bc9c9923528b4d559266950a0509f9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:06.305001 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-df07c00f-a798-4ec3-a038-831c5d614b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:06.312676 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c5784-9192-45f1-aa96-0a0d8bffa356 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.322775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dce858-7b7c-4fd6-9255-f5cf4d9abb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.323474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dce858-7b7c-4fd6-9255-f5cf4d9abb51 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.323766 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dce858-7b7c-4fd6-9255-f5cf4d9abb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.324046 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dce858-7b7c-4fd6-9255-f5cf4d9abb51 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.324778 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dce858-7b7c-4fd6-9255-f5cf4d9abb51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.326727 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dce858-7b7c-4fd6-9255-f5cf4d9abb51 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.347886 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 800/1587] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:36:06 2022] POST /identity/v3/users => generated 293 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:06.348954 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dce858-7b7c-4fd6-9255-f5cf4d9abb51 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.359164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dce858-7b7c-4fd6-9255-f5cf4d9abb51 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.363693 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78c791-9cf5-4a55-93a7-43523a7b940b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.364360 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78c791-9cf5-4a55-93a7-43523a7b940b admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.364653 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78c791-9cf5-4a55-93a7-43523a7b940b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.364933 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78c791-9cf5-4a55-93a7-43523a7b940b admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.365655 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78c791-9cf5-4a55-93a7-43523a7b940b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.367235 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78c791-9cf5-4a55-93a7-43523a7b940b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.371377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 788/1588] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:06.372825 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdbfc2-6311-49d6-8194-5689e0683b2c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.373456 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdbfc2-6311-49d6-8194-5689e0683b2c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.373456 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdbfc2-6311-49d6-8194-5689e0683b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.378284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 801/1589] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:06.379094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78c791-9cf5-4a55-93a7-43523a7b940b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.388524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78c791-9cf5-4a55-93a7-43523a7b940b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.393030 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647a137-cc2c-4f90-9140-0acbd22703eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.393660 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647a137-cc2c-4f90-9140-0acbd22703eb admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.393947 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647a137-cc2c-4f90-9140-0acbd22703eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.394230 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647a137-cc2c-4f90-9140-0acbd22703eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.394956 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647a137-cc2c-4f90-9140-0acbd22703eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.396561 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647a137-cc2c-4f90-9140-0acbd22703eb admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.403221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2ffdbfc2-6311-49d6-8194-5689e0683b2c None None] MFA Rules not processed for user `e01e44631ee14a2480b4673cf47bb0dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:06.405080 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2ffdbfc2-6311-49d6-8194-5689e0683b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:06.406904 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 802/1590] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:06.410518 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647a137-cc2c-4f90-9140-0acbd22703eb admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.420535 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647a137-cc2c-4f90-9140-0acbd22703eb admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.425121 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251476be-d1da-457a-9b81-7d389a7fd8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.425966 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251476be-d1da-457a-9b81-7d389a7fd8b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.426250 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251476be-d1da-457a-9b81-7d389a7fd8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.426526 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251476be-d1da-457a-9b81-7d389a7fd8b4 admin admin] PATH_INFO: `/v3/projects/ff89a4ee01d444d2aee3bdc9199d556f/users/b92da35ea7c946ea876b13b13ed98258/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.440767 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251476be-d1da-457a-9b81-7d389a7fd8b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff89a4ee01d444d2aee3bdc9199d556f, user_id=b92da35ea7c946ea876b13b13ed98258, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.443417 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251476be-d1da-457a-9b81-7d389a7fd8b4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.456570 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 803/1591] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:06 2022] PUT /identity/v3/projects/ff89a4ee01d444d2aee3bdc9199d556f/users/b92da35ea7c946ea876b13b13ed98258/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:06.457422 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251476be-d1da-457a-9b81-7d389a7fd8b4 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.470494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 789/1592] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:06.471337 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdbfc2-6311-49d6-8194-5689e0683b2c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.481970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdbfc2-6311-49d6-8194-5689e0683b2c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.525267 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251476be-d1da-457a-9b81-7d389a7fd8b4 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.529066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:06.530121 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f38640-66c3-467e-9390-803269fa889e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.530825 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f38640-66c3-467e-9390-803269fa889e admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.531093 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f38640-66c3-467e-9390-803269fa889e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.531390 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f38640-66c3-467e-9390-803269fa889e admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.532056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f38640-66c3-467e-9390-803269fa889e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.533820 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f38640-66c3-467e-9390-803269fa889e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.541582 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eae7dd-54af-4476-887c-967c8d1d5755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.542243 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eae7dd-54af-4476-887c-967c8d1d5755 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.542526 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eae7dd-54af-4476-887c-967c8d1d5755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.542803 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eae7dd-54af-4476-887c-967c8d1d5755 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.543557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eae7dd-54af-4476-887c-967c8d1d5755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.544156 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 804/1593] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:06.545109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f38640-66c3-467e-9390-803269fa889e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.545486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eae7dd-54af-4476-887c-967c8d1d5755 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.554225 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f38640-66c3-467e-9390-803269fa889e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.556662 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 790/1594] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:06.557460 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eae7dd-54af-4476-887c-967c8d1d5755 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.558944 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d6a6c-ee26-4042-9a3a-f76a92316567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.559580 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d6a6c-ee26-4042-9a3a-f76a92316567 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.559866 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d6a6c-ee26-4042-9a3a-f76a92316567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.560145 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d6a6c-ee26-4042-9a3a-f76a92316567 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.560899 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d6a6c-ee26-4042-9a3a-f76a92316567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.562478 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d6a6c-ee26-4042-9a3a-f76a92316567 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.568851 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eae7dd-54af-4476-887c-967c8d1d5755 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.572682 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 805/1595] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:06.573591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d6a6c-ee26-4042-9a3a-f76a92316567 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.573752 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759c6a7-3e6a-4a05-b0a0-d3c4acbe1434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.574395 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759c6a7-3e6a-4a05-b0a0-d3c4acbe1434 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.574683 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759c6a7-3e6a-4a05-b0a0-d3c4acbe1434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.574966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759c6a7-3e6a-4a05-b0a0-d3c4acbe1434 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.575693 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759c6a7-3e6a-4a05-b0a0-d3c4acbe1434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.577630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759c6a7-3e6a-4a05-b0a0-d3c4acbe1434 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.584701 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d6a6c-ee26-4042-9a3a-f76a92316567 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.590655 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb4685-d750-44c4-8534-3772cb4d70c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.591289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb4685-d750-44c4-8534-3772cb4d70c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.591575 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb4685-d750-44c4-8534-3772cb4d70c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.591858 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb4685-d750-44c4-8534-3772cb4d70c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.592965 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb4685-d750-44c4-8534-3772cb4d70c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.594403 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb4685-d750-44c4-8534-3772cb4d70c6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.599969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:06.605358 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 791/1596] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:36:06 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:06.606447 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759c6a7-3e6a-4a05-b0a0-d3c4acbe1434 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.610077 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 806/1597] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:06.611320 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808e38e-3b0b-43ae-949a-b60fe829c67d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.611691 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808e38e-3b0b-43ae-949a-b60fe829c67d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.612044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808e38e-3b0b-43ae-949a-b60fe829c67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.628480 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a808e38e-3b0b-43ae-949a-b60fe829c67d None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:06.629704 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a808e38e-3b0b-43ae-949a-b60fe829c67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:06.670915 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759c6a7-3e6a-4a05-b0a0-d3c4acbe1434 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.675575 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c271cf-e0b6-47bb-a25a-a19fc96a162a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.676376 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c271cf-e0b6-47bb-a25a-a19fc96a162a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.676683 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c271cf-e0b6-47bb-a25a-a19fc96a162a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.677016 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c271cf-e0b6-47bb-a25a-a19fc96a162a admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.677751 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c271cf-e0b6-47bb-a25a-a19fc96a162a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.679512 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c271cf-e0b6-47bb-a25a-a19fc96a162a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.689242 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 792/1598] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:06.690017 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c271cf-e0b6-47bb-a25a-a19fc96a162a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.694860 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 807/1599] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:06.694860 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808e38e-3b0b-43ae-949a-b60fe829c67d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.699959 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c271cf-e0b6-47bb-a25a-a19fc96a162a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.702467 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808e38e-3b0b-43ae-949a-b60fe829c67d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.706769 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b296376-539b-4d50-9a6d-3f35bc906736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.707414 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b296376-539b-4d50-9a6d-3f35bc906736 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.707531 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20b7d2-3054-45d3-b7d8-07df2d3ff442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.707698 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b296376-539b-4d50-9a6d-3f35bc906736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.707982 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b296376-539b-4d50-9a6d-3f35bc906736 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.708154 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20b7d2-3054-45d3-b7d8-07df2d3ff442 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.708468 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20b7d2-3054-45d3-b7d8-07df2d3ff442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.708704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b296376-539b-4d50-9a6d-3f35bc906736 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.708806 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20b7d2-3054-45d3-b7d8-07df2d3ff442 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.709462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20b7d2-3054-45d3-b7d8-07df2d3ff442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.710609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b296376-539b-4d50-9a6d-3f35bc906736 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.711032 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20b7d2-3054-45d3-b7d8-07df2d3ff442 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.721722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 808/1600] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:06.722583 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20b7d2-3054-45d3-b7d8-07df2d3ff442 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.733725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20b7d2-3054-45d3-b7d8-07df2d3ff442 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.738327 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 793/1601] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:36:06 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:06.738471 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fa9b1-b705-41ca-a2a3-3442c08b9439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.739055 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fa9b1-b705-41ca-a2a3-3442c08b9439 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.739341 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fa9b1-b705-41ca-a2a3-3442c08b9439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.739622 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fa9b1-b705-41ca-a2a3-3442c08b9439 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.739876 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b296376-539b-4d50-9a6d-3f35bc906736 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.740385 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380fa9b1-b705-41ca-a2a3-3442c08b9439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.742009 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380fa9b1-b705-41ca-a2a3-3442c08b9439 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.752549 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 809/1602] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:06.753404 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fa9b1-b705-41ca-a2a3-3442c08b9439 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.763314 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fa9b1-b705-41ca-a2a3-3442c08b9439 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.800935 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b296376-539b-4d50-9a6d-3f35bc906736 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.805748 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3db658-baaf-4466-a4ba-cc522b348b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.806561 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3db658-baaf-4466-a4ba-cc522b348b0f admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.806846 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3db658-baaf-4466-a4ba-cc522b348b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.807127 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3db658-baaf-4466-a4ba-cc522b348b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.807983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3db658-baaf-4466-a4ba-cc522b348b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.809661 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3db658-baaf-4466-a4ba-cc522b348b0f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.818511 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82c1e5-eea3-46e2-a854-e8be1446a1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.819245 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82c1e5-eea3-46e2-a854-e8be1446a1f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.819749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82c1e5-eea3-46e2-a854-e8be1446a1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.819879 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 794/1603] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:06.819977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82c1e5-eea3-46e2-a854-e8be1446a1f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.820437 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3db658-baaf-4466-a4ba-cc522b348b0f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.821345 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82c1e5-eea3-46e2-a854-e8be1446a1f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.823447 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82c1e5-eea3-46e2-a854-e8be1446a1f1 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.830104 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3db658-baaf-4466-a4ba-cc522b348b0f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.835478 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420463c1-d6fb-4a59-8725-67e2ba8be45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.837138 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420463c1-d6fb-4a59-8725-67e2ba8be45f admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.837406 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420463c1-d6fb-4a59-8725-67e2ba8be45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.837714 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420463c1-d6fb-4a59-8725-67e2ba8be45f admin admin] PATH_INFO: `/v3/projects/80d19e08e8794466b6ab5de018413367/users/9a693f4cc3b14bb49bfc2d55b51a0741/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.844422 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 810/1604] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:36:06 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:06.845256 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82c1e5-eea3-46e2-a854-e8be1446a1f1 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.853828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420463c1-d6fb-4a59-8725-67e2ba8be45f admin admin] RBAC: Authorizing `identity:create_grant(project_id=80d19e08e8794466b6ab5de018413367, user_id=9a693f4cc3b14bb49bfc2d55b51a0741, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.854881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: WARNING py.warnings [None req-420463c1-d6fb-4a59-8725-67e2ba8be45f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:36:06.854881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: warnings.warn(msg) Jun 02 13:36:06.854881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: Jun 02 13:36:06.855368 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82c1e5-eea3-46e2-a854-e8be1446a1f1 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.856918 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420463c1-d6fb-4a59-8725-67e2ba8be45f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.860526 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b32c5c-58d2-4ed3-b238-93283a75792b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.861405 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b32c5c-58d2-4ed3-b238-93283a75792b admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.861691 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b32c5c-58d2-4ed3-b238-93283a75792b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.862257 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b32c5c-58d2-4ed3-b238-93283a75792b admin admin] PATH_INFO: `/v3/projects/39255fa001f44b29a23006adf9c1a10d/users/4e88422338024035b5c64d2788965086/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.871365 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 795/1605] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:06 2022] PUT /identity/v3/projects/80d19e08e8794466b6ab5de018413367/users/9a693f4cc3b14bb49bfc2d55b51a0741/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:06.872179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420463c1-d6fb-4a59-8725-67e2ba8be45f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.877446 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b32c5c-58d2-4ed3-b238-93283a75792b admin admin] RBAC: Authorizing `identity:create_grant(project_id=39255fa001f44b29a23006adf9c1a10d, user_id=4e88422338024035b5c64d2788965086, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.880174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b32c5c-58d2-4ed3-b238-93283a75792b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.893979 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 811/1606] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:06 2022] PUT /identity/v3/projects/39255fa001f44b29a23006adf9c1a10d/users/4e88422338024035b5c64d2788965086/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:06.896949 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:06.898218 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b32c5c-58d2-4ed3-b238-93283a75792b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.942579 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420463c1-d6fb-4a59-8725-67e2ba8be45f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.945505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:06.963801 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b32c5c-58d2-4ed3-b238-93283a75792b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.968552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4af136-f36a-4b32-87e6-296e2dbd01f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.969720 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4af136-f36a-4b32-87e6-296e2dbd01f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.969999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4af136-f36a-4b32-87e6-296e2dbd01f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.970271 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4af136-f36a-4b32-87e6-296e2dbd01f4 admin admin] PATH_INFO: `/v3/projects/8e9e2d5c93274eb781bd76912178bae6/users/88bc03c141d64772b606e087d86e973e/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.985626 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4af136-f36a-4b32-87e6-296e2dbd01f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e9e2d5c93274eb781bd76912178bae6, user_id=88bc03c141d64772b606e087d86e973e, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.988291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4af136-f36a-4b32-87e6-296e2dbd01f4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.996526 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5b5ef-080d-4923-9f77-c0648873d4f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.997188 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5b5ef-080d-4923-9f77-c0648873d4f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.997474 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5b5ef-080d-4923-9f77-c0648873d4f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.997750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5b5ef-080d-4923-9f77-c0648873d4f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.002087 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 812/1607] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:06 2022] PUT /identity/v3/projects/8e9e2d5c93274eb781bd76912178bae6/users/88bc03c141d64772b606e087d86e973e/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:07.003009 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4af136-f36a-4b32-87e6-296e2dbd01f4 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:07.007666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5b5ef-080d-4923-9f77-c0648873d4f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:07.009694 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5b5ef-080d-4923-9f77-c0648873d4f8 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:07.023677 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 796/1608] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:07.025694 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5b5ef-080d-4923-9f77-c0648873d4f8 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:07.037529 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5b5ef-080d-4923-9f77-c0648873d4f8 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:07.082074 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4af136-f36a-4b32-87e6-296e2dbd01f4 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:07.089257 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48e071-ccaf-4399-a352-1880d7c8f3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:07.090416 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48e071-ccaf-4399-a352-1880d7c8f3f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.090997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48e071-ccaf-4399-a352-1880d7c8f3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.091580 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48e071-ccaf-4399-a352-1880d7c8f3f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.093160 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48e071-ccaf-4399-a352-1880d7c8f3f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:07.096044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48e071-ccaf-4399-a352-1880d7c8f3f5 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:07.104262 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e64155-ba2c-42ac-845b-473ffbaaf462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:07.105352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e64155-ba2c-42ac-845b-473ffbaaf462 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.105645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e64155-ba2c-42ac-845b-473ffbaaf462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.105926 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e64155-ba2c-42ac-845b-473ffbaaf462 admin admin] PATH_INFO: `/v3/projects/28aead0a91684b0eb7fcdeace101cd1b/users/24621111433b47458b429fb7cd862b18/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.120929 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 813/1609] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:36:07 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:07.121867 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48e071-ccaf-4399-a352-1880d7c8f3f5 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:07.127953 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e64155-ba2c-42ac-845b-473ffbaaf462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28aead0a91684b0eb7fcdeace101cd1b, user_id=24621111433b47458b429fb7cd862b18, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:07.131632 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e64155-ba2c-42ac-845b-473ffbaaf462 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:07.132138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48e071-ccaf-4399-a352-1880d7c8f3f5 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:07.137829 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9fde1-ba10-4a42-a8cb-1eb92d78e342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:07.138859 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9fde1-ba10-4a42-a8cb-1eb92d78e342 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.139209 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9fde1-ba10-4a42-a8cb-1eb92d78e342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.139564 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9fde1-ba10-4a42-a8cb-1eb92d78e342 admin admin] PATH_INFO: `/v3/projects/e2a60aa73c3943e18fea2b2f38fadffe/users/a1622acb057f419ca98e7d44584c276d/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.148872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 797/1610] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:07 2022] PUT /identity/v3/projects/28aead0a91684b0eb7fcdeace101cd1b/users/24621111433b47458b429fb7cd862b18/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:07.150242 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e64155-ba2c-42ac-845b-473ffbaaf462 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:07.159016 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9fde1-ba10-4a42-a8cb-1eb92d78e342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2a60aa73c3943e18fea2b2f38fadffe, user_id=a1622acb057f419ca98e7d44584c276d, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:07.161836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9fde1-ba10-4a42-a8cb-1eb92d78e342 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:07.175954 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 814/1611] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:07 2022] PUT /identity/v3/projects/e2a60aa73c3943e18fea2b2f38fadffe/users/a1622acb057f419ca98e7d44584c276d/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:07.177058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3d885-7bf8-4b2a-9c88-0fb8cb0677d4 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.177374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3d885-7bf8-4b2a-9c88-0fb8cb0677d4 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.177800 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3d885-7bf8-4b2a-9c88-0fb8cb0677d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.207738 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a6d3d885-7bf8-4b2a-9c88-0fb8cb0677d4 None None] MFA Rules not processed for user `9a693f4cc3b14bb49bfc2d55b51a0741`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:07.209243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a6d3d885-7bf8-4b2a-9c88-0fb8cb0677d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:07.225284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:07.234652 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e64155-ba2c-42ac-845b-473ffbaaf462 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:07.289163 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 815/1612] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:07.291179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0a0f8-3534-4fa7-95d0-87f2ad8697fb None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.291869 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0a0f8-3534-4fa7-95d0-87f2ad8697fb None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.292146 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0a0f8-3534-4fa7-95d0-87f2ad8697fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.306002 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c3976-6a18-4ce5-8b2b-115ab64f85d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:07.306683 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c3976-6a18-4ce5-8b2b-115ab64f85d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.307097 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c3976-6a18-4ce5-8b2b-115ab64f85d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.307386 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c3976-6a18-4ce5-8b2b-115ab64f85d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.308109 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c3976-6a18-4ce5-8b2b-115ab64f85d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:07.309780 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c3976-6a18-4ce5-8b2b-115ab64f85d2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:07.324765 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 798/1613] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:07.325983 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d8f0a0f8-3534-4fa7-95d0-87f2ad8697fb None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:07.326129 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdaeaf-9d1c-437c-be46-8daadc0111aa None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.326430 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdaeaf-9d1c-437c-be46-8daadc0111aa None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.326713 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdaeaf-9d1c-437c-be46-8daadc0111aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.329311 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d8f0a0f8-3534-4fa7-95d0-87f2ad8697fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:07.343299 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 816/1614] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:07.344103 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0a0f8-3534-4fa7-95d0-87f2ad8697fb None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:07.349106 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-20fdaeaf-9d1c-437c-be46-8daadc0111aa None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:07.350479 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-20fdaeaf-9d1c-437c-be46-8daadc0111aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:07.361437 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0a0f8-3534-4fa7-95d0-87f2ad8697fb None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:07.362456 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 799/1615] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:07.363728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da46a50-191c-4c5e-aa17-16d7b2cc71e2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.364021 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da46a50-191c-4c5e-aa17-16d7b2cc71e2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.364324 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da46a50-191c-4c5e-aa17-16d7b2cc71e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.374094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d07b05-c7a0-467f-9c08-0765b211216c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:07.374925 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d07b05-c7a0-467f-9c08-0765b211216c admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.375420 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d07b05-c7a0-467f-9c08-0765b211216c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.376281 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d07b05-c7a0-467f-9c08-0765b211216c admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.377278 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d07b05-c7a0-467f-9c08-0765b211216c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:07.379204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d07b05-c7a0-467f-9c08-0765b211216c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:07.382973 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3da46a50-191c-4c5e-aa17-16d7b2cc71e2 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:07.384807 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3da46a50-191c-4c5e-aa17-16d7b2cc71e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:07.397956 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 817/1616] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:07.398171 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 800/1617] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:07.398283 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbfcbf-2b39-40be-aa10-a618563a9f6c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.398283 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbfcbf-2b39-40be-aa10-a618563a9f6c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.398614 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0d144-a7b8-4b12-8fac-00ce105c1503 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.398706 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbfcbf-2b39-40be-aa10-a618563a9f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.398827 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0d144-a7b8-4b12-8fac-00ce105c1503 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.398827 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0d144-a7b8-4b12-8fac-00ce105c1503 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.398827 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 801/1618] 10.222.0.32 () {54 vars in 961 bytes} [Thu Jun 2 13:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:07.398827 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0d144-a7b8-4b12-8fac-00ce105c1503 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:07.408569 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:07.411876 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0d144-a7b8-4b12-8fac-00ce105c1503 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:07.417000 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49518154-848f-406a-9b22-0140ba77c358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:07.418422 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49518154-848f-406a-9b22-0140ba77c358 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.418422 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49518154-848f-406a-9b22-0140ba77c358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.418624 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49518154-848f-406a-9b22-0140ba77c358 admin admin] PATH_INFO: `/v3/projects/0701dde4a0134a4fab671cf1aeebb02c/users/989f33ddcc8446d99758acfbd2d31d9b/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.421373 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-bfdbfcbf-2b39-40be-aa10-a618563a9f6c None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:07.422807 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bfdbfcbf-2b39-40be-aa10-a618563a9f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:07.433050 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 818/1619] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:07.433739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbfcbf-2b39-40be-aa10-a618563a9f6c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:07.435199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bfdbfcbf-2b39-40be-aa10-a618563a9f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:07.437801 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49518154-848f-406a-9b22-0140ba77c358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0701dde4a0134a4fab671cf1aeebb02c, user_id=989f33ddcc8446d99758acfbd2d31d9b, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:07.440521 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49518154-848f-406a-9b22-0140ba77c358 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:07.456544 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 802/1620] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:07 2022] PUT /identity/v3/projects/0701dde4a0134a4fab671cf1aeebb02c/users/989f33ddcc8446d99758acfbd2d31d9b/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:07.457498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49518154-848f-406a-9b22-0140ba77c358 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:07.460774 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-49518154-848f-406a-9b22-0140ba77c358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:07.505654 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbfcbf-2b39-40be-aa10-a618563a9f6c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:07.543743 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49518154-848f-406a-9b22-0140ba77c358 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:07.548728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b2211-65ff-4ff5-bb2e-6b57e9bd820a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:07.549371 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b2211-65ff-4ff5-bb2e-6b57e9bd820a service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.549672 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b2211-65ff-4ff5-bb2e-6b57e9bd820a service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.550047 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b2211-65ff-4ff5-bb2e-6b57e9bd820a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.570809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece2a88-4f57-483f-a318-26b72b91aa79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:07.571921 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece2a88-4f57-483f-a318-26b72b91aa79 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.572688 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece2a88-4f57-483f-a318-26b72b91aa79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.573493 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece2a88-4f57-483f-a318-26b72b91aa79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.621273 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b2211-65ff-4ff5-bb2e-6b57e9bd820a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:07.622741 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b2211-65ff-4ff5-bb2e-6b57e9bd820a service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:07.635590 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 803/1621] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:07.636772 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b2211-65ff-4ff5-bb2e-6b57e9bd820a service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:07.644446 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece2a88-4f57-483f-a318-26b72b91aa79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:07.646308 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece2a88-4f57-483f-a318-26b72b91aa79 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:07.646755 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b2211-65ff-4ff5-bb2e-6b57e9bd820a service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:07.652523 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb521082-b39f-4808-9303-d8839d5a25dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:07.653510 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb521082-b39f-4808-9303-d8839d5a25dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.653869 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb521082-b39f-4808-9303-d8839d5a25dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.654214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb521082-b39f-4808-9303-d8839d5a25dd admin admin] PATH_INFO: `/v3/projects/dc3c067f85e74cb0be300bc5ca63d672/users/fec1cda1cad442b3ac6a1cc98e0747b0/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.657541 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 819/1622] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:07.658688 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230f59e-1398-4084-821e-ea9b0a1e7137 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.658983 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230f59e-1398-4084-821e-ea9b0a1e7137 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.659267 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230f59e-1398-4084-821e-ea9b0a1e7137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.663633 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:07.675059 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb521082-b39f-4808-9303-d8839d5a25dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc3c067f85e74cb0be300bc5ca63d672, user_id=fec1cda1cad442b3ac6a1cc98e0747b0, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:07.677932 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb521082-b39f-4808-9303-d8839d5a25dd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:07.678828 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-7230f59e-1398-4084-821e-ea9b0a1e7137 None None] MFA Rules not processed for user `b2e5d9f3c4e04ca3bf52b28b67d2a4d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:07.680001 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7230f59e-1398-4084-821e-ea9b0a1e7137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:07.696840 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 804/1623] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:07 2022] PUT /identity/v3/projects/dc3c067f85e74cb0be300bc5ca63d672/users/fec1cda1cad442b3ac6a1cc98e0747b0/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:07.700576 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb521082-b39f-4808-9303-d8839d5a25dd admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:07.754531 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:07.765172 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb521082-b39f-4808-9303-d8839d5a25dd admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:07.769188 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896b74e-371e-4be5-82c5-a1c983df744f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:07.769958 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 820/1624] 10.222.0.32 () {58 vars in 1058 bytes} [Thu Jun 2 13:36:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:07.770083 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896b74e-371e-4be5-82c5-a1c983df744f service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.770197 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896b74e-371e-4be5-82c5-a1c983df744f service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.770572 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896b74e-371e-4be5-82c5-a1c983df744f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.770680 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230f59e-1398-4084-821e-ea9b0a1e7137 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:07.783103 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230f59e-1398-4084-821e-ea9b0a1e7137 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:07.787027 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79d99e-f6a9-4104-ac46-af00d7b132df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:07.787676 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79d99e-f6a9-4104-ac46-af00d7b132df service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.787956 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79d99e-f6a9-4104-ac46-af00d7b132df service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.788240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79d99e-f6a9-4104-ac46-af00d7b132df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.844805 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896b74e-371e-4be5-82c5-a1c983df744f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:07.846596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896b74e-371e-4be5-82c5-a1c983df744f service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:07.861165 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 805/1625] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:07.862286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896b74e-371e-4be5-82c5-a1c983df744f service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:07.865821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79d99e-f6a9-4104-ac46-af00d7b132df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:07.867361 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79d99e-f6a9-4104-ac46-af00d7b132df service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:07.874335 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896b74e-371e-4be5-82c5-a1c983df744f service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:07.879291 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee2000-7b45-48f7-979a-f85751cc3ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:07.880181 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 821/1626] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:07.880690 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee2000-7b45-48f7-979a-f85751cc3ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.880947 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee2000-7b45-48f7-979a-f85751cc3ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.881068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79d99e-f6a9-4104-ac46-af00d7b132df service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:07.881239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee2000-7b45-48f7-979a-f85751cc3ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.881959 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee2000-7b45-48f7-979a-f85751cc3ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:07.883685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee2000-7b45-48f7-979a-f85751cc3ba4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:07.890561 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79d99e-f6a9-4104-ac46-af00d7b132df service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:07.897967 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 806/1627] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:07.897967 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee2000-7b45-48f7-979a-f85751cc3ba4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:07.898517 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f8fc0-867a-4f8f-a9c5-9e1ead504a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:07.898517 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f8fc0-867a-4f8f-a9c5-9e1ead504a0b admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.898517 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f8fc0-867a-4f8f-a9c5-9e1ead504a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.898517 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f8fc0-867a-4f8f-a9c5-9e1ead504a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.899488 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f8fc0-867a-4f8f-a9c5-9e1ead504a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:07.901117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f8fc0-867a-4f8f-a9c5-9e1ead504a0b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:07.922375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 822/1628] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:07.923843 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f8fc0-867a-4f8f-a9c5-9e1ead504a0b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:07.937481 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f8fc0-867a-4f8f-a9c5-9e1ead504a0b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:07.947234 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca9fde-0d1e-4c4e-9cf7-d18192e4a918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:07.948843 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca9fde-0d1e-4c4e-9cf7-d18192e4a918 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.949476 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca9fde-0d1e-4c4e-9cf7-d18192e4a918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.949952 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca9fde-0d1e-4c4e-9cf7-d18192e4a918 admin admin] PATH_INFO: `/v3/projects/0701dde4a0134a4fab671cf1aeebb02c/users/989f33ddcc8446d99758acfbd2d31d9b/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.955336 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca9fde-0d1e-4c4e-9cf7-d18192e4a918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0701dde4a0134a4fab671cf1aeebb02c, user_id=989f33ddcc8446d99758acfbd2d31d9b, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:07.960261 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca9fde-0d1e-4c4e-9cf7-d18192e4a918 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:07.979085 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 823/1629] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:07 2022] PUT /identity/v3/projects/0701dde4a0134a4fab671cf1aeebb02c/users/989f33ddcc8446d99758acfbd2d31d9b/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:07.980786 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca9fde-0d1e-4c4e-9cf7-d18192e4a918 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:07.989100 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee2000-7b45-48f7-979a-f85751cc3ba4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:08.032603 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:08.090762 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca9fde-0d1e-4c4e-9cf7-d18192e4a918 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:08.104064 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd78046-fc98-48d5-a837-a44d61f3bfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:08.105389 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd78046-fc98-48d5-a837-a44d61f3bfd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:08.105679 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd78046-fc98-48d5-a837-a44d61f3bfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:08.105976 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd78046-fc98-48d5-a837-a44d61f3bfd8 admin admin] PATH_INFO: `/v3/projects/dc3c067f85e74cb0be300bc5ca63d672/users/fec1cda1cad442b3ac6a1cc98e0747b0/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:08.112085 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd78046-fc98-48d5-a837-a44d61f3bfd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc3c067f85e74cb0be300bc5ca63d672, user_id=fec1cda1cad442b3ac6a1cc98e0747b0, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:08.115305 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd78046-fc98-48d5-a837-a44d61f3bfd8 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:08.134727 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed826e-b984-4b21-be65-41fdc73f7635 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:08.135400 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed826e-b984-4b21-be65-41fdc73f7635 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:08.135687 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed826e-b984-4b21-be65-41fdc73f7635 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:08.136081 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed826e-b984-4b21-be65-41fdc73f7635 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:08.147117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 824/1630] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:07 2022] PUT /identity/v3/projects/dc3c067f85e74cb0be300bc5ca63d672/users/fec1cda1cad442b3ac6a1cc98e0747b0/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:08.160790 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87d784-3044-4aec-8272-909f86b2837f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:08.161088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87d784-3044-4aec-8272-909f86b2837f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:08.161373 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87d784-3044-4aec-8272-909f86b2837f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:08.231526 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-9e87d784-3044-4aec-8272-909f86b2837f None None] MFA Rules not processed for user `989f33ddcc8446d99758acfbd2d31d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:08.232827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9e87d784-3044-4aec-8272-909f86b2837f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:08.241902 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed826e-b984-4b21-be65-41fdc73f7635 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:08.245058 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed826e-b984-4b21-be65-41fdc73f7635 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:08.259020 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 807/1631] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:08.260964 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4864a-45d7-4065-9178-c12447ac9d85 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:08.261428 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4864a-45d7-4065-9178-c12447ac9d85 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:08.262008 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4864a-45d7-4065-9178-c12447ac9d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:08.316608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e7a4864a-45d7-4065-9178-c12447ac9d85 None None] MFA Rules not processed for user `fec1cda1cad442b3ac6a1cc98e0747b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:08.318096 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e7a4864a-45d7-4065-9178-c12447ac9d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:08.339168 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:08.390613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 825/1632] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:08.402912 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87d784-3044-4aec-8272-909f86b2837f None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:08.442594 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 808/1633] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:08 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:08.453986 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4864a-45d7-4065-9178-c12447ac9d85 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:08.503139 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87d784-3044-4aec-8272-909f86b2837f None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:08.510054 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e2952-337c-4d1c-b932-fc3554b4399b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:08.511106 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e2952-337c-4d1c-b932-fc3554b4399b service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:08.511615 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e2952-337c-4d1c-b932-fc3554b4399b service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:08.512114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e2952-337c-4d1c-b932-fc3554b4399b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:08.562981 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:08.568664 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4864a-45d7-4065-9178-c12447ac9d85 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:08.584207 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cabbe-bb48-4395-8cde-3d8d71f643e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:08.584927 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cabbe-bb48-4395-8cde-3d8d71f643e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:08.585218 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cabbe-bb48-4395-8cde-3d8d71f643e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:08.585502 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cabbe-bb48-4395-8cde-3d8d71f643e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:08.608360 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425cabbe-bb48-4395-8cde-3d8d71f643e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:08.609850 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425cabbe-bb48-4395-8cde-3d8d71f643e2 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:08.636270 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 809/1634] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:08 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:08.637814 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e2952-337c-4d1c-b932-fc3554b4399b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:08.643276 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e2952-337c-4d1c-b932-fc3554b4399b service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:08.673674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 826/1635] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:08.832438 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cabbe-bb48-4395-8cde-3d8d71f643e2 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:08.843622 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cabbe-bb48-4395-8cde-3d8d71f643e2 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:08.848491 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343d604-d5b7-424f-a336-79473370118a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:08.849447 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343d604-d5b7-424f-a336-79473370118a service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:08.849962 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343d604-d5b7-424f-a336-79473370118a service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:08.850614 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343d604-d5b7-424f-a336-79473370118a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:08.988441 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343d604-d5b7-424f-a336-79473370118a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:08.993742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343d604-d5b7-424f-a336-79473370118a service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:09.021313 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 810/1636] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:09.161877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b521a31-e0c8-4a8b-9d57-89a419e7f47e None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:09.162407 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b521a31-e0c8-4a8b-9d57-89a419e7f47e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:09.162850 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b521a31-e0c8-4a8b-9d57-89a419e7f47e None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:09.165094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 827/1637] 10.222.0.32 () {54 vars in 961 bytes} [Thu Jun 2 13:36:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:09.175779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f10923-bd75-4feb-ab96-f1036146c20a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:09.176072 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f10923-bd75-4feb-ab96-f1036146c20a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:09.176374 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f10923-bd75-4feb-ab96-f1036146c20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:09.232677 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b6f10923-bd75-4feb-ab96-f1036146c20a None None] MFA Rules not processed for user `b2e5d9f3c4e04ca3bf52b28b67d2a4d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:09.236953 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b6f10923-bd75-4feb-ab96-f1036146c20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:09.402634 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 811/1638] 10.222.0.32 () {58 vars in 1058 bytes} [Thu Jun 2 13:36:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:09.431876 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5891bf-0f22-4f97-a2f7-4be87f5ef466 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:09.440584 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5891bf-0f22-4f97-a2f7-4be87f5ef466 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:09.440875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5891bf-0f22-4f97-a2f7-4be87f5ef466 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:09.449761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 828/1639] 10.222.0.32 () {54 vars in 912 bytes} [Thu Jun 2 13:36:09 2022] GET /identity => generated 270 bytes in 34 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:09.457730 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acddcd-e659-4e91-942b-5840e74de160 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:09.458417 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acddcd-e659-4e91-942b-5840e74de160 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:09.458703 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acddcd-e659-4e91-942b-5840e74de160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:09.515940 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f3acddcd-e659-4e91-942b-5840e74de160 None None] MFA Rules not processed for user `b2e5d9f3c4e04ca3bf52b28b67d2a4d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:09.517786 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f3acddcd-e659-4e91-942b-5840e74de160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:09.538615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 812/1640] 10.222.0.32 () {58 vars in 1009 bytes} [Thu Jun 2 13:36:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:36:09.618719 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5891bf-0f22-4f97-a2f7-4be87f5ef466 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:09.640441 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5891bf-0f22-4f97-a2f7-4be87f5ef466 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:09.649522 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e8acf-4bb2-4110-9594-73e93309d18c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:09.652384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e8acf-4bb2-4110-9594-73e93309d18c service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:09.654290 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e8acf-4bb2-4110-9594-73e93309d18c service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:09.654695 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e8acf-4bb2-4110-9594-73e93309d18c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:09.683113 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e8acf-4bb2-4110-9594-73e93309d18c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:09.688498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e8acf-4bb2-4110-9594-73e93309d18c service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:09.725125 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 829/1641] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:09.834983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6965f3-669c-4e19-a4a9-82a1ca814d13 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:09.835271 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6965f3-669c-4e19-a4a9-82a1ca814d13 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:09.835728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6965f3-669c-4e19-a4a9-82a1ca814d13 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:09.838430 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 813/1642] 10.222.0.32 () {54 vars in 912 bytes} [Thu Jun 2 13:36:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:09.845142 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f13df5-1aec-4c9a-a0db-4b9932a2d56a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:09.845449 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f13df5-1aec-4c9a-a0db-4b9932a2d56a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:09.845732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f13df5-1aec-4c9a-a0db-4b9932a2d56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:09.888850 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-23f13df5-1aec-4c9a-a0db-4b9932a2d56a None None] MFA Rules not processed for user `b2e5d9f3c4e04ca3bf52b28b67d2a4d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:09.893597 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-23f13df5-1aec-4c9a-a0db-4b9932a2d56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:09.921786 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 830/1643] 10.222.0.32 () {58 vars in 1009 bytes} [Thu Jun 2 13:36:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:09.936201 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6965f3-669c-4e19-a4a9-82a1ca814d13 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:09.959437 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6965f3-669c-4e19-a4a9-82a1ca814d13 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:09.967743 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6ab93-228c-49a8-bb90-3247289a6fab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:09.970064 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6ab93-228c-49a8-bb90-3247289a6fab service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:09.972220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6ab93-228c-49a8-bb90-3247289a6fab service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:09.973115 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6ab93-228c-49a8-bb90-3247289a6fab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:09.998166 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6ab93-228c-49a8-bb90-3247289a6fab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:10.003290 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6ab93-228c-49a8-bb90-3247289a6fab service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:10.037683 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 814/1644] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:10.178981 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f13df5-1aec-4c9a-a0db-4b9932a2d56a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:10.318653 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f13df5-1aec-4c9a-a0db-4b9932a2d56a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:10.337025 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b456c0-aaee-4e90-9168-880e66d270dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:10.337943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b456c0-aaee-4e90-9168-880e66d270dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:10.338223 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b456c0-aaee-4e90-9168-880e66d270dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:10.338509 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b456c0-aaee-4e90-9168-880e66d270dc admin admin] PATH_INFO: `/v3/users/9a693f4cc3b14bb49bfc2d55b51a0741` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:10.340195 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b456c0-aaee-4e90-9168-880e66d270dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a693f4cc3b14bb49bfc2d55b51a0741)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:10.343638 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b456c0-aaee-4e90-9168-880e66d270dc admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:10.385306 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:10.441604 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-45b456c0-aaee-4e90-9168-880e66d270dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a693f4cc3b14bb49bfc2d55b51a0741'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:10.487072 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-45b456c0-aaee-4e90-9168-880e66d270dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a693f4cc3b14bb49bfc2d55b51a0741'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:10.491946 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-45b456c0-aaee-4e90-9168-880e66d270dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a693f4cc3b14bb49bfc2d55b51a0741'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:10.541812 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-45b456c0-aaee-4e90-9168-880e66d270dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a693f4cc3b14bb49bfc2d55b51a0741'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:10.554383 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-45b456c0-aaee-4e90-9168-880e66d270dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a693f4cc3b14bb49bfc2d55b51a0741'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:10.568053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 831/1645] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:36:10 2022] DELETE /identity/v3/users/9a693f4cc3b14bb49bfc2d55b51a0741 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:10.570921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d1eeb-36e5-4bf5-a610-4c635798b6ea None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:10.571229 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d1eeb-36e5-4bf5-a610-4c635798b6ea None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:10.571541 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d1eeb-36e5-4bf5-a610-4c635798b6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:10.596118 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1d1d1eeb-36e5-4bf5-a610-4c635798b6ea None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:10.597623 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1d1d1eeb-36e5-4bf5-a610-4c635798b6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:10.679741 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:10.695057 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 815/1646] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:10.725008 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b456c0-aaee-4e90-9168-880e66d270dc admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:10.727618 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-45b456c0-aaee-4e90-9168-880e66d270dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:10.814673 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b456c0-aaee-4e90-9168-880e66d270dc admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:10.818558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86327497-15b2-4415-acf8-e1c2f5b60535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:10.819448 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86327497-15b2-4415-acf8-e1c2f5b60535 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:10.819836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86327497-15b2-4415-acf8-e1c2f5b60535 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:10.820214 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86327497-15b2-4415-acf8-e1c2f5b60535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:10.831868 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86327497-15b2-4415-acf8-e1c2f5b60535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:10.833500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86327497-15b2-4415-acf8-e1c2f5b60535 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:10.845739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 832/1647] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:11.510467 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda5739-6eb1-49fd-a81d-8fca97634bc1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:11.511024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda5739-6eb1-49fd-a81d-8fca97634bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:11.511024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda5739-6eb1-49fd-a81d-8fca97634bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:11.558508 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-cbda5739-6eb1-49fd-a81d-8fca97634bc1 None None] MFA Rules not processed for user `24621111433b47458b429fb7cd862b18`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:11.559735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cbda5739-6eb1-49fd-a81d-8fca97634bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:11.687385 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 816/1648] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:11.699488 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc9f5f-576f-45fd-95a8-ba69170649fe None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:11.700131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc9f5f-576f-45fd-95a8-ba69170649fe None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:11.700131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc9f5f-576f-45fd-95a8-ba69170649fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:11.738802 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a4dc9f5f-576f-45fd-95a8-ba69170649fe None None] MFA Rules not processed for user `24621111433b47458b429fb7cd862b18`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:11.740544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a4dc9f5f-576f-45fd-95a8-ba69170649fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:11.759529 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 833/1649] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:11.771619 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda5739-6eb1-49fd-a81d-8fca97634bc1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:11.773238 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cbda5739-6eb1-49fd-a81d-8fca97634bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:11.985493 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda5739-6eb1-49fd-a81d-8fca97634bc1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:12.001640 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c083d5-b90b-4b05-bd2d-12b9c9bd8930 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:12.002186 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c083d5-b90b-4b05-bd2d-12b9c9bd8930 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:12.002469 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c083d5-b90b-4b05-bd2d-12b9c9bd8930 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:12.002746 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c083d5-b90b-4b05-bd2d-12b9c9bd8930 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:12.028430 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c083d5-b90b-4b05-bd2d-12b9c9bd8930 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:12.030243 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c083d5-b90b-4b05-bd2d-12b9c9bd8930 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:12.048112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 817/1650] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:12.832179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc9f5f-576f-45fd-95a8-ba69170649fe None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:12.833680 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a4dc9f5f-576f-45fd-95a8-ba69170649fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:12.853374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc9f5f-576f-45fd-95a8-ba69170649fe None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:12.862821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f9d90-79aa-4699-8d6f-8866c41499db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:12.863909 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f9d90-79aa-4699-8d6f-8866c41499db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:12.864507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f9d90-79aa-4699-8d6f-8866c41499db admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:12.864928 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f9d90-79aa-4699-8d6f-8866c41499db admin admin] PATH_INFO: `/v3/projects/80d19e08e8794466b6ab5de018413367` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:12.866716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f9d90-79aa-4699-8d6f-8866c41499db admin admin] RBAC: Authorizing `identity:delete_project(project_id=80d19e08e8794466b6ab5de018413367)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:12.868836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: WARNING py.warnings [None req-a66f9d90-79aa-4699-8d6f-8866c41499db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:36:12.868836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: warnings.warn(msg) Jun 02 13:36:12.868836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: Jun 02 13:36:12.870436 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f9d90-79aa-4699-8d6f-8866c41499db admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:12.953594 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6ae83-203c-41f5-bb51-0d1bee7769a0 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:12.954139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6ae83-203c-41f5-bb51-0d1bee7769a0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:12.954139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6ae83-203c-41f5-bb51-0d1bee7769a0 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:12.956071 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 818/1651] 10.222.0.32 () {54 vars in 912 bytes} [Thu Jun 2 13:36:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:12.966307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca70b8-4d73-48e1-b1da-29d1430e4a13 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:12.966575 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca70b8-4d73-48e1-b1da-29d1430e4a13 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:12.966890 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca70b8-4d73-48e1-b1da-29d1430e4a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:12.975256 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a66f9d90-79aa-4699-8d6f-8866c41499db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80d19e08e8794466b6ab5de018413367', 'request_id': 'req-a66f9d90-79aa-4699-8d6f-8866c41499db'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:12.989163 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a66f9d90-79aa-4699-8d6f-8866c41499db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80d19e08e8794466b6ab5de018413367', 'request_id': 'req-a66f9d90-79aa-4699-8d6f-8866c41499db'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:13.001065 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a66f9d90-79aa-4699-8d6f-8866c41499db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80d19e08e8794466b6ab5de018413367', 'request_id': 'req-a66f9d90-79aa-4699-8d6f-8866c41499db'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:13.044571 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a66f9d90-79aa-4699-8d6f-8866c41499db admin admin] The token cache is being invalidate because project 80d19e08e8794466b6ab5de018413367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:36:13.045397 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a66f9d90-79aa-4699-8d6f-8866c41499db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:13.046180 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a66f9d90-79aa-4699-8d6f-8866c41499db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:13.048321 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 834/1652] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:36:12 2022] DELETE /identity/v3/projects/80d19e08e8794466b6ab5de018413367 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:13.055777 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0eca70b8-4d73-48e1-b1da-29d1430e4a13 None None] MFA Rules not processed for user `9eb2722c122f4aeba23ec16b5a3c485f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:13.056180 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff071e-1f5d-405b-b98a-2bf209d2a288 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:13.056528 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff071e-1f5d-405b-b98a-2bf209d2a288 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:13.056818 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff071e-1f5d-405b-b98a-2bf209d2a288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:13.057054 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0eca70b8-4d73-48e1-b1da-29d1430e4a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:13.084274 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3cff071e-1f5d-405b-b98a-2bf209d2a288 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:13.087814 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3cff071e-1f5d-405b-b98a-2bf209d2a288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:13.105181 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:13.156154 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 819/1653] 10.222.0.32 () {58 vars in 1009 bytes} [Thu Jun 2 13:36:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:13.181676 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 835/1654] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:36:13.183501 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca70b8-4d73-48e1-b1da-29d1430e4a13 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:13.186797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0eca70b8-4d73-48e1-b1da-29d1430e4a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:13.189860 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23459d-c817-4903-9a18-508015cfdf9e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:13.190403 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23459d-c817-4903-9a18-508015cfdf9e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:13.191045 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23459d-c817-4903-9a18-508015cfdf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:13.213512 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca70b8-4d73-48e1-b1da-29d1430e4a13 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:13.217026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-8f23459d-c817-4903-9a18-508015cfdf9e None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:13.218615 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8f23459d-c817-4903-9a18-508015cfdf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:13.222936 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1372d55-c9c3-471c-803c-567590ca2fb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:13.223606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1372d55-c9c3-471c-803c-567590ca2fb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:13.223889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1372d55-c9c3-471c-803c-567590ca2fb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:13.224161 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1372d55-c9c3-471c-803c-567590ca2fb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:13.230548 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 836/1655] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:13.236520 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23459d-c817-4903-9a18-508015cfdf9e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:13.241715 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1372d55-c9c3-471c-803c-567590ca2fb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:13.243750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1372d55-c9c3-471c-803c-567590ca2fb2 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:13.252020 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:13.263161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23459d-c817-4903-9a18-508015cfdf9e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:13.265403 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 820/1656] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:13.284884 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a89682-212e-4911-b915-80a915ea1d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:13.285668 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a89682-212e-4911-b915-80a915ea1d89 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:13.286035 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a89682-212e-4911-b915-80a915ea1d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:13.286322 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a89682-212e-4911-b915-80a915ea1d89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:13.287126 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a89682-212e-4911-b915-80a915ea1d89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:13.287478 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a89682-212e-4911-b915-80a915ea1d89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:13.289285 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a89682-212e-4911-b915-80a915ea1d89 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:13.319824 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 837/1657] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:13.320147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1372d55-c9c3-471c-803c-567590ca2fb2 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:13.338786 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1372d55-c9c3-471c-803c-567590ca2fb2 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:13.354944 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e3f24-50de-4ba1-9f73-eff78e82b026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:13.355675 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e3f24-50de-4ba1-9f73-eff78e82b026 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:13.355960 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e3f24-50de-4ba1-9f73-eff78e82b026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:13.356657 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e3f24-50de-4ba1-9f73-eff78e82b026 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:13.358008 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e3f24-50de-4ba1-9f73-eff78e82b026 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:13.365244 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e3f24-50de-4ba1-9f73-eff78e82b026 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:13.449905 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a89682-212e-4911-b915-80a915ea1d89 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:13.450083 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 821/1658] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:36:13 2022] POST /identity/v3/projects => generated 405 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:13.462628 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a89682-212e-4911-b915-80a915ea1d89 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:13.627342 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73123c1f-f8d8-401c-a821-da8bdbe94f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:13.628228 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73123c1f-f8d8-401c-a821-da8bdbe94f0a admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:13.628619 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73123c1f-f8d8-401c-a821-da8bdbe94f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:13.628992 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73123c1f-f8d8-401c-a821-da8bdbe94f0a admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:13.629784 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73123c1f-f8d8-401c-a821-da8bdbe94f0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:13.631883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73123c1f-f8d8-401c-a821-da8bdbe94f0a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:13.659238 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 838/1659] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:36:13 2022] POST /identity/v3/users => generated 303 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:13.663732 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e3f24-50de-4ba1-9f73-eff78e82b026 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:13.679681 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e3f24-50de-4ba1-9f73-eff78e82b026 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:13.691298 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ceecf-9446-4246-94fd-8fc2424a3afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:13.692251 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ceecf-9446-4246-94fd-8fc2424a3afd admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:13.693396 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ceecf-9446-4246-94fd-8fc2424a3afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:13.693902 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ceecf-9446-4246-94fd-8fc2424a3afd admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:13.696019 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ceecf-9446-4246-94fd-8fc2424a3afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:13.701538 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ceecf-9446-4246-94fd-8fc2424a3afd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:13.794187 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 822/1660] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:13.798391 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73123c1f-f8d8-401c-a821-da8bdbe94f0a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:13.813736 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73123c1f-f8d8-401c-a821-da8bdbe94f0a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:13.837617 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab3c35-29d4-4c22-809a-bc9c02ee39fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:13.839579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab3c35-29d4-4c22-809a-bc9c02ee39fd admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:13.839886 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab3c35-29d4-4c22-809a-bc9c02ee39fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:13.840161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab3c35-29d4-4c22-809a-bc9c02ee39fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:13.840951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab3c35-29d4-4c22-809a-bc9c02ee39fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:13.842702 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab3c35-29d4-4c22-809a-bc9c02ee39fd admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:13.872279 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 839/1661] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:13.876093 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ceecf-9446-4246-94fd-8fc2424a3afd admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:13.902832 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ceecf-9446-4246-94fd-8fc2424a3afd admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:13.916153 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2c93f-86cd-4eb4-b0c3-a35baf70d9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:13.919714 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2c93f-86cd-4eb4-b0c3-a35baf70d9bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:13.920128 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2c93f-86cd-4eb4-b0c3-a35baf70d9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:13.921654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2c93f-86cd-4eb4-b0c3-a35baf70d9bf admin admin] PATH_INFO: `/v3/projects/0cd613de79084aee8decf9153f80e5f2/users/4de07807f7b641dc9e6bd7b1308f777e/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:13.978339 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2c93f-86cd-4eb4-b0c3-a35baf70d9bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cd613de79084aee8decf9153f80e5f2, user_id=4de07807f7b641dc9e6bd7b1308f777e, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:14.001514 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2c93f-86cd-4eb4-b0c3-a35baf70d9bf admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:14.039801 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 823/1662] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:13 2022] PUT /identity/v3/projects/0cd613de79084aee8decf9153f80e5f2/users/4de07807f7b641dc9e6bd7b1308f777e/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:14.047762 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191cccb8-add6-4dea-bbdb-54dbc87d7cdc None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:14.048325 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191cccb8-add6-4dea-bbdb-54dbc87d7cdc None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:14.048608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191cccb8-add6-4dea-bbdb-54dbc87d7cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:14.078625 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-191cccb8-add6-4dea-bbdb-54dbc87d7cdc None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:14.079855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-191cccb8-add6-4dea-bbdb-54dbc87d7cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:14.225954 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 840/1663] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:14.287494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2c93f-86cd-4eb4-b0c3-a35baf70d9bf admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:14.501465 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2c93f-86cd-4eb4-b0c3-a35baf70d9bf admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:14.510290 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d4e07-e744-4880-9017-2a62544837d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:14.511326 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d4e07-e744-4880-9017-2a62544837d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:14.511618 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d4e07-e744-4880-9017-2a62544837d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:14.511910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d4e07-e744-4880-9017-2a62544837d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:14.559201 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d4e07-e744-4880-9017-2a62544837d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:14.561212 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d4e07-e744-4880-9017-2a62544837d9 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:14.594740 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 824/1664] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:15.671499 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191cccb8-add6-4dea-bbdb-54dbc87d7cdc None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:15.676954 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-191cccb8-add6-4dea-bbdb-54dbc87d7cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:15.750225 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:15.944117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191cccb8-add6-4dea-bbdb-54dbc87d7cdc None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:15.958659 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a6e2d-d431-44dc-8325-98711de28c9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:15.960379 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a6e2d-d431-44dc-8325-98711de28c9b service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:15.960808 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a6e2d-d431-44dc-8325-98711de28c9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:15.965676 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a6e2d-d431-44dc-8325-98711de28c9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:15.975059 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-684a6e2d-d431-44dc-8325-98711de28c9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:16.000854 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e66097-88db-45da-9ffa-10d5306c9027 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:16.001333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e66097-88db-45da-9ffa-10d5306c9027 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:16.001545 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e66097-88db-45da-9ffa-10d5306c9027 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:16.002787 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 825/1665] 10.222.0.32 () {54 vars in 960 bytes} [Thu Jun 2 13:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:16.021242 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559c30b-1d29-4d69-8e46-81e959ee2c9e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:16.021534 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559c30b-1d29-4d69-8e46-81e959ee2c9e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:16.021817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559c30b-1d29-4d69-8e46-81e959ee2c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:16.067858 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0559c30b-1d29-4d69-8e46-81e959ee2c9e None None] MFA Rules not processed for user `24410ef5e78042c79c5b4a0d78b56258`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:16.083622 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0559c30b-1d29-4d69-8e46-81e959ee2c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:16.210678 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a6e2d-d431-44dc-8325-98711de28c9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:16.214209 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a6e2d-d431-44dc-8325-98711de28c9b service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:16.233534 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 841/1666] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:15 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:16.281191 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 826/1667] 10.222.0.32 () {58 vars in 1057 bytes} [Thu Jun 2 13:36:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:36:16.298202 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a6e2d-d431-44dc-8325-98711de28c9b service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:16.318500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a6e2d-d431-44dc-8325-98711de28c9b service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:16.337012 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52966e69-2c29-4b9c-bfb9-cf5ce750f4d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24410ef5e78042c79c5b4a0d78b56258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:16.337836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52966e69-2c29-4b9c-bfb9-cf5ce750f4d4 service placement] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:16.338128 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52966e69-2c29-4b9c-bfb9-cf5ce750f4d4 service placement] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:16.338408 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52966e69-2c29-4b9c-bfb9-cf5ce750f4d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:16.347110 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-52966e69-2c29-4b9c-bfb9-cf5ce750f4d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:16.424811 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52966e69-2c29-4b9c-bfb9-cf5ce750f4d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:16.432782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52966e69-2c29-4b9c-bfb9-cf5ce750f4d4 service placement] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:16.461623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 842/1668] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:18.604259 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb4653-a878-4949-b73a-2a1e9d0d90d0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:18.604830 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb4653-a878-4949-b73a-2a1e9d0d90d0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:18.604830 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb4653-a878-4949-b73a-2a1e9d0d90d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:18.620439 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a5e43-662c-424d-85cb-86bec1faebe4 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:18.620911 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a5e43-662c-424d-85cb-86bec1faebe4 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:18.621003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a5e43-662c-424d-85cb-86bec1faebe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:18.664792 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-89eb4653-a878-4949-b73a-2a1e9d0d90d0 None None] MFA Rules not processed for user `b92da35ea7c946ea876b13b13ed98258`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:18.667154 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-89eb4653-a878-4949-b73a-2a1e9d0d90d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:18.693050 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-728a5e43-662c-424d-85cb-86bec1faebe4 None None] MFA Rules not processed for user `4de07807f7b641dc9e6bd7b1308f777e`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:18.695412 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-728a5e43-662c-424d-85cb-86bec1faebe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:18.754301 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:18.862549 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 827/1669] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:18.868207 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e95d9c-d8cc-4332-a116-b1b79a5920a3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:18.868560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e95d9c-d8cc-4332-a116-b1b79a5920a3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:18.896185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e95d9c-d8cc-4332-a116-b1b79a5920a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:18.904224 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 843/1670] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:18 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:36:18.906477 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a5e43-662c-424d-85cb-86bec1faebe4 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:18.940589 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a5e43-662c-424d-85cb-86bec1faebe4 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:18.950498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c7e95d9c-d8cc-4332-a116-b1b79a5920a3 None None] MFA Rules not processed for user `b92da35ea7c946ea876b13b13ed98258`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:18.953089 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c7e95d9c-d8cc-4332-a116-b1b79a5920a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:18.959644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5a9b9-7e72-4630-a782-cb07948ef552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:18.960347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5a9b9-7e72-4630-a782-cb07948ef552 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:18.960642 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5a9b9-7e72-4630-a782-cb07948ef552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:18.961502 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5a9b9-7e72-4630-a782-cb07948ef552 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:18.962674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5a9b9-7e72-4630-a782-cb07948ef552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:18.964408 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5a9b9-7e72-4630-a782-cb07948ef552 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:18.975554 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 828/1671] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:18.991119 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e95d9c-d8cc-4332-a116-b1b79a5920a3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:18.992997 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c7e95d9c-d8cc-4332-a116-b1b79a5920a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:19.045113 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 844/1672] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:36:18 2022] POST /identity/v3/projects => generated 403 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:36:19.050944 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5a9b9-7e72-4630-a782-cb07948ef552 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:19.130683 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:19.173276 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e95d9c-d8cc-4332-a116-b1b79a5920a3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:19.202523 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5a9b9-7e72-4630-a782-cb07948ef552 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:19.216244 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff100dfe-2a52-46e2-9989-345cd0653dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:19.217481 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff100dfe-2a52-46e2-9989-345cd0653dbf admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:19.218024 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff100dfe-2a52-46e2-9989-345cd0653dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:19.218508 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff100dfe-2a52-46e2-9989-345cd0653dbf admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:19.219418 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff100dfe-2a52-46e2-9989-345cd0653dbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:19.222258 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff100dfe-2a52-46e2-9989-345cd0653dbf admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:19.250650 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 845/1673] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:36:19 2022] POST /identity/v3/users => generated 308 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:19.254242 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff100dfe-2a52-46e2-9989-345cd0653dbf admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:19.281475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff100dfe-2a52-46e2-9989-345cd0653dbf admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:19.298444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf905a39-1583-4488-b3c7-4fb521100a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:19.299507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf905a39-1583-4488-b3c7-4fb521100a07 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:19.301084 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf905a39-1583-4488-b3c7-4fb521100a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:19.302575 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf905a39-1583-4488-b3c7-4fb521100a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:19.303576 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf905a39-1583-4488-b3c7-4fb521100a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:19.310840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf905a39-1583-4488-b3c7-4fb521100a07 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:19.339398 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 846/1674] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:36:19.343120 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf905a39-1583-4488-b3c7-4fb521100a07 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:19.370122 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf905a39-1583-4488-b3c7-4fb521100a07 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:19.386579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca951c-8217-461d-b547-a943af674eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:19.388641 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca951c-8217-461d-b547-a943af674eb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:19.389148 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca951c-8217-461d-b547-a943af674eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:19.389420 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca951c-8217-461d-b547-a943af674eb2 admin admin] PATH_INFO: `/v3/projects/cb362ca55c444219bd970d0f64779557/users/e17bc5cd16b345c5910958f1865159aa/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:19.393908 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f334abe-29be-4288-8e4f-6220ff9677ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:19.394574 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f334abe-29be-4288-8e4f-6220ff9677ed service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:19.394854 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f334abe-29be-4288-8e4f-6220ff9677ed service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:19.395132 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f334abe-29be-4288-8e4f-6220ff9677ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:19.409937 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca951c-8217-461d-b547-a943af674eb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb362ca55c444219bd970d0f64779557, user_id=e17bc5cd16b345c5910958f1865159aa, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:19.413812 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca951c-8217-461d-b547-a943af674eb2 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:19.435162 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 847/1675] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:19 2022] PUT /identity/v3/projects/cb362ca55c444219bd970d0f64779557/users/e17bc5cd16b345c5910958f1865159aa/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:19.439986 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca951c-8217-461d-b547-a943af674eb2 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:19.531408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f334abe-29be-4288-8e4f-6220ff9677ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:19.534085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f334abe-29be-4288-8e4f-6220ff9677ed service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:19.549953 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:19.564669 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 829/1676] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:19.588557 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca951c-8217-461d-b547-a943af674eb2 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:19.594020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa3ede-eaae-4216-81de-9d4aab53aae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:19.595829 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa3ede-eaae-4216-81de-9d4aab53aae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:19.596241 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa3ede-eaae-4216-81de-9d4aab53aae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:19.597591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa3ede-eaae-4216-81de-9d4aab53aae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:19.598778 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa3ede-eaae-4216-81de-9d4aab53aae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:19.601382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa3ede-eaae-4216-81de-9d4aab53aae6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:19.647879 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 848/1677] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:19.651776 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f334abe-29be-4288-8e4f-6220ff9677ed service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:19.704587 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f334abe-29be-4288-8e4f-6220ff9677ed service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:19.719038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a13a1-e492-44cc-b1d7-ed40b1458b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:19.721129 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a13a1-e492-44cc-b1d7-ed40b1458b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:19.726381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a13a1-e492-44cc-b1d7-ed40b1458b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:19.727486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a13a1-e492-44cc-b1d7-ed40b1458b01 admin admin] PATH_INFO: `/v3/projects/cb362ca55c444219bd970d0f64779557/users/e17bc5cd16b345c5910958f1865159aa/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:19.733445 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a13a1-e492-44cc-b1d7-ed40b1458b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb362ca55c444219bd970d0f64779557, user_id=e17bc5cd16b345c5910958f1865159aa, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:19.739032 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a13a1-e492-44cc-b1d7-ed40b1458b01 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:19.789476 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 830/1678] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:19 2022] PUT /identity/v3/projects/cb362ca55c444219bd970d0f64779557/users/e17bc5cd16b345c5910958f1865159aa/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:36:20.577356 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6630dc-113c-4981-90d6-be98d1f54690 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:20.577580 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6630dc-113c-4981-90d6-be98d1f54690 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:20.577916 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6630dc-113c-4981-90d6-be98d1f54690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:20.657369 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6c6630dc-113c-4981-90d6-be98d1f54690 None None] MFA Rules not processed for user `a1622acb057f419ca98e7d44584c276d`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:20.659346 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6c6630dc-113c-4981-90d6-be98d1f54690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:20.808841 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 849/1679] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:20.881305 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a13a1-e492-44cc-b1d7-ed40b1458b01 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:20.883114 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-838a13a1-e492-44cc-b1d7-ed40b1458b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:21.071795 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a13a1-e492-44cc-b1d7-ed40b1458b01 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:21.082705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2f803-cb7a-4e6b-8ed6-f3f94e41fcf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:21.087704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2f803-cb7a-4e6b-8ed6-f3f94e41fcf6 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:21.088165 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2f803-cb7a-4e6b-8ed6-f3f94e41fcf6 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:21.088587 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2f803-cb7a-4e6b-8ed6-f3f94e41fcf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:21.108396 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2f803-cb7a-4e6b-8ed6-f3f94e41fcf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:21.110739 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2f803-cb7a-4e6b-8ed6-f3f94e41fcf6 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:21.134997 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 831/1680] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:21.867862 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5b609-290e-4c6d-85d1-e91eb74c7dbe None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:21.869770 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5b609-290e-4c6d-85d1-e91eb74c7dbe None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:21.871678 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5b609-290e-4c6d-85d1-e91eb74c7dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:21.885592 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:21.971146 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-73a5b609-290e-4c6d-85d1-e91eb74c7dbe None None] MFA Rules not processed for user `e17bc5cd16b345c5910958f1865159aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:21.973836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-73a5b609-290e-4c6d-85d1-e91eb74c7dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:22.094222 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 850/1681] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:21 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:22.562791 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d5e95-c8ce-410f-ba80-9c32b8164ffe None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:22.563248 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d5e95-c8ce-410f-ba80-9c32b8164ffe None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:22.566334 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d5e95-c8ce-410f-ba80-9c32b8164ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:22.611816 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0b9d5e95-c8ce-410f-ba80-9c32b8164ffe None None] MFA Rules not processed for user `b92da35ea7c946ea876b13b13ed98258`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:22.621924 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0b9d5e95-c8ce-410f-ba80-9c32b8164ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:22.798512 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 832/1682] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:24.162699 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd571f-6e00-48e0-985e-62d68581dfd7 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:24.163214 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd571f-6e00-48e0-985e-62d68581dfd7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:24.163285 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd571f-6e00-48e0-985e-62d68581dfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:24.229476 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b0dd571f-6e00-48e0-985e-62d68581dfd7 None None] MFA Rules not processed for user `bbcd5ba866b84d099d183fe19ba61a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:24.231413 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b0dd571f-6e00-48e0-985e-62d68581dfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:24.469661 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 851/1683] 10.222.0.32 () {58 vars in 1009 bytes} [Thu Jun 2 13:36:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:24.765552 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d5e95-c8ce-410f-ba80-9c32b8164ffe None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:24.768546 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0b9d5e95-c8ce-410f-ba80-9c32b8164ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:24.852455 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2569a-4c60-40d5-91d2-80b842c68b70 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:24.852739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2569a-4c60-40d5-91d2-80b842c68b70 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:24.853701 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2569a-4c60-40d5-91d2-80b842c68b70 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:24.855426 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 852/1684] 10.222.0.32 () {54 vars in 912 bytes} [Thu Jun 2 13:36:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:24.875403 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c08ea7-45c0-45d2-bf1e-cb57b84a628f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:24.875676 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c08ea7-45c0-45d2-bf1e-cb57b84a628f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:24.875959 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c08ea7-45c0-45d2-bf1e-cb57b84a628f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:24.965587 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-59c08ea7-45c0-45d2-bf1e-cb57b84a628f None None] MFA Rules not processed for user `9eb2722c122f4aeba23ec16b5a3c485f`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:24.975534 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-59c08ea7-45c0-45d2-bf1e-cb57b84a628f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:25.023602 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d5e95-c8ce-410f-ba80-9c32b8164ffe None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:25.046498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d03d0d-a863-456d-b9f9-2e24bbf577d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aea97e7b39448a283032f662142b6e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:25.047227 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d03d0d-a863-456d-b9f9-2e24bbf577d1 service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:25.047515 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d03d0d-a863-456d-b9f9-2e24bbf577d1 service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:25.047789 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d03d0d-a863-456d-b9f9-2e24bbf577d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:25.080108 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d03d0d-a863-456d-b9f9-2e24bbf577d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:25.092046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d03d0d-a863-456d-b9f9-2e24bbf577d1 service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:25.148722 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 833/1685] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Jun 2 13:36:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:36:25.298696 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 853/1686] 10.222.0.32 () {58 vars in 1009 bytes} [Thu Jun 2 13:36:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:25.380094 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d03d0d-a863-456d-b9f9-2e24bbf577d1 service swift] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:25.392195 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:25.397019 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d03d0d-a863-456d-b9f9-2e24bbf577d1 service swift] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:25.404856 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d97f6d-e962-463f-a231-1533e3ac7117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:25.405525 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d97f6d-e962-463f-a231-1533e3ac7117 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:25.405817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d97f6d-e962-463f-a231-1533e3ac7117 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:25.406091 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d97f6d-e962-463f-a231-1533e3ac7117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:25.448057 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d97f6d-e962-463f-a231-1533e3ac7117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:25.452657 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d97f6d-e962-463f-a231-1533e3ac7117 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:25.501222 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 834/1687] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:25.552903 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b21e9-226d-411a-b0b9-d74f2538d7a8 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:25.553199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b21e9-226d-411a-b0b9-d74f2538d7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:25.553478 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b21e9-226d-411a-b0b9-d74f2538d7a8 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:25.554921 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 854/1688] 10.222.0.32 () {54 vars in 921 bytes} [Thu Jun 2 13:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:25.841100 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb0c97-7b7b-4e24-bc89-74a26f81ccfe None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:25.841652 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb0c97-7b7b-4e24-bc89-74a26f81ccfe None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:25.841652 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb0c97-7b7b-4e24-bc89-74a26f81ccfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:25.885651 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-64eb0c97-7b7b-4e24-bc89-74a26f81ccfe None None] MFA Rules not processed for user `24410ef5e78042c79c5b4a0d78b56258`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:25.886912 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-64eb0c97-7b7b-4e24-bc89-74a26f81ccfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:26.076440 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 835/1689] 10.222.0.32 () {58 vars in 1018 bytes} [Thu Jun 2 13:36:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:26.108941 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b21e9-226d-411a-b0b9-d74f2538d7a8 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:26.145517 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b21e9-226d-411a-b0b9-d74f2538d7a8 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:26.153619 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2fb98-c38d-44f2-abcb-53025f571a33 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24410ef5e78042c79c5b4a0d78b56258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:26.154482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2fb98-c38d-44f2-abcb-53025f571a33 service placement] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:26.154909 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2fb98-c38d-44f2-abcb-53025f571a33 service placement] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:26.155349 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2fb98-c38d-44f2-abcb-53025f571a33 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:26.175327 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2fb98-c38d-44f2-abcb-53025f571a33 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:26.177265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2fb98-c38d-44f2-abcb-53025f571a33 service placement] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:26.194996 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 855/1690] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:27.203364 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e8509-f4a6-42ff-87a5-040828330873 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:27.205734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e8509-f4a6-42ff-87a5-040828330873 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:27.207070 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e8509-f4a6-42ff-87a5-040828330873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:27.278353 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-834e8509-f4a6-42ff-87a5-040828330873 None None] MFA Rules not processed for user `88bc03c141d64772b606e087d86e973e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:27.283862 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-834e8509-f4a6-42ff-87a5-040828330873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:27.373428 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 836/1691] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:27.390710 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2fb98-c38d-44f2-abcb-53025f571a33 service placement] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:27.406336 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2fb98-c38d-44f2-abcb-53025f571a33 service placement] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:27.413148 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0dd1fd-7c2e-4480-99e2-ddf1fce11fb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:27.414867 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0dd1fd-7c2e-4480-99e2-ddf1fce11fb4 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:27.415301 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0dd1fd-7c2e-4480-99e2-ddf1fce11fb4 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:27.415799 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0dd1fd-7c2e-4480-99e2-ddf1fce11fb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:27.425916 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0dd1fd-7c2e-4480-99e2-ddf1fce11fb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:27.427814 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0dd1fd-7c2e-4480-99e2-ddf1fce11fb4 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:27.442919 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 856/1692] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:36:27.787701 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403aa514-92b4-4389-827d-7e122d9fd8bd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:27.787985 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403aa514-92b4-4389-827d-7e122d9fd8bd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:27.789128 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403aa514-92b4-4389-827d-7e122d9fd8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:27.840897 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-403aa514-92b4-4389-827d-7e122d9fd8bd None None] MFA Rules not processed for user `4e88422338024035b5c64d2788965086`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:27.842391 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-403aa514-92b4-4389-827d-7e122d9fd8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:27.863842 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e556f-95c4-40bc-8aec-511cf22bba52 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:27.864591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e556f-95c4-40bc-8aec-511cf22bba52 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:27.865206 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e556f-95c4-40bc-8aec-511cf22bba52 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:27.867973 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 857/1693] 10.222.0.32 () {54 vars in 921 bytes} [Thu Jun 2 13:36:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:27.880852 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9b166-3a0b-4300-b528-4581c0c8fb93 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:27.881932 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9b166-3a0b-4300-b528-4581c0c8fb93 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:27.883008 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9b166-3a0b-4300-b528-4581c0c8fb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:27.932384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-abf9b166-3a0b-4300-b528-4581c0c8fb93 None None] MFA Rules not processed for user `24410ef5e78042c79c5b4a0d78b56258`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:27.934551 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-abf9b166-3a0b-4300-b528-4581c0c8fb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:27.975426 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 858/1694] 10.222.0.32 () {58 vars in 1018 bytes} [Thu Jun 2 13:36:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:36:28.026828 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9b166-3a0b-4300-b528-4581c0c8fb93 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:28.032714 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-abf9b166-3a0b-4300-b528-4581c0c8fb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:28.078522 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9b166-3a0b-4300-b528-4581c0c8fb93 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:28.104559 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fa575-391b-47f4-b702-b9135176f5a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24410ef5e78042c79c5b4a0d78b56258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:28.105381 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fa575-391b-47f4-b702-b9135176f5a6 service placement] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:28.105680 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fa575-391b-47f4-b702-b9135176f5a6 service placement] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:28.106181 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fa575-391b-47f4-b702-b9135176f5a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:28.117146 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 837/1695] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:28.200076 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:28.202137 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c0909-30dd-48af-abfe-c1e676217f12 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:28.202261 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c0909-30dd-48af-abfe-c1e676217f12 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:28.202601 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c0909-30dd-48af-abfe-c1e676217f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:28.212977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8fa575-391b-47f4-b702-b9135176f5a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:28.218713 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8fa575-391b-47f4-b702-b9135176f5a6 service placement] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:28.255195 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:28.280411 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 859/1696] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:28.288380 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-232c0909-30dd-48af-abfe-c1e676217f12 None None] MFA Rules not processed for user `a1622acb057f419ca98e7d44584c276d`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:28.293733 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-232c0909-30dd-48af-abfe-c1e676217f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:28.339253 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 838/1697] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:36:28.674394 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94208d32-5ce6-4a85-8ef4-1b2ef894fd9a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:28.674998 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94208d32-5ce6-4a85-8ef4-1b2ef894fd9a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:28.675156 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94208d32-5ce6-4a85-8ef4-1b2ef894fd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:28.727918 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c0909-30dd-48af-abfe-c1e676217f12 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:28.752942 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-94208d32-5ce6-4a85-8ef4-1b2ef894fd9a None None] MFA Rules not processed for user `9eb2722c122f4aeba23ec16b5a3c485f`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:28.757052 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-94208d32-5ce6-4a85-8ef4-1b2ef894fd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:28.787386 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 860/1698] 10.222.0.47 () {58 vars in 1015 bytes} [Thu Jun 2 13:36:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:28.789015 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94208d32-5ce6-4a85-8ef4-1b2ef894fd9a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:28.840813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94208d32-5ce6-4a85-8ef4-1b2ef894fd9a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:28.858785 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f3f87-226e-4372-b8aa-3b89daad1759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:28.861163 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f3f87-226e-4372-b8aa-3b89daad1759 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:28.861816 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f3f87-226e-4372-b8aa-3b89daad1759 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:28.869312 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f3f87-226e-4372-b8aa-3b89daad1759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:28.949160 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f3f87-226e-4372-b8aa-3b89daad1759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:28.953367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f3f87-226e-4372-b8aa-3b89daad1759 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:29.003101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 861/1699] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:29.004099 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f3f87-226e-4372-b8aa-3b89daad1759 service nova] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:29.009398 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6b4f3f87-226e-4372-b8aa-3b89daad1759 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:29.020005 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c0909-30dd-48af-abfe-c1e676217f12 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:29.053147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef396133-2e29-4eac-8fbc-0e9ed76fbd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:29.060207 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef396133-2e29-4eac-8fbc-0e9ed76fbd1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:29.066168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef396133-2e29-4eac-8fbc-0e9ed76fbd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:29.068216 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef396133-2e29-4eac-8fbc-0e9ed76fbd1b admin admin] PATH_INFO: `/v3/users/4de07807f7b641dc9e6bd7b1308f777e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:29.072107 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef396133-2e29-4eac-8fbc-0e9ed76fbd1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4de07807f7b641dc9e6bd7b1308f777e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:29.075102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: WARNING py.warnings [None req-ef396133-2e29-4eac-8fbc-0e9ed76fbd1b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:36:29.075102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: warnings.warn(msg) Jun 02 13:36:29.075102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: Jun 02 13:36:29.081915 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef396133-2e29-4eac-8fbc-0e9ed76fbd1b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:29.082865 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f3f87-226e-4372-b8aa-3b89daad1759 service nova] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:29.108752 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfc40d-a5c6-42f8-9f41-9efa62fb33a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:29.109693 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfc40d-a5c6-42f8-9f41-9efa62fb33a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:29.110189 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfc40d-a5c6-42f8-9f41-9efa62fb33a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:29.110696 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfc40d-a5c6-42f8-9f41-9efa62fb33a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:29.138609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfc40d-a5c6-42f8-9f41-9efa62fb33a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:29.143020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfc40d-a5c6-42f8-9f41-9efa62fb33a9 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:29.170488 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 862/1700] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:29.338300 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ef396133-2e29-4eac-8fbc-0e9ed76fbd1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4de07807f7b641dc9e6bd7b1308f777e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:29.392959 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ef396133-2e29-4eac-8fbc-0e9ed76fbd1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4de07807f7b641dc9e6bd7b1308f777e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:29.396753 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ef396133-2e29-4eac-8fbc-0e9ed76fbd1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4de07807f7b641dc9e6bd7b1308f777e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:29.469735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ef396133-2e29-4eac-8fbc-0e9ed76fbd1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4de07807f7b641dc9e6bd7b1308f777e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:29.492976 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ef396133-2e29-4eac-8fbc-0e9ed76fbd1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4de07807f7b641dc9e6bd7b1308f777e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:29.512127 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 839/1701] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:36:28 2022] DELETE /identity/v3/users/4de07807f7b641dc9e6bd7b1308f777e => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:31.598986 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfc40d-a5c6-42f8-9f41-9efa62fb33a9 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:31.600509 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4fcfc40d-a5c6-42f8-9f41-9efa62fb33a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:31.650865 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfc40d-a5c6-42f8-9f41-9efa62fb33a9 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:31.870477 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fff91-e34c-4d3d-b33e-ff69e7eb04d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:31.871392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fff91-e34c-4d3d-b33e-ff69e7eb04d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:31.871681 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fff91-e34c-4d3d-b33e-ff69e7eb04d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:31.871962 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fff91-e34c-4d3d-b33e-ff69e7eb04d7 admin admin] PATH_INFO: `/v3/users/e01e44631ee14a2480b4673cf47bb0dc` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:31.878601 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0fff91-e34c-4d3d-b33e-ff69e7eb04d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e01e44631ee14a2480b4673cf47bb0dc)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:31.886725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0fff91-e34c-4d3d-b33e-ff69e7eb04d7 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:32.093587 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0d0fff91-e34c-4d3d-b33e-ff69e7eb04d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e01e44631ee14a2480b4673cf47bb0dc'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:32.114320 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0d0fff91-e34c-4d3d-b33e-ff69e7eb04d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e01e44631ee14a2480b4673cf47bb0dc'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:32.115378 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0d0fff91-e34c-4d3d-b33e-ff69e7eb04d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e01e44631ee14a2480b4673cf47bb0dc'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:32.166206 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0d0fff91-e34c-4d3d-b33e-ff69e7eb04d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e01e44631ee14a2480b4673cf47bb0dc'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:32.186236 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0d0fff91-e34c-4d3d-b33e-ff69e7eb04d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e01e44631ee14a2480b4673cf47bb0dc'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:32.222935 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 863/1702] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:36:31 2022] DELETE /identity/v3/users/e01e44631ee14a2480b4673cf47bb0dc => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:32.242874 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983eb88a-9599-47e3-a655-864c97f02fa1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:32.243427 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983eb88a-9599-47e3-a655-864c97f02fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:32.243503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983eb88a-9599-47e3-a655-864c97f02fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:32.290802 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-983eb88a-9599-47e3-a655-864c97f02fa1 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:32.297482 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-983eb88a-9599-47e3-a655-864c97f02fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:32.471222 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 840/1703] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:32.517754 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fff91-e34c-4d3d-b33e-ff69e7eb04d7 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:32.519607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0d0fff91-e34c-4d3d-b33e-ff69e7eb04d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:32.651299 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:32.697184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fff91-e34c-4d3d-b33e-ff69e7eb04d7 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:32.705110 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983eb88a-9599-47e3-a655-864c97f02fa1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:32.708415 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-983eb88a-9599-47e3-a655-864c97f02fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:32.712196 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e29bad-fcfc-4218-9cb8-bb05be40ec16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:32.713293 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e29bad-fcfc-4218-9cb8-bb05be40ec16 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:32.716459 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e29bad-fcfc-4218-9cb8-bb05be40ec16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:32.716993 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e29bad-fcfc-4218-9cb8-bb05be40ec16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:32.736722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e29bad-fcfc-4218-9cb8-bb05be40ec16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:32.738514 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e29bad-fcfc-4218-9cb8-bb05be40ec16 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:32.750681 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983eb88a-9599-47e3-a655-864c97f02fa1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:32.761276 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa35de-4b31-4e95-b82f-30450d43d5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:32.763288 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa35de-4b31-4e95-b82f-30450d43d5f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:32.763930 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa35de-4b31-4e95-b82f-30450d43d5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:32.765159 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa35de-4b31-4e95-b82f-30450d43d5f4 admin admin] PATH_INFO: `/v3/projects/0cd613de79084aee8decf9153f80e5f2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:32.766864 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa35de-4b31-4e95-b82f-30450d43d5f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cd613de79084aee8decf9153f80e5f2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:32.769984 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa35de-4b31-4e95-b82f-30450d43d5f4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:32.773399 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 864/1704] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:32.798112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:32.902356 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6faa35de-4b31-4e95-b82f-30450d43d5f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cd613de79084aee8decf9153f80e5f2', 'request_id': 'req-6faa35de-4b31-4e95-b82f-30450d43d5f4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:32.925255 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6faa35de-4b31-4e95-b82f-30450d43d5f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cd613de79084aee8decf9153f80e5f2', 'request_id': 'req-6faa35de-4b31-4e95-b82f-30450d43d5f4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:32.954588 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6faa35de-4b31-4e95-b82f-30450d43d5f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cd613de79084aee8decf9153f80e5f2', 'request_id': 'req-6faa35de-4b31-4e95-b82f-30450d43d5f4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:33.006894 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6faa35de-4b31-4e95-b82f-30450d43d5f4 admin admin] The token cache is being invalidate because project 0cd613de79084aee8decf9153f80e5f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:36:33.010285 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6faa35de-4b31-4e95-b82f-30450d43d5f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:33.012340 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6faa35de-4b31-4e95-b82f-30450d43d5f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:33.023472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 841/1705] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:36:32 2022] DELETE /identity/v3/projects/0cd613de79084aee8decf9153f80e5f2 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:33.026246 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e29bad-fcfc-4218-9cb8-bb05be40ec16 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:33.041927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e29bad-fcfc-4218-9cb8-bb05be40ec16 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:33.300529 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2264f-67ac-4817-b74d-65140b520db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:33.304856 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2264f-67ac-4817-b74d-65140b520db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:33.316748 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2264f-67ac-4817-b74d-65140b520db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:33.317096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2264f-67ac-4817-b74d-65140b520db1 admin admin] PATH_INFO: `/v3/users/e17bc5cd16b345c5910958f1865159aa` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:33.318558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2264f-67ac-4817-b74d-65140b520db1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e17bc5cd16b345c5910958f1865159aa)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:33.320675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2264f-67ac-4817-b74d-65140b520db1 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:33.448004 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a1e2264f-67ac-4817-b74d-65140b520db1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e17bc5cd16b345c5910958f1865159aa'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:33.466181 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a1e2264f-67ac-4817-b74d-65140b520db1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e17bc5cd16b345c5910958f1865159aa'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:33.472677 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a1e2264f-67ac-4817-b74d-65140b520db1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e17bc5cd16b345c5910958f1865159aa'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:33.527864 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a1e2264f-67ac-4817-b74d-65140b520db1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e17bc5cd16b345c5910958f1865159aa'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:33.548483 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a1e2264f-67ac-4817-b74d-65140b520db1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e17bc5cd16b345c5910958f1865159aa'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:33.561766 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 865/1706] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:36:33 2022] DELETE /identity/v3/users/e17bc5cd16b345c5910958f1865159aa => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:34.564740 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa35de-4b31-4e95-b82f-30450d43d5f4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:34.567323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6faa35de-4b31-4e95-b82f-30450d43d5f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:34.603304 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa35de-4b31-4e95-b82f-30450d43d5f4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:34.691634 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2264f-67ac-4817-b74d-65140b520db1 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:34.701619 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a1e2264f-67ac-4817-b74d-65140b520db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:34.781233 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8865d9c-b5b9-464b-b0bb-b10d216fcde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:34.786343 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8865d9c-b5b9-464b-b0bb-b10d216fcde8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:34.787638 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8865d9c-b5b9-464b-b0bb-b10d216fcde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:34.789108 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8865d9c-b5b9-464b-b0bb-b10d216fcde8 admin admin] PATH_INFO: `/v3/projects/1c152733c0654735a480fa000e25c4c2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:34.793926 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8865d9c-b5b9-464b-b0bb-b10d216fcde8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c152733c0654735a480fa000e25c4c2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:34.799471 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8865d9c-b5b9-464b-b0bb-b10d216fcde8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:34.859361 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2264f-67ac-4817-b74d-65140b520db1 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:34.864234 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff99f9-913d-4076-9d88-9c8604dfb814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:34.865417 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff99f9-913d-4076-9d88-9c8604dfb814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:34.865675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff99f9-913d-4076-9d88-9c8604dfb814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:34.866052 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff99f9-913d-4076-9d88-9c8604dfb814 admin admin] PATH_INFO: `/v3/projects/cb362ca55c444219bd970d0f64779557` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:34.869395 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff99f9-913d-4076-9d88-9c8604dfb814 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb362ca55c444219bd970d0f64779557)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:34.871234 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff99f9-913d-4076-9d88-9c8604dfb814 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:34.884375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:34.987469 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-edff99f9-913d-4076-9d88-9c8604dfb814 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb362ca55c444219bd970d0f64779557', 'request_id': 'req-edff99f9-913d-4076-9d88-9c8604dfb814'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:34.990719 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d8865d9c-b5b9-464b-b0bb-b10d216fcde8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c152733c0654735a480fa000e25c4c2', 'request_id': 'req-d8865d9c-b5b9-464b-b0bb-b10d216fcde8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:35.021514 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-edff99f9-913d-4076-9d88-9c8604dfb814 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb362ca55c444219bd970d0f64779557', 'request_id': 'req-edff99f9-913d-4076-9d88-9c8604dfb814'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:35.023341 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d8865d9c-b5b9-464b-b0bb-b10d216fcde8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c152733c0654735a480fa000e25c4c2', 'request_id': 'req-d8865d9c-b5b9-464b-b0bb-b10d216fcde8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:35.031287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-edff99f9-913d-4076-9d88-9c8604dfb814 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb362ca55c444219bd970d0f64779557', 'request_id': 'req-edff99f9-913d-4076-9d88-9c8604dfb814'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:35.051074 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d8865d9c-b5b9-464b-b0bb-b10d216fcde8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c152733c0654735a480fa000e25c4c2', 'request_id': 'req-d8865d9c-b5b9-464b-b0bb-b10d216fcde8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:35.064185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-edff99f9-913d-4076-9d88-9c8604dfb814 admin admin] The token cache is being invalidate because project cb362ca55c444219bd970d0f64779557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:36:35.065351 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-edff99f9-913d-4076-9d88-9c8604dfb814 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:35.066268 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-edff99f9-913d-4076-9d88-9c8604dfb814 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:35.077907 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 866/1707] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:36:34 2022] DELETE /identity/v3/projects/cb362ca55c444219bd970d0f64779557 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:35.079870 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdb6b9-a9e5-4528-9b16-db6727b50c15 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:35.080709 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdb6b9-a9e5-4528-9b16-db6727b50c15 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:35.081196 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdb6b9-a9e5-4528-9b16-db6727b50c15 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:35.084718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 867/1708] 10.222.0.32 () {54 vars in 921 bytes} [Thu Jun 2 13:36:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:35.089186 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0dfe1-b653-4a53-b0ff-e76332c83eb8 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:35.089583 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0dfe1-b653-4a53-b0ff-e76332c83eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:35.089969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0dfe1-b653-4a53-b0ff-e76332c83eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:35.096603 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d8865d9c-b5b9-464b-b0bb-b10d216fcde8 admin admin] The token cache is being invalidate because project 1c152733c0654735a480fa000e25c4c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:36:35.096917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d8865d9c-b5b9-464b-b0bb-b10d216fcde8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:35.103722 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d8865d9c-b5b9-464b-b0bb-b10d216fcde8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:35.110981 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 842/1709] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:36:34 2022] DELETE /identity/v3/projects/1c152733c0654735a480fa000e25c4c2 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:35.116232 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8865d9c-b5b9-464b-b0bb-b10d216fcde8 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:35.121049 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d8865d9c-b5b9-464b-b0bb-b10d216fcde8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:35.141683 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3cf0dfe1-b653-4a53-b0ff-e76332c83eb8 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:35.142919 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3cf0dfe1-b653-4a53-b0ff-e76332c83eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:35.249714 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:35.349240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 868/1710] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:35.351221 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a6587-c82d-4a6c-859f-e12587fa893b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:35.351520 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a6587-c82d-4a6c-859f-e12587fa893b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:35.351793 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a6587-c82d-4a6c-859f-e12587fa893b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:35.367512 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8865d9c-b5b9-464b-b0bb-b10d216fcde8 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:35.388884 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fcd6b2-3e31-4005-8b12-5063f5aad957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:35.389795 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcd6b2-3e31-4005-8b12-5063f5aad957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:35.390089 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcd6b2-3e31-4005-8b12-5063f5aad957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:35.390374 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcd6b2-3e31-4005-8b12-5063f5aad957 admin admin] PATH_INFO: `/v3/users/fec1cda1cad442b3ac6a1cc98e0747b0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:35.395749 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fcd6b2-3e31-4005-8b12-5063f5aad957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fec1cda1cad442b3ac6a1cc98e0747b0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:35.395957 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-316a6587-c82d-4a6c-859f-e12587fa893b None None] MFA Rules not processed for user `b2e5d9f3c4e04ca3bf52b28b67d2a4d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:35.397224 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-316a6587-c82d-4a6c-859f-e12587fa893b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:35.401297 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fcd6b2-3e31-4005-8b12-5063f5aad957 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:35.538073 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 869/1711] 10.222.0.32 () {58 vars in 1018 bytes} [Thu Jun 2 13:36:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:35.540004 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd765c8-dd41-4d31-a2d6-ad201a3d35cd None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:35.540460 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd765c8-dd41-4d31-a2d6-ad201a3d35cd None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:35.540733 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd765c8-dd41-4d31-a2d6-ad201a3d35cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:35.551114 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-65fcd6b2-3e31-4005-8b12-5063f5aad957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fec1cda1cad442b3ac6a1cc98e0747b0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:35.565382 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-65fcd6b2-3e31-4005-8b12-5063f5aad957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fec1cda1cad442b3ac6a1cc98e0747b0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:35.566955 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-65fcd6b2-3e31-4005-8b12-5063f5aad957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fec1cda1cad442b3ac6a1cc98e0747b0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:35.581673 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-dbd765c8-dd41-4d31-a2d6-ad201a3d35cd None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:35.582927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-dbd765c8-dd41-4d31-a2d6-ad201a3d35cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:35.602376 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 870/1712] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:35.604911 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd765c8-dd41-4d31-a2d6-ad201a3d35cd None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:35.609514 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-65fcd6b2-3e31-4005-8b12-5063f5aad957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fec1cda1cad442b3ac6a1cc98e0747b0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:35.627289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd765c8-dd41-4d31-a2d6-ad201a3d35cd None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:35.637114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0acef22-b1c1-4e51-8248-014eda255ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:35.637828 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0acef22-b1c1-4e51-8248-014eda255ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:35.638121 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0acef22-b1c1-4e51-8248-014eda255ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:35.638407 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0acef22-b1c1-4e51-8248-014eda255ed4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:35.639286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0acef22-b1c1-4e51-8248-014eda255ed4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:35.639605 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0acef22-b1c1-4e51-8248-014eda255ed4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:35.641269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-65fcd6b2-3e31-4005-8b12-5063f5aad957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fec1cda1cad442b3ac6a1cc98e0747b0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:35.641394 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0acef22-b1c1-4e51-8248-014eda255ed4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:35.653488 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 843/1713] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:36:35 2022] DELETE /identity/v3/users/fec1cda1cad442b3ac6a1cc98e0747b0 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:35.676469 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 871/1714] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:35.678019 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fcd6b2-3e31-4005-8b12-5063f5aad957 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:35.857317 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fcd6b2-3e31-4005-8b12-5063f5aad957 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:35.879746 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03093ac9-976f-4ba7-b48f-5495bb69950e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:35.880602 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03093ac9-976f-4ba7-b48f-5495bb69950e admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:35.883495 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03093ac9-976f-4ba7-b48f-5495bb69950e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:35.884337 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03093ac9-976f-4ba7-b48f-5495bb69950e admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:35.887281 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03093ac9-976f-4ba7-b48f-5495bb69950e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:35.889450 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03093ac9-976f-4ba7-b48f-5495bb69950e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:35.963913 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 844/1715] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:36:35 2022] POST /identity/v3/projects => generated 363 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:35.964288 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0acef22-b1c1-4e51-8248-014eda255ed4 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:35.979211 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0acef22-b1c1-4e51-8248-014eda255ed4 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:35.996628 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:36.221450 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b568f-0e2b-48d6-aade-36eb02cc6b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:36.229739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b568f-0e2b-48d6-aade-36eb02cc6b8f admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:36.236737 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b568f-0e2b-48d6-aade-36eb02cc6b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:36.239995 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b568f-0e2b-48d6-aade-36eb02cc6b8f admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:36.243884 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b568f-0e2b-48d6-aade-36eb02cc6b8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:36.248827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b568f-0e2b-48d6-aade-36eb02cc6b8f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:36.295866 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 872/1716] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:36:35 2022] POST /identity/v3/users => generated 282 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:36:36.301200 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03093ac9-976f-4ba7-b48f-5495bb69950e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:36.328355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03093ac9-976f-4ba7-b48f-5495bb69950e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:36.355056 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e380e14-2bff-492e-8367-69867240ef96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:36.368215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e380e14-2bff-492e-8367-69867240ef96 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:36.368215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e380e14-2bff-492e-8367-69867240ef96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:36.368644 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e380e14-2bff-492e-8367-69867240ef96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:36.369237 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e380e14-2bff-492e-8367-69867240ef96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:36.373691 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e380e14-2bff-492e-8367-69867240ef96 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:36.404461 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 845/1717] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:36.409412 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b568f-0e2b-48d6-aade-36eb02cc6b8f admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:36.436619 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b568f-0e2b-48d6-aade-36eb02cc6b8f admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:36.448188 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4722176-c119-4eb0-a127-dab07e5729a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:36.449864 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4722176-c119-4eb0-a127-dab07e5729a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:36.450833 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4722176-c119-4eb0-a127-dab07e5729a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:36.451376 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4722176-c119-4eb0-a127-dab07e5729a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:36.453818 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4722176-c119-4eb0-a127-dab07e5729a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:36.458046 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4722176-c119-4eb0-a127-dab07e5729a3 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:36.476839 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 873/1718] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:36:36.481625 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e380e14-2bff-492e-8367-69867240ef96 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:36.504152 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e380e14-2bff-492e-8367-69867240ef96 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:36.523365 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfd7a6-404c-4787-8222-87267405b25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:36.526742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfd7a6-404c-4787-8222-87267405b25e admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:36.529055 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfd7a6-404c-4787-8222-87267405b25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:36.530748 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfd7a6-404c-4787-8222-87267405b25e admin admin] PATH_INFO: `/v3/projects/2915f6dacc9b483db91d692e6c71f3b9/users/f78790440a5b409d972fb0e9d94c59e4/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:36.594625 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfd7a6-404c-4787-8222-87267405b25e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2915f6dacc9b483db91d692e6c71f3b9, user_id=f78790440a5b409d972fb0e9d94c59e4, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:36.617968 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfd7a6-404c-4787-8222-87267405b25e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:36.650015 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 846/1719] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:36 2022] PUT /identity/v3/projects/2915f6dacc9b483db91d692e6c71f3b9/users/f78790440a5b409d972fb0e9d94c59e4/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:36.662497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b14be-0e53-4d77-8a17-d21a97f688eb None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:36.663008 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b14be-0e53-4d77-8a17-d21a97f688eb None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:36.664202 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b14be-0e53-4d77-8a17-d21a97f688eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:36.746084 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-1d8b14be-0e53-4d77-8a17-d21a97f688eb None None] MFA Rules not processed for user `f78790440a5b409d972fb0e9d94c59e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:36.751701 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1d8b14be-0e53-4d77-8a17-d21a97f688eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:36.942218 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfd7a6-404c-4787-8222-87267405b25e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:36.945653 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4abfd7a6-404c-4787-8222-87267405b25e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:36.953829 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:36.995921 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 874/1720] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:36 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:36.996990 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b14be-0e53-4d77-8a17-d21a97f688eb None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:37.140011 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b14be-0e53-4d77-8a17-d21a97f688eb None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:37.155450 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eea776-cb78-4272-8210-813e62ad0137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:37.156268 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eea776-cb78-4272-8210-813e62ad0137 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:37.156710 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eea776-cb78-4272-8210-813e62ad0137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:37.157064 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eea776-cb78-4272-8210-813e62ad0137 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:37.157950 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eea776-cb78-4272-8210-813e62ad0137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:37.162618 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eea776-cb78-4272-8210-813e62ad0137 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:37.237647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:37.258847 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 875/1721] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:36:36 2022] POST /identity/v3/projects => generated 363 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:37.260034 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eea776-cb78-4272-8210-813e62ad0137 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:37.261208 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfd7a6-404c-4787-8222-87267405b25e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:37.452773 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eea776-cb78-4272-8210-813e62ad0137 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:37.464052 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c354c3b-a987-4662-8089-55e531c073ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:37.464908 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c354c3b-a987-4662-8089-55e531c073ea admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:37.465303 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c354c3b-a987-4662-8089-55e531c073ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:37.466032 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c354c3b-a987-4662-8089-55e531c073ea admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:37.467632 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c354c3b-a987-4662-8089-55e531c073ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:37.470253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c354c3b-a987-4662-8089-55e531c073ea admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:37.479095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28996b-3624-46d1-9722-9bced4a04b5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:37.479908 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28996b-3624-46d1-9722-9bced4a04b5e service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:37.480606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28996b-3624-46d1-9722-9bced4a04b5e service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:37.481567 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28996b-3624-46d1-9722-9bced4a04b5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:37.488879 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1e28996b-3624-46d1-9722-9bced4a04b5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:37.515071 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28996b-3624-46d1-9722-9bced4a04b5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:37.518618 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 876/1722] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:36:37 2022] POST /identity/v3/users => generated 288 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:37.518756 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28996b-3624-46d1-9722-9bced4a04b5e service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:37.519823 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c354c3b-a987-4662-8089-55e531c073ea admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:37.549180 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c354c3b-a987-4662-8089-55e531c073ea admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:37.564992 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 847/1723] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:37.568310 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ecfee-0988-45dc-946b-425a1e7b869b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:37.569109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ecfee-0988-45dc-946b-425a1e7b869b admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:37.570041 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ecfee-0988-45dc-946b-425a1e7b869b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:37.570426 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ecfee-0988-45dc-946b-425a1e7b869b admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:37.571288 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ecfee-0988-45dc-946b-425a1e7b869b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:37.574406 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ecfee-0988-45dc-946b-425a1e7b869b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:37.627490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 877/1724] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:37.627824 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28996b-3624-46d1-9722-9bced4a04b5e service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:37.652067 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28996b-3624-46d1-9722-9bced4a04b5e service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:37.668514 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34196a94-f34e-438c-966b-2058f47c453f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:37.669434 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34196a94-f34e-438c-966b-2058f47c453f admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:37.669726 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34196a94-f34e-438c-966b-2058f47c453f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:37.670011 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34196a94-f34e-438c-966b-2058f47c453f admin admin] PATH_INFO: `/v3/projects/43d33a7faad645659a63ce561a774159/users/f7c81fda4dd749c69c33c8f9ab98fc10/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:37.729189 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34196a94-f34e-438c-966b-2058f47c453f admin admin] RBAC: Authorizing `identity:create_grant(project_id=43d33a7faad645659a63ce561a774159, user_id=f7c81fda4dd749c69c33c8f9ab98fc10, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:37.731958 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34196a94-f34e-438c-966b-2058f47c453f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:37.778085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 848/1725] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:37 2022] PUT /identity/v3/projects/43d33a7faad645659a63ce561a774159/users/f7c81fda4dd749c69c33c8f9ab98fc10/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:36:37.781479 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ecfee-0988-45dc-946b-425a1e7b869b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:37.796160 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ecfee-0988-45dc-946b-425a1e7b869b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:37.993536 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e818f7e-e580-474a-903c-a820c6a28c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:37.994614 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e818f7e-e580-474a-903c-a820c6a28c66 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:37.995111 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e818f7e-e580-474a-903c-a820c6a28c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:37.995621 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e818f7e-e580-474a-903c-a820c6a28c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:37.996604 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e818f7e-e580-474a-903c-a820c6a28c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:37.998962 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e818f7e-e580-474a-903c-a820c6a28c66 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:38.032868 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 878/1726] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:38.034345 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34196a94-f34e-438c-966b-2058f47c453f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:38.051597 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34196a94-f34e-438c-966b-2058f47c453f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:38.063834 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4470747-c901-49d3-a6ff-6f4d9b8cfd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:38.066073 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4470747-c901-49d3-a6ff-6f4d9b8cfd1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:38.066735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4470747-c901-49d3-a6ff-6f4d9b8cfd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:38.067129 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4470747-c901-49d3-a6ff-6f4d9b8cfd1d admin admin] PATH_INFO: `/v3/projects/43d33a7faad645659a63ce561a774159/users/f7c81fda4dd749c69c33c8f9ab98fc10/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:38.074084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4470747-c901-49d3-a6ff-6f4d9b8cfd1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=43d33a7faad645659a63ce561a774159, user_id=f7c81fda4dd749c69c33c8f9ab98fc10, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:38.084753 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4470747-c901-49d3-a6ff-6f4d9b8cfd1d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:38.209160 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 849/1727] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:38 2022] PUT /identity/v3/projects/43d33a7faad645659a63ce561a774159/users/f7c81fda4dd749c69c33c8f9ab98fc10/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:36:38.211018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f86663-28e1-4a0e-87b7-ba6842a74bc1 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:38.211425 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f86663-28e1-4a0e-87b7-ba6842a74bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:38.211825 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f86663-28e1-4a0e-87b7-ba6842a74bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:38.290367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-07f86663-28e1-4a0e-87b7-ba6842a74bc1 None None] MFA Rules not processed for user `f7c81fda4dd749c69c33c8f9ab98fc10`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:38.291781 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-07f86663-28e1-4a0e-87b7-ba6842a74bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:38.493035 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:38.503042 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 879/1728] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:38 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:38.518669 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4470747-c901-49d3-a6ff-6f4d9b8cfd1d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:38.520936 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a4470747-c901-49d3-a6ff-6f4d9b8cfd1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:38.773798 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:38.783980 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4470747-c901-49d3-a6ff-6f4d9b8cfd1d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:38.798207 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374c188-c625-4773-bda7-97c2c8684d4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:38.799647 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374c188-c625-4773-bda7-97c2c8684d4f service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:38.799929 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374c188-c625-4773-bda7-97c2c8684d4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:38.800216 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374c188-c625-4773-bda7-97c2c8684d4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:38.813203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374c188-c625-4773-bda7-97c2c8684d4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:38.815273 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374c188-c625-4773-bda7-97c2c8684d4f service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:38.834904 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 850/1729] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:38 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:39.065177 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fb9a5-17d0-44f3-9406-be6360002366 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:39.066119 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fb9a5-17d0-44f3-9406-be6360002366 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:39.066690 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fb9a5-17d0-44f3-9406-be6360002366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:39.087438 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374c188-c625-4773-bda7-97c2c8684d4f service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:39.090017 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f374c188-c625-4773-bda7-97c2c8684d4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:39.143368 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-671fb9a5-17d0-44f3-9406-be6360002366 None None] MFA Rules not processed for user `4e88422338024035b5c64d2788965086`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:39.146842 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-671fb9a5-17d0-44f3-9406-be6360002366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:39.275570 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374c188-c625-4773-bda7-97c2c8684d4f service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:39.281235 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea33b7-89d6-4ba5-a913-c0496af17299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:39.282165 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea33b7-89d6-4ba5-a913-c0496af17299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:39.283030 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea33b7-89d6-4ba5-a913-c0496af17299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:39.283326 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea33b7-89d6-4ba5-a913-c0496af17299 admin admin] PATH_INFO: `/v3/projects/dc3c067f85e74cb0be300bc5ca63d672` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:39.284645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea33b7-89d6-4ba5-a913-c0496af17299 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc3c067f85e74cb0be300bc5ca63d672)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:39.287274 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 880/1730] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:39.292721 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea33b7-89d6-4ba5-a913-c0496af17299 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:39.379140 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b2ea33b7-89d6-4ba5-a913-c0496af17299 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc3c067f85e74cb0be300bc5ca63d672', 'request_id': 'req-b2ea33b7-89d6-4ba5-a913-c0496af17299'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:39.386407 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b2ea33b7-89d6-4ba5-a913-c0496af17299 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc3c067f85e74cb0be300bc5ca63d672', 'request_id': 'req-b2ea33b7-89d6-4ba5-a913-c0496af17299'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:39.402472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b2ea33b7-89d6-4ba5-a913-c0496af17299 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc3c067f85e74cb0be300bc5ca63d672', 'request_id': 'req-b2ea33b7-89d6-4ba5-a913-c0496af17299'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:39.439230 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b2ea33b7-89d6-4ba5-a913-c0496af17299 admin admin] The token cache is being invalidate because project dc3c067f85e74cb0be300bc5ca63d672 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:36:39.439896 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b2ea33b7-89d6-4ba5-a913-c0496af17299 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:39.441756 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b2ea33b7-89d6-4ba5-a913-c0496af17299 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:39.450946 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8614cfb-653b-49cc-8e03-90e4eb0e6bca None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:39.451571 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8614cfb-653b-49cc-8e03-90e4eb0e6bca None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:39.452158 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8614cfb-653b-49cc-8e03-90e4eb0e6bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:39.452405 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 851/1731] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:36:39 2022] DELETE /identity/v3/projects/dc3c067f85e74cb0be300bc5ca63d672 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:36:39.513407 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c8614cfb-653b-49cc-8e03-90e4eb0e6bca None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:39.515936 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c8614cfb-653b-49cc-8e03-90e4eb0e6bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:39.612605 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea33b7-89d6-4ba5-a913-c0496af17299 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:39.614599 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b2ea33b7-89d6-4ba5-a913-c0496af17299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:39.636126 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 881/1732] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:39.644746 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a69b52-6391-42cb-b075-0cd12c8ff4c3 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:39.645347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a69b52-6391-42cb-b075-0cd12c8ff4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:39.646321 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a69b52-6391-42cb-b075-0cd12c8ff4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:39.670295 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-65a69b52-6391-42cb-b075-0cd12c8ff4c3 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:39.672539 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-65a69b52-6391-42cb-b075-0cd12c8ff4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:39.693942 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 882/1733] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:39.695120 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a69b52-6391-42cb-b075-0cd12c8ff4c3 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:39.697148 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea33b7-89d6-4ba5-a913-c0496af17299 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:39.702927 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2577d27-7258-4051-8dcc-c2ebbf4bd71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:39.703819 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2577d27-7258-4051-8dcc-c2ebbf4bd71f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:39.704202 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2577d27-7258-4051-8dcc-c2ebbf4bd71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:39.704418 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2577d27-7258-4051-8dcc-c2ebbf4bd71f admin admin] PATH_INFO: `/v3/users/f78790440a5b409d972fb0e9d94c59e4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:39.706111 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2577d27-7258-4051-8dcc-c2ebbf4bd71f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f78790440a5b409d972fb0e9d94c59e4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:39.707537 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a69b52-6391-42cb-b075-0cd12c8ff4c3 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:39.708065 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2577d27-7258-4051-8dcc-c2ebbf4bd71f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:39.713357 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c949647-5026-470a-b66c-dbde85245ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:39.714279 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c949647-5026-470a-b66c-dbde85245ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:39.715199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c949647-5026-470a-b66c-dbde85245ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:39.715199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c949647-5026-470a-b66c-dbde85245ce7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:39.716189 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c949647-5026-470a-b66c-dbde85245ce7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:39.716646 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c949647-5026-470a-b66c-dbde85245ce7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:39.718359 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c949647-5026-470a-b66c-dbde85245ce7 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:39.738719 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 883/1734] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:39.739733 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c949647-5026-470a-b66c-dbde85245ce7 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:39.746129 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:39.756481 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c949647-5026-470a-b66c-dbde85245ce7 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:39.765724 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f215e16-b394-4837-9172-6cea9b87ec3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:39.766604 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f215e16-b394-4837-9172-6cea9b87ec3a admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:39.769575 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f215e16-b394-4837-9172-6cea9b87ec3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:39.770762 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f215e16-b394-4837-9172-6cea9b87ec3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:39.774224 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f215e16-b394-4837-9172-6cea9b87ec3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:39.780826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f215e16-b394-4837-9172-6cea9b87ec3a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:39.784709 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d2577d27-7258-4051-8dcc-c2ebbf4bd71f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f78790440a5b409d972fb0e9d94c59e4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:39.800157 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d2577d27-7258-4051-8dcc-c2ebbf4bd71f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f78790440a5b409d972fb0e9d94c59e4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:39.801164 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d2577d27-7258-4051-8dcc-c2ebbf4bd71f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f78790440a5b409d972fb0e9d94c59e4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:39.829147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d2577d27-7258-4051-8dcc-c2ebbf4bd71f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f78790440a5b409d972fb0e9d94c59e4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:39.834630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 884/1735] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:36:39 2022] POST /identity/v3/projects => generated 369 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:39.838968 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f215e16-b394-4837-9172-6cea9b87ec3a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:39.841044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3f215e16-b394-4837-9172-6cea9b87ec3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:39.845047 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d2577d27-7258-4051-8dcc-c2ebbf4bd71f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f78790440a5b409d972fb0e9d94c59e4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:39.856467 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 852/1736] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:36:39 2022] DELETE /identity/v3/users/f78790440a5b409d972fb0e9d94c59e4 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:36:39.861592 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53c7b9-d6fb-4455-b594-1a9c10ac042c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:39.861976 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53c7b9-d6fb-4455-b594-1a9c10ac042c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:39.862306 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53c7b9-d6fb-4455-b594-1a9c10ac042c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:39.887116 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-eb53c7b9-d6fb-4455-b594-1a9c10ac042c None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:39.888859 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-eb53c7b9-d6fb-4455-b594-1a9c10ac042c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:39.953118 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f215e16-b394-4837-9172-6cea9b87ec3a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:39.967015 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:39.982241 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 853/1737] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:39.984631 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af39144-78ba-43d2-9a0b-2e9739d8eb6b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:39.985766 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af39144-78ba-43d2-9a0b-2e9739d8eb6b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:39.986234 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af39144-78ba-43d2-9a0b-2e9739d8eb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:40.009800 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2af39144-78ba-43d2-9a0b-2e9739d8eb6b None None] MFA Rules not processed for user `88bc03c141d64772b606e087d86e973e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:40.014513 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2af39144-78ba-43d2-9a0b-2e9739d8eb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:40.053511 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae234d58-4229-4427-b670-098e5a1d3835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:40.055903 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae234d58-4229-4427-b670-098e5a1d3835 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:40.055903 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae234d58-4229-4427-b670-098e5a1d3835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:40.055903 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae234d58-4229-4427-b670-098e5a1d3835 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:40.057233 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae234d58-4229-4427-b670-098e5a1d3835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:40.060117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae234d58-4229-4427-b670-098e5a1d3835 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:40.083530 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 885/1738] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:36:39 2022] POST /identity/v3/users => generated 285 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:40.085818 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae234d58-4229-4427-b670-098e5a1d3835 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:40.087672 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ae234d58-4229-4427-b670-098e5a1d3835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:40.104050 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 854/1739] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:40.106414 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af39144-78ba-43d2-9a0b-2e9739d8eb6b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:40.124747 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af39144-78ba-43d2-9a0b-2e9739d8eb6b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:40.130211 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b30b2a-e9cf-490c-a61c-e3caacbdc379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:40.130895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b30b2a-e9cf-490c-a61c-e3caacbdc379 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:40.131182 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b30b2a-e9cf-490c-a61c-e3caacbdc379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:40.131460 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b30b2a-e9cf-490c-a61c-e3caacbdc379 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:40.132818 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b30b2a-e9cf-490c-a61c-e3caacbdc379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:40.134019 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b30b2a-e9cf-490c-a61c-e3caacbdc379 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:40.157748 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 855/1740] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:40.158890 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b30b2a-e9cf-490c-a61c-e3caacbdc379 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:40.187934 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b30b2a-e9cf-490c-a61c-e3caacbdc379 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:40.193613 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac65a8-06d9-4b88-a9af-409bd8387523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:40.193613 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac65a8-06d9-4b88-a9af-409bd8387523 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:40.193812 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac65a8-06d9-4b88-a9af-409bd8387523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:40.194093 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac65a8-06d9-4b88-a9af-409bd8387523 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:40.194896 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac65a8-06d9-4b88-a9af-409bd8387523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:40.196558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac65a8-06d9-4b88-a9af-409bd8387523 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:40.216561 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 856/1741] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:40.220371 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac65a8-06d9-4b88-a9af-409bd8387523 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:40.233624 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae234d58-4229-4427-b670-098e5a1d3835 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:40.244064 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac65a8-06d9-4b88-a9af-409bd8387523 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:40.248127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49746c-e077-4639-928b-f20a790b0235 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:40.250348 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c8b3f-aeb3-4c5e-8880-ecafa1da81d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:40.251216 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49746c-e077-4639-928b-f20a790b0235 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:40.251512 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49746c-e077-4639-928b-f20a790b0235 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:40.251793 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49746c-e077-4639-928b-f20a790b0235 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:40.252154 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c8b3f-aeb3-4c5e-8880-ecafa1da81d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:40.252672 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c8b3f-aeb3-4c5e-8880-ecafa1da81d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:40.253146 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c8b3f-aeb3-4c5e-8880-ecafa1da81d9 admin admin] PATH_INFO: `/v3/projects/f98e2a29a3a74e0bbfec38ed55f1b935/users/3c5110dc4b234b9b95ce931241e3925a/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:40.283326 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49746c-e077-4639-928b-f20a790b0235 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:40.285315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49746c-e077-4639-928b-f20a790b0235 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:40.286396 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c8b3f-aeb3-4c5e-8880-ecafa1da81d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f98e2a29a3a74e0bbfec38ed55f1b935, user_id=3c5110dc4b234b9b95ce931241e3925a, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:40.291303 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c8b3f-aeb3-4c5e-8880-ecafa1da81d9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:40.309281 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:40.313074 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 886/1742] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:40.341608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 857/1743] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:40 2022] PUT /identity/v3/projects/f98e2a29a3a74e0bbfec38ed55f1b935/users/3c5110dc4b234b9b95ce931241e3925a/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:36:40.347141 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90225b81-bd9b-4a1a-aaee-cadd732dfb2c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:40.353479 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90225b81-bd9b-4a1a-aaee-cadd732dfb2c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:40.354342 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90225b81-bd9b-4a1a-aaee-cadd732dfb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:40.407148 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-90225b81-bd9b-4a1a-aaee-cadd732dfb2c None None] MFA Rules not processed for user `3c5110dc4b234b9b95ce931241e3925a`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:40.410907 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-90225b81-bd9b-4a1a-aaee-cadd732dfb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:40.611488 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 887/1744] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:40.614297 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c8b3f-aeb3-4c5e-8880-ecafa1da81d9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:40.729129 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c8b3f-aeb3-4c5e-8880-ecafa1da81d9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:40.737591 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c82d7-546d-4109-b421-66460490e555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:40.740503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c82d7-546d-4109-b421-66460490e555 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:40.740860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c82d7-546d-4109-b421-66460490e555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:40.741973 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c82d7-546d-4109-b421-66460490e555 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:40.742768 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c82d7-546d-4109-b421-66460490e555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:40.749466 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c82d7-546d-4109-b421-66460490e555 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:40.794322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 858/1745] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:36:40 2022] POST /identity/v3/projects => generated 369 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:40.799101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90225b81-bd9b-4a1a-aaee-cadd732dfb2c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:40.819700 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90225b81-bd9b-4a1a-aaee-cadd732dfb2c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:40.874401 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:40.887535 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c82d7-546d-4109-b421-66460490e555 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:40.892202 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a50c82d7-546d-4109-b421-66460490e555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:40.917070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27a816-2c37-48a8-a2b0-175fd6e1d08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:40.917852 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27a816-2c37-48a8-a2b0-175fd6e1d08d admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:40.918292 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27a816-2c37-48a8-a2b0-175fd6e1d08d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:40.919177 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27a816-2c37-48a8-a2b0-175fd6e1d08d admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:40.920176 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27a816-2c37-48a8-a2b0-175fd6e1d08d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:40.923090 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27a816-2c37-48a8-a2b0-175fd6e1d08d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:40.933155 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c82d7-546d-4109-b421-66460490e555 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:40.938214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b2e28-bf4a-44ee-94fb-e44ede1c5b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:40.939141 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b2e28-bf4a-44ee-94fb-e44ede1c5b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:40.939382 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b2e28-bf4a-44ee-94fb-e44ede1c5b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:40.939732 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b2e28-bf4a-44ee-94fb-e44ede1c5b2b admin admin] PATH_INFO: `/v3/projects/2915f6dacc9b483db91d692e6c71f3b9` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:40.941050 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b2e28-bf4a-44ee-94fb-e44ede1c5b2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2915f6dacc9b483db91d692e6c71f3b9)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:40.943510 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b2e28-bf4a-44ee-94fb-e44ede1c5b2b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:40.951885 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 888/1746] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:36:40 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:40.953061 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27a816-2c37-48a8-a2b0-175fd6e1d08d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:40.965301 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27a816-2c37-48a8-a2b0-175fd6e1d08d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:40.970250 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5308b8-95b4-4cf3-a6dc-88f675eaa167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:40.971507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5308b8-95b4-4cf3-a6dc-88f675eaa167 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:40.971803 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5308b8-95b4-4cf3-a6dc-88f675eaa167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:40.972088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5308b8-95b4-4cf3-a6dc-88f675eaa167 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:40.972863 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5308b8-95b4-4cf3-a6dc-88f675eaa167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:40.974474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5308b8-95b4-4cf3-a6dc-88f675eaa167 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:40.989390 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 889/1747] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:40.991676 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5308b8-95b4-4cf3-a6dc-88f675eaa167 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:41.004495 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5308b8-95b4-4cf3-a6dc-88f675eaa167 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:41.010992 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d16b2e28-bf4a-44ee-94fb-e44ede1c5b2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2915f6dacc9b483db91d692e6c71f3b9', 'request_id': 'req-d16b2e28-bf4a-44ee-94fb-e44ede1c5b2b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:41.017381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d16b2e28-bf4a-44ee-94fb-e44ede1c5b2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2915f6dacc9b483db91d692e6c71f3b9', 'request_id': 'req-d16b2e28-bf4a-44ee-94fb-e44ede1c5b2b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:41.028536 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d16b2e28-bf4a-44ee-94fb-e44ede1c5b2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2915f6dacc9b483db91d692e6c71f3b9', 'request_id': 'req-d16b2e28-bf4a-44ee-94fb-e44ede1c5b2b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:41.046148 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d16b2e28-bf4a-44ee-94fb-e44ede1c5b2b admin admin] The token cache is being invalidate because project 2915f6dacc9b483db91d692e6c71f3b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:36:41.046513 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d16b2e28-bf4a-44ee-94fb-e44ede1c5b2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:41.047280 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d16b2e28-bf4a-44ee-94fb-e44ede1c5b2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:41.051820 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 859/1748] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:36:40 2022] DELETE /identity/v3/projects/2915f6dacc9b483db91d692e6c71f3b9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:41.052972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b2e28-bf4a-44ee-94fb-e44ede1c5b2b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:41.054534 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d16b2e28-bf4a-44ee-94fb-e44ede1c5b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:41.084309 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8cf21-64c1-4d85-8afe-2df1097b669f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:41.085867 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8cf21-64c1-4d85-8afe-2df1097b669f admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:41.086221 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8cf21-64c1-4d85-8afe-2df1097b669f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:41.086508 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8cf21-64c1-4d85-8afe-2df1097b669f admin admin] PATH_INFO: `/v3/projects/1a9000009e8944a7991977dbc73926c3/users/5b1b7bc0dafc44939bde0ee3b83878df/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:41.104629 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8cf21-64c1-4d85-8afe-2df1097b669f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9000009e8944a7991977dbc73926c3, user_id=5b1b7bc0dafc44939bde0ee3b83878df, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:41.107280 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8cf21-64c1-4d85-8afe-2df1097b669f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:41.123651 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 890/1749] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:40 2022] PUT /identity/v3/projects/1a9000009e8944a7991977dbc73926c3/users/5b1b7bc0dafc44939bde0ee3b83878df/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:41.127444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8cf21-64c1-4d85-8afe-2df1097b669f admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:41.129143 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c9b8cf21-64c1-4d85-8afe-2df1097b669f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:41.138441 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b2e28-bf4a-44ee-94fb-e44ede1c5b2b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:41.182815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:41.224072 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8cf21-64c1-4d85-8afe-2df1097b669f admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:41.231304 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0de7cc-ff28-4c88-b7ee-362b49146ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:41.232245 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0de7cc-ff28-4c88-b7ee-362b49146ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:41.232504 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0de7cc-ff28-4c88-b7ee-362b49146ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:41.232782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0de7cc-ff28-4c88-b7ee-362b49146ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:41.233603 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0de7cc-ff28-4c88-b7ee-362b49146ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:41.235756 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0de7cc-ff28-4c88-b7ee-362b49146ec6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:41.250641 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 891/1750] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:41.256154 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0de7cc-ff28-4c88-b7ee-362b49146ec6 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:41.278303 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0de7cc-ff28-4c88-b7ee-362b49146ec6 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:41.300097 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240a44f-16ed-4771-9974-52052041d8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:41.301479 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240a44f-16ed-4771-9974-52052041d8bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:41.301939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240a44f-16ed-4771-9974-52052041d8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:41.302434 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240a44f-16ed-4771-9974-52052041d8bd admin admin] PATH_INFO: `/v3/projects/1a9000009e8944a7991977dbc73926c3/users/5b1b7bc0dafc44939bde0ee3b83878df/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:41.316214 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240a44f-16ed-4771-9974-52052041d8bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9000009e8944a7991977dbc73926c3, user_id=5b1b7bc0dafc44939bde0ee3b83878df, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:41.319981 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240a44f-16ed-4771-9974-52052041d8bd admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:41.339936 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb94457-95b8-42a4-8550-3e3ac8cd3541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:41.340906 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb94457-95b8-42a4-8550-3e3ac8cd3541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:41.341227 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb94457-95b8-42a4-8550-3e3ac8cd3541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:41.341540 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb94457-95b8-42a4-8550-3e3ac8cd3541 admin admin] PATH_INFO: `/v3/users/f7c81fda4dd749c69c33c8f9ab98fc10` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:41.359226 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 892/1751] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:41 2022] PUT /identity/v3/projects/1a9000009e8944a7991977dbc73926c3/users/5b1b7bc0dafc44939bde0ee3b83878df/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:41.359440 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb94457-95b8-42a4-8550-3e3ac8cd3541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7c81fda4dd749c69c33c8f9ab98fc10)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:41.361106 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce1725-ba78-4d41-abf4-97d31efcb4f1 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:41.361467 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce1725-ba78-4d41-abf4-97d31efcb4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:41.361816 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce1725-ba78-4d41-abf4-97d31efcb4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:41.364887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb94457-95b8-42a4-8550-3e3ac8cd3541 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:41.434835 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c5ce1725-ba78-4d41-abf4-97d31efcb4f1 None None] MFA Rules not processed for user `5b1b7bc0dafc44939bde0ee3b83878df`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:41.436096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c5ce1725-ba78-4d41-abf4-97d31efcb4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:41.454430 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:41.492472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-adb94457-95b8-42a4-8550-3e3ac8cd3541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7c81fda4dd749c69c33c8f9ab98fc10'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:41.514937 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-adb94457-95b8-42a4-8550-3e3ac8cd3541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7c81fda4dd749c69c33c8f9ab98fc10'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:41.515967 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-adb94457-95b8-42a4-8550-3e3ac8cd3541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7c81fda4dd749c69c33c8f9ab98fc10'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:41.533162 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-adb94457-95b8-42a4-8550-3e3ac8cd3541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7c81fda4dd749c69c33c8f9ab98fc10'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:41.563601 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-adb94457-95b8-42a4-8550-3e3ac8cd3541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7c81fda4dd749c69c33c8f9ab98fc10'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:41.585940 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 860/1752] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:36:41 2022] DELETE /identity/v3/users/f7c81fda4dd749c69c33c8f9ab98fc10 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:41.590434 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a22a1f-ec56-46a5-abef-56ef3a6192ed None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:41.591526 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a22a1f-ec56-46a5-abef-56ef3a6192ed None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:41.592293 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a22a1f-ec56-46a5-abef-56ef3a6192ed None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:41.597210 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 861/1753] 10.222.0.32 () {54 vars in 921 bytes} [Thu Jun 2 13:36:41 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:41.624728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f9754-b6ba-4217-80ec-2e5b330ccce6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:41.625028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f9754-b6ba-4217-80ec-2e5b330ccce6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:41.625316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f9754-b6ba-4217-80ec-2e5b330ccce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:41.640277 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 893/1754] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:41 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:36:41.663194 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce1725-ba78-4d41-abf4-97d31efcb4f1 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:41.665181 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c5ce1725-ba78-4d41-abf4-97d31efcb4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:41.707514 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e04f9754-b6ba-4217-80ec-2e5b330ccce6 None None] MFA Rules not processed for user `b2e5d9f3c4e04ca3bf52b28b67d2a4d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:41.711399 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e04f9754-b6ba-4217-80ec-2e5b330ccce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:41.838135 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce1725-ba78-4d41-abf4-97d31efcb4f1 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:41.896530 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 862/1755] 10.222.0.32 () {58 vars in 1018 bytes} [Thu Jun 2 13:36:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:41.964933 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e0a58-f359-45e0-a409-09071ad5849d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:41.965838 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e0a58-f359-45e0-a409-09071ad5849d service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:41.966509 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e0a58-f359-45e0-a409-09071ad5849d service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:41.966809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e0a58-f359-45e0-a409-09071ad5849d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:42.099262 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e0a58-f359-45e0-a409-09071ad5849d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:42.101645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e0a58-f359-45e0-a409-09071ad5849d service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:42.112888 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 894/1756] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:41 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:43.217529 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f9754-b6ba-4217-80ec-2e5b330ccce6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:43.219320 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e04f9754-b6ba-4217-80ec-2e5b330ccce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:43.283416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:43.387492 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f9754-b6ba-4217-80ec-2e5b330ccce6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:43.401271 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14077c6-2d67-4525-a826-866de0da5cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:43.402311 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14077c6-2d67-4525-a826-866de0da5cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:43.403262 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14077c6-2d67-4525-a826-866de0da5cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:43.403689 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14077c6-2d67-4525-a826-866de0da5cdf admin admin] PATH_INFO: `/v3/projects/43d33a7faad645659a63ce561a774159` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:43.415452 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14077c6-2d67-4525-a826-866de0da5cdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=43d33a7faad645659a63ce561a774159)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:43.417575 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14077c6-2d67-4525-a826-866de0da5cdf admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:43.587790 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d14077c6-2d67-4525-a826-866de0da5cdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43d33a7faad645659a63ce561a774159', 'request_id': 'req-d14077c6-2d67-4525-a826-866de0da5cdf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:43.613424 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d14077c6-2d67-4525-a826-866de0da5cdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43d33a7faad645659a63ce561a774159', 'request_id': 'req-d14077c6-2d67-4525-a826-866de0da5cdf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:43.632724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d14077c6-2d67-4525-a826-866de0da5cdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43d33a7faad645659a63ce561a774159', 'request_id': 'req-d14077c6-2d67-4525-a826-866de0da5cdf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:43.696861 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d14077c6-2d67-4525-a826-866de0da5cdf admin admin] The token cache is being invalidate because project 43d33a7faad645659a63ce561a774159 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:36:43.697167 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d14077c6-2d67-4525-a826-866de0da5cdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:43.703481 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d14077c6-2d67-4525-a826-866de0da5cdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:43.720646 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 863/1757] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:36:43 2022] DELETE /identity/v3/projects/43d33a7faad645659a63ce561a774159 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:43.726149 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd4a8c-b7cb-4f39-ac31-fc250990f005 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:43.726645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd4a8c-b7cb-4f39-ac31-fc250990f005 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:43.726738 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd4a8c-b7cb-4f39-ac31-fc250990f005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:43.785084 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-60bd4a8c-b7cb-4f39-ac31-fc250990f005 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:43.786538 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-60bd4a8c-b7cb-4f39-ac31-fc250990f005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:43.793210 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:43.983501 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c2754-da7a-48fc-9418-6f0374bfd1f5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:43.983954 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c2754-da7a-48fc-9418-6f0374bfd1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:43.984389 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c2754-da7a-48fc-9418-6f0374bfd1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:43.987305 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 895/1758] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:44.011111 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-652c2754-da7a-48fc-9418-6f0374bfd1f5 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:44.016865 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-652c2754-da7a-48fc-9418-6f0374bfd1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:44.079953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd4a8c-b7cb-4f39-ac31-fc250990f005 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:44.092284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 864/1759] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:44.094315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd4a8c-b7cb-4f39-ac31-fc250990f005 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:44.095282 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c2754-da7a-48fc-9418-6f0374bfd1f5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:44.100823 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-652c2754-da7a-48fc-9418-6f0374bfd1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:44.110616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4117dd0-08f7-40f0-995c-9d8c3db2bcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:44.111410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4117dd0-08f7-40f0-995c-9d8c3db2bcde admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:44.112402 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4117dd0-08f7-40f0-995c-9d8c3db2bcde admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:44.112402 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4117dd0-08f7-40f0-995c-9d8c3db2bcde admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:44.115185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4117dd0-08f7-40f0-995c-9d8c3db2bcde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:44.115185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4117dd0-08f7-40f0-995c-9d8c3db2bcde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:44.125038 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4117dd0-08f7-40f0-995c-9d8c3db2bcde admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:44.160255 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 896/1760] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:44.161293 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4117dd0-08f7-40f0-995c-9d8c3db2bcde admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:44.189497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4117dd0-08f7-40f0-995c-9d8c3db2bcde admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:44.206620 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693555c-96e2-4de2-a0b1-09aba38a552a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:44.206620 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693555c-96e2-4de2-a0b1-09aba38a552a admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:44.206620 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693555c-96e2-4de2-a0b1-09aba38a552a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:44.207062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693555c-96e2-4de2-a0b1-09aba38a552a admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:44.207615 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693555c-96e2-4de2-a0b1-09aba38a552a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:44.212280 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693555c-96e2-4de2-a0b1-09aba38a552a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:44.293649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 897/1761] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:36:44 2022] POST /identity/v3/projects => generated 357 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:44.299098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693555c-96e2-4de2-a0b1-09aba38a552a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:44.305546 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c2754-da7a-48fc-9418-6f0374bfd1f5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:44.425731 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:44.482541 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bc1c4-c310-463b-843f-cb08bc45ac4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:44.487887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bc1c4-c310-463b-843f-cb08bc45ac4e service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:44.488111 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bc1c4-c310-463b-843f-cb08bc45ac4e service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:44.489069 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bc1c4-c310-463b-843f-cb08bc45ac4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:44.496854 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-146bc1c4-c310-463b-843f-cb08bc45ac4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:44.515880 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693555c-96e2-4de2-a0b1-09aba38a552a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:44.527828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bc1c4-c310-463b-843f-cb08bc45ac4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:44.531715 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bc1c4-c310-463b-843f-cb08bc45ac4e service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:44.537623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d08aef-f27b-4bcf-9ab7-b4be363d6b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:44.538834 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d08aef-f27b-4bcf-9ab7-b4be363d6b69 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:44.539532 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d08aef-f27b-4bcf-9ab7-b4be363d6b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:44.540018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d08aef-f27b-4bcf-9ab7-b4be363d6b69 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:44.541305 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d08aef-f27b-4bcf-9ab7-b4be363d6b69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:44.546006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d08aef-f27b-4bcf-9ab7-b4be363d6b69 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:44.560530 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 865/1762] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:44.646319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bc1c4-c310-463b-843f-cb08bc45ac4e service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:44.646942 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 898/1763] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:36:44 2022] POST /identity/v3/users => generated 279 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:36:44.670640 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bc1c4-c310-463b-843f-cb08bc45ac4e service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:44.695253 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3643e0-2aca-4c30-b302-73e86096daef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:44.696346 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3643e0-2aca-4c30-b302-73e86096daef admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:44.696913 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3643e0-2aca-4c30-b302-73e86096daef admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:44.697428 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3643e0-2aca-4c30-b302-73e86096daef admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:44.698800 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3643e0-2aca-4c30-b302-73e86096daef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:44.703803 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3643e0-2aca-4c30-b302-73e86096daef admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:44.747513 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 866/1764] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:44.750682 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d08aef-f27b-4bcf-9ab7-b4be363d6b69 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:44.766290 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d08aef-f27b-4bcf-9ab7-b4be363d6b69 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:44.780444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2244457-a412-47ae-9b34-3a3ab9560c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:44.781137 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2244457-a412-47ae-9b34-3a3ab9560c4c admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:44.781424 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2244457-a412-47ae-9b34-3a3ab9560c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:44.781704 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2244457-a412-47ae-9b34-3a3ab9560c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:44.787292 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2244457-a412-47ae-9b34-3a3ab9560c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:44.787757 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2244457-a412-47ae-9b34-3a3ab9560c4c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:44.820466 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3643e0-2aca-4c30-b302-73e86096daef admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:44.821877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 899/1765] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:44.837823 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3643e0-2aca-4c30-b302-73e86096daef admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:44.852112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6eb4a2-4c24-4bd7-8258-cb8132edd6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:44.853232 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6eb4a2-4c24-4bd7-8258-cb8132edd6b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:44.853521 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6eb4a2-4c24-4bd7-8258-cb8132edd6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:44.853802 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6eb4a2-4c24-4bd7-8258-cb8132edd6b5 admin admin] PATH_INFO: `/v3/projects/34a1f4057b1e483796ae68e4f464d359/users/e75bb5d10f9540658386880801fbbf50/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:44.885019 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6eb4a2-4c24-4bd7-8258-cb8132edd6b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34a1f4057b1e483796ae68e4f464d359, user_id=e75bb5d10f9540658386880801fbbf50, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:44.889157 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6eb4a2-4c24-4bd7-8258-cb8132edd6b5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:44.912339 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 867/1766] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:44 2022] PUT /identity/v3/projects/34a1f4057b1e483796ae68e4f464d359/users/e75bb5d10f9540658386880801fbbf50/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:36:44.920459 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721b82d-1d22-4750-8e8e-4ce286d8a9fa None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:44.921749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721b82d-1d22-4750-8e8e-4ce286d8a9fa None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:44.922485 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721b82d-1d22-4750-8e8e-4ce286d8a9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:44.967861 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c721b82d-1d22-4750-8e8e-4ce286d8a9fa None None] MFA Rules not processed for user `e75bb5d10f9540658386880801fbbf50`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:44.969276 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c721b82d-1d22-4750-8e8e-4ce286d8a9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:45.000771 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6eb4a2-4c24-4bd7-8258-cb8132edd6b5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:45.002950 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9f6eb4a2-4c24-4bd7-8258-cb8132edd6b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:45.033055 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:45.086724 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 900/1767] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:44 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:45.092575 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721b82d-1d22-4750-8e8e-4ce286d8a9fa None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:45.140938 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6eb4a2-4c24-4bd7-8258-cb8132edd6b5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:45.153340 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146eb18-176a-44fe-802a-35a3f5c6b882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:45.160340 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146eb18-176a-44fe-802a-35a3f5c6b882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:45.160911 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146eb18-176a-44fe-802a-35a3f5c6b882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:45.161375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146eb18-176a-44fe-802a-35a3f5c6b882 admin admin] PATH_INFO: `/v3/users/3c5110dc4b234b9b95ce931241e3925a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:45.166062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146eb18-176a-44fe-802a-35a3f5c6b882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c5110dc4b234b9b95ce931241e3925a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:45.170149 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146eb18-176a-44fe-802a-35a3f5c6b882 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:45.239667 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721b82d-1d22-4750-8e8e-4ce286d8a9fa None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:45.244797 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f24ed4-9005-4da4-aa9c-0f1d07e0327e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:45.245319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2146eb18-176a-44fe-802a-35a3f5c6b882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c5110dc4b234b9b95ce931241e3925a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:45.245595 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f24ed4-9005-4da4-aa9c-0f1d07e0327e admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:45.246103 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f24ed4-9005-4da4-aa9c-0f1d07e0327e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:45.246589 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f24ed4-9005-4da4-aa9c-0f1d07e0327e admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:45.247386 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f24ed4-9005-4da4-aa9c-0f1d07e0327e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:45.249905 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f24ed4-9005-4da4-aa9c-0f1d07e0327e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:45.253107 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2146eb18-176a-44fe-802a-35a3f5c6b882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c5110dc4b234b9b95ce931241e3925a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:45.254244 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2146eb18-176a-44fe-802a-35a3f5c6b882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c5110dc4b234b9b95ce931241e3925a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:45.268781 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2146eb18-176a-44fe-802a-35a3f5c6b882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c5110dc4b234b9b95ce931241e3925a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:45.277785 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2146eb18-176a-44fe-802a-35a3f5c6b882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c5110dc4b234b9b95ce931241e3925a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:45.282619 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 901/1768] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:36:45 2022] POST /identity/v3/projects => generated 355 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:45.286426 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f24ed4-9005-4da4-aa9c-0f1d07e0327e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:45.288368 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 868/1769] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:36:44 2022] DELETE /identity/v3/users/3c5110dc4b234b9b95ce931241e3925a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:45.290008 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-96f24ed4-9005-4da4-aa9c-0f1d07e0327e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:45.290948 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42fd7a-dcd7-440c-b841-d10c78b08c42 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:45.291241 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42fd7a-dcd7-440c-b841-d10c78b08c42 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:45.291526 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42fd7a-dcd7-440c-b841-d10c78b08c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:45.312436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4a42fd7a-dcd7-440c-b841-d10c78b08c42 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:45.313670 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4a42fd7a-dcd7-440c-b841-d10c78b08c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:45.328782 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:45.369072 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f24ed4-9005-4da4-aa9c-0f1d07e0327e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:45.393707 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 869/1770] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:45.400728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42fd7a-dcd7-440c-b841-d10c78b08c42 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:45.403846 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4a42fd7a-dcd7-440c-b841-d10c78b08c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:45.450474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d0ce5-f030-4dff-9f4c-65bbb50a73c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:45.451351 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d0ce5-f030-4dff-9f4c-65bbb50a73c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:45.451883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d0ce5-f030-4dff-9f4c-65bbb50a73c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:45.452366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d0ce5-f030-4dff-9f4c-65bbb50a73c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:45.453222 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d0ce5-f030-4dff-9f4c-65bbb50a73c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:45.455606 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d0ce5-f030-4dff-9f4c-65bbb50a73c4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:45.504935 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42fd7a-dcd7-440c-b841-d10c78b08c42 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:45.509303 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71cfb7-ef71-4076-8c38-52385e7ec793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:45.510090 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71cfb7-ef71-4076-8c38-52385e7ec793 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:45.510475 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71cfb7-ef71-4076-8c38-52385e7ec793 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:45.510851 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71cfb7-ef71-4076-8c38-52385e7ec793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:45.513907 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 902/1771] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:36:45 2022] POST /identity/v3/users => generated 284 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:36:45.517926 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d0ce5-f030-4dff-9f4c-65bbb50a73c4 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:45.528777 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71cfb7-ef71-4076-8c38-52385e7ec793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:45.529131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:45.530914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71cfb7-ef71-4076-8c38-52385e7ec793 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:45.532252 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d0ce5-f030-4dff-9f4c-65bbb50a73c4 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:45.546867 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 870/1772] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:36:45.547189 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d2f1a-3d49-42f6-af82-2bb9ed4ecac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:45.547952 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d2f1a-3d49-42f6-af82-2bb9ed4ecac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:45.548395 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d2f1a-3d49-42f6-af82-2bb9ed4ecac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:45.548750 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d2f1a-3d49-42f6-af82-2bb9ed4ecac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:45.549573 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d2f1a-3d49-42f6-af82-2bb9ed4ecac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:45.551333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d2f1a-3d49-42f6-af82-2bb9ed4ecac6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:45.564370 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 903/1773] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:45.567595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71cfb7-ef71-4076-8c38-52385e7ec793 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:45.578214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71cfb7-ef71-4076-8c38-52385e7ec793 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:45.583724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bbe24-e66b-4f68-92e8-0bf08258f574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:45.585410 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bbe24-e66b-4f68-92e8-0bf08258f574 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:45.585754 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bbe24-e66b-4f68-92e8-0bf08258f574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:45.586099 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bbe24-e66b-4f68-92e8-0bf08258f574 admin admin] PATH_INFO: `/v3/projects/bfe7e34c2aa149f58c80d5f264a03e8e/users/11853611356d4c57b5eb25c61fc726d5/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:45.609105 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3bbe24-e66b-4f68-92e8-0bf08258f574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe7e34c2aa149f58c80d5f264a03e8e, user_id=11853611356d4c57b5eb25c61fc726d5, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:45.614254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3bbe24-e66b-4f68-92e8-0bf08258f574 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:45.642248 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 871/1774] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:45 2022] PUT /identity/v3/projects/bfe7e34c2aa149f58c80d5f264a03e8e/users/11853611356d4c57b5eb25c61fc726d5/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:45.646557 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d2f1a-3d49-42f6-af82-2bb9ed4ecac6 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:45.659234 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d2f1a-3d49-42f6-af82-2bb9ed4ecac6 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:45.745790 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d9bfe-b819-4612-aa5e-c415cde6c244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:45.746771 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d9bfe-b819-4612-aa5e-c415cde6c244 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:45.747253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d9bfe-b819-4612-aa5e-c415cde6c244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:45.747758 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d9bfe-b819-4612-aa5e-c415cde6c244 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:45.749824 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d9bfe-b819-4612-aa5e-c415cde6c244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:45.751652 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d9bfe-b819-4612-aa5e-c415cde6c244 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:45.764875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 904/1775] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:45.769338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bbe24-e66b-4f68-92e8-0bf08258f574 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:45.780479 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bbe24-e66b-4f68-92e8-0bf08258f574 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:45.794589 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c705b-5107-4980-8b0d-42372abb4505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:45.797849 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c705b-5107-4980-8b0d-42372abb4505 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:45.797849 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c705b-5107-4980-8b0d-42372abb4505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:45.797849 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c705b-5107-4980-8b0d-42372abb4505 admin admin] PATH_INFO: `/v3/projects/bfe7e34c2aa149f58c80d5f264a03e8e/users/11853611356d4c57b5eb25c61fc726d5/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:45.816916 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c705b-5107-4980-8b0d-42372abb4505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe7e34c2aa149f58c80d5f264a03e8e, user_id=11853611356d4c57b5eb25c61fc726d5, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:45.825280 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c705b-5107-4980-8b0d-42372abb4505 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:45.842652 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 872/1776] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:45 2022] PUT /identity/v3/projects/bfe7e34c2aa149f58c80d5f264a03e8e/users/11853611356d4c57b5eb25c61fc726d5/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:45.853573 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3a80a-3df7-4da2-8ef3-7fb8ae378521 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:45.854765 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3a80a-3df7-4da2-8ef3-7fb8ae378521 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:45.855558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3a80a-3df7-4da2-8ef3-7fb8ae378521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:45.924668 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-bce3a80a-3df7-4da2-8ef3-7fb8ae378521 None None] MFA Rules not processed for user `11853611356d4c57b5eb25c61fc726d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:45.926054 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bce3a80a-3df7-4da2-8ef3-7fb8ae378521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:46.002120 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c705b-5107-4980-8b0d-42372abb4505 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:46.003904 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4b2c705b-5107-4980-8b0d-42372abb4505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:46.114341 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 905/1777] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:45 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:46.127066 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3a80a-3df7-4da2-8ef3-7fb8ae378521 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:46.131565 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bce3a80a-3df7-4da2-8ef3-7fb8ae378521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:46.152217 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c705b-5107-4980-8b0d-42372abb4505 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:46.173301 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad2e87-4a2e-42d1-896e-f9672aa9a9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:46.174197 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad2e87-4a2e-42d1-896e-f9672aa9a9ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:46.174834 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad2e87-4a2e-42d1-896e-f9672aa9a9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:46.174834 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad2e87-4a2e-42d1-896e-f9672aa9a9ef admin admin] PATH_INFO: `/v3/projects/f98e2a29a3a74e0bbfec38ed55f1b935` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:46.177675 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad2e87-4a2e-42d1-896e-f9672aa9a9ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=f98e2a29a3a74e0bbfec38ed55f1b935)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:46.183532 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad2e87-4a2e-42d1-896e-f9672aa9a9ef admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:46.238701 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:46.258235 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3a80a-3df7-4da2-8ef3-7fb8ae378521 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:46.275261 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d9ad2e87-4a2e-42d1-896e-f9672aa9a9ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f98e2a29a3a74e0bbfec38ed55f1b935', 'request_id': 'req-d9ad2e87-4a2e-42d1-896e-f9672aa9a9ef'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:46.278783 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d9ad2e87-4a2e-42d1-896e-f9672aa9a9ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f98e2a29a3a74e0bbfec38ed55f1b935', 'request_id': 'req-d9ad2e87-4a2e-42d1-896e-f9672aa9a9ef'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:46.288877 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d9ad2e87-4a2e-42d1-896e-f9672aa9a9ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f98e2a29a3a74e0bbfec38ed55f1b935', 'request_id': 'req-d9ad2e87-4a2e-42d1-896e-f9672aa9a9ef'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:46.296428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:46.302842 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d9ad2e87-4a2e-42d1-896e-f9672aa9a9ef admin admin] The token cache is being invalidate because project f98e2a29a3a74e0bbfec38ed55f1b935 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:36:46.303346 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d9ad2e87-4a2e-42d1-896e-f9672aa9a9ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:46.304651 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d9ad2e87-4a2e-42d1-896e-f9672aa9a9ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:46.306573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 873/1778] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:36:46 2022] DELETE /identity/v3/projects/f98e2a29a3a74e0bbfec38ed55f1b935 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:36:46.311251 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad2e87-4a2e-42d1-896e-f9672aa9a9ef admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:46.313741 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d9ad2e87-4a2e-42d1-896e-f9672aa9a9ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:46.331975 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea8dad-2504-4ac2-8e47-4053467ee743 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:46.333281 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea8dad-2504-4ac2-8e47-4053467ee743 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:46.333713 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea8dad-2504-4ac2-8e47-4053467ee743 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:46.334079 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea8dad-2504-4ac2-8e47-4053467ee743 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:46.336500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-12ea8dad-2504-4ac2-8e47-4053467ee743 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:46.424139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad2e87-4a2e-42d1-896e-f9672aa9a9ef admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:46.445565 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d30f7-4d4a-4bc5-b5c4-563b31539e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:46.447006 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d30f7-4d4a-4bc5-b5c4-563b31539e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:46.447615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d30f7-4d4a-4bc5-b5c4-563b31539e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:46.448042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d30f7-4d4a-4bc5-b5c4-563b31539e92 admin admin] PATH_INFO: `/v3/users/5b1b7bc0dafc44939bde0ee3b83878df` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:46.450347 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d30f7-4d4a-4bc5-b5c4-563b31539e92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b1b7bc0dafc44939bde0ee3b83878df)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:46.454425 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d30f7-4d4a-4bc5-b5c4-563b31539e92 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:46.457265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea8dad-2504-4ac2-8e47-4053467ee743 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:46.458863 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea8dad-2504-4ac2-8e47-4053467ee743 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:46.472176 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 906/1779] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:46 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:36:46.601810 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-889d30f7-4d4a-4bc5-b5c4-563b31539e92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b1b7bc0dafc44939bde0ee3b83878df'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:46.603803 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea8dad-2504-4ac2-8e47-4053467ee743 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:46.605941 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-12ea8dad-2504-4ac2-8e47-4053467ee743 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:46.611964 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-889d30f7-4d4a-4bc5-b5c4-563b31539e92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b1b7bc0dafc44939bde0ee3b83878df'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:46.613402 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-889d30f7-4d4a-4bc5-b5c4-563b31539e92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b1b7bc0dafc44939bde0ee3b83878df'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:46.617718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea8dad-2504-4ac2-8e47-4053467ee743 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:46.621894 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50393968-aef4-4e92-9017-77c98b3e2377 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:46.622572 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50393968-aef4-4e92-9017-77c98b3e2377 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:46.622931 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50393968-aef4-4e92-9017-77c98b3e2377 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:46.623335 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50393968-aef4-4e92-9017-77c98b3e2377 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:46.625099 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-50393968-aef4-4e92-9017-77c98b3e2377 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:46.633400 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-889d30f7-4d4a-4bc5-b5c4-563b31539e92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b1b7bc0dafc44939bde0ee3b83878df'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:46.642157 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-889d30f7-4d4a-4bc5-b5c4-563b31539e92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b1b7bc0dafc44939bde0ee3b83878df'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:46.649438 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 874/1780] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:36:46 2022] DELETE /identity/v3/users/5b1b7bc0dafc44939bde0ee3b83878df => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:46.701769 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50393968-aef4-4e92-9017-77c98b3e2377 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:46.703192 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50393968-aef4-4e92-9017-77c98b3e2377 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:46.715963 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 907/1781] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:46 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:36:47.323269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d30f7-4d4a-4bc5-b5c4-563b31539e92 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:47.328734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-889d30f7-4d4a-4bc5-b5c4-563b31539e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:47.366073 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50393968-aef4-4e92-9017-77c98b3e2377 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:47.367834 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-50393968-aef4-4e92-9017-77c98b3e2377 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:47.400287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50393968-aef4-4e92-9017-77c98b3e2377 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:47.402153 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:47.445763 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d30f7-4d4a-4bc5-b5c4-563b31539e92 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:47.451707 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed32b1-9a58-4a21-8a93-9c083c9cd5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:47.452676 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed32b1-9a58-4a21-8a93-9c083c9cd5ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:47.453051 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed32b1-9a58-4a21-8a93-9c083c9cd5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:47.453340 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed32b1-9a58-4a21-8a93-9c083c9cd5ef admin admin] PATH_INFO: `/v3/users/bc9c9923528b4d559266950a0509f9d9` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:47.454634 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed32b1-9a58-4a21-8a93-9c083c9cd5ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc9c9923528b4d559266950a0509f9d9)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:47.457063 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed32b1-9a58-4a21-8a93-9c083c9cd5ef admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:47.524011 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f0ed32b1-9a58-4a21-8a93-9c083c9cd5ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc9c9923528b4d559266950a0509f9d9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:47.524177 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a95702-bf86-4b80-945c-80554adee1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:47.525948 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a95702-bf86-4b80-945c-80554adee1db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:47.526741 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a95702-bf86-4b80-945c-80554adee1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:47.526925 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a95702-bf86-4b80-945c-80554adee1db admin admin] PATH_INFO: `/v3/projects/1a9000009e8944a7991977dbc73926c3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:47.530968 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a95702-bf86-4b80-945c-80554adee1db admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a9000009e8944a7991977dbc73926c3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:47.533174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a95702-bf86-4b80-945c-80554adee1db admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:47.537687 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f0ed32b1-9a58-4a21-8a93-9c083c9cd5ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc9c9923528b4d559266950a0509f9d9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:47.538685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f0ed32b1-9a58-4a21-8a93-9c083c9cd5ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc9c9923528b4d559266950a0509f9d9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:47.558759 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f0ed32b1-9a58-4a21-8a93-9c083c9cd5ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc9c9923528b4d559266950a0509f9d9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:47.570556 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f0ed32b1-9a58-4a21-8a93-9c083c9cd5ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc9c9923528b4d559266950a0509f9d9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:47.575940 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:47.580068 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 875/1782] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:36:47 2022] DELETE /identity/v3/users/bc9c9923528b4d559266950a0509f9d9 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:47.585889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fe320-d942-49c3-aff3-cd642136018b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:47.586663 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fe320-d942-49c3-aff3-cd642136018b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:47.587254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fe320-d942-49c3-aff3-cd642136018b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:47.611977 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-463fe320-d942-49c3-aff3-cd642136018b None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:47.613449 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-463fe320-d942-49c3-aff3-cd642136018b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:47.624219 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-20a95702-bf86-4b80-945c-80554adee1db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a9000009e8944a7991977dbc73926c3', 'request_id': 'req-20a95702-bf86-4b80-945c-80554adee1db'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:47.640626 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-20a95702-bf86-4b80-945c-80554adee1db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a9000009e8944a7991977dbc73926c3', 'request_id': 'req-20a95702-bf86-4b80-945c-80554adee1db'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:47.656881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-20a95702-bf86-4b80-945c-80554adee1db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a9000009e8944a7991977dbc73926c3', 'request_id': 'req-20a95702-bf86-4b80-945c-80554adee1db'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:47.688604 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-20a95702-bf86-4b80-945c-80554adee1db admin admin] The token cache is being invalidate because project 1a9000009e8944a7991977dbc73926c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:36:47.688939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-20a95702-bf86-4b80-945c-80554adee1db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:47.689708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-20a95702-bf86-4b80-945c-80554adee1db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:47.691628 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 908/1783] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:36:47 2022] DELETE /identity/v3/projects/1a9000009e8944a7991977dbc73926c3 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:47.700384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875df52-0a84-437b-b423-a2ea734f0a62 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:47.700699 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875df52-0a84-437b-b423-a2ea734f0a62 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:47.701958 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875df52-0a84-437b-b423-a2ea734f0a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:47.714816 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 876/1784] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:47.723635 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fe320-d942-49c3-aff3-cd642136018b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:47.727172 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-463fe320-d942-49c3-aff3-cd642136018b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:47.732521 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-1875df52-0a84-437b-b423-a2ea734f0a62 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:47.733721 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1875df52-0a84-437b-b423-a2ea734f0a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:47.747807 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 909/1785] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:47.758684 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5f0ad-137c-48cf-acd3-6e6fcdd08f64 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:47.758981 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5f0ad-137c-48cf-acd3-6e6fcdd08f64 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:47.759486 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5f0ad-137c-48cf-acd3-6e6fcdd08f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:47.797329 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-16c5f0ad-137c-48cf-acd3-6e6fcdd08f64 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:47.798096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-16c5f0ad-137c-48cf-acd3-6e6fcdd08f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:47.826546 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 910/1786] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:36:47.835278 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5f0ad-137c-48cf-acd3-6e6fcdd08f64 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:47.835689 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fe320-d942-49c3-aff3-cd642136018b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:47.839761 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de91cf-8f35-438e-be2d-de028d7d6c5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:47.840746 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de91cf-8f35-438e-be2d-de028d7d6c5b service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:47.841156 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de91cf-8f35-438e-be2d-de028d7d6c5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:47.841489 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de91cf-8f35-438e-be2d-de028d7d6c5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:47.849910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:47.852920 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5f0ad-137c-48cf-acd3-6e6fcdd08f64 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:47.853331 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de91cf-8f35-438e-be2d-de028d7d6c5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:47.855368 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de91cf-8f35-438e-be2d-de028d7d6c5b service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:47.859357 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d06f59-dff0-4567-8a64-0a0d5ee45ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:47.860038 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d06f59-dff0-4567-8a64-0a0d5ee45ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:47.860344 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d06f59-dff0-4567-8a64-0a0d5ee45ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:47.860632 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d06f59-dff0-4567-8a64-0a0d5ee45ed0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:47.861379 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d06f59-dff0-4567-8a64-0a0d5ee45ed0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:47.861687 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d06f59-dff0-4567-8a64-0a0d5ee45ed0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:47.863533 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d06f59-dff0-4567-8a64-0a0d5ee45ed0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:47.889830 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 911/1787] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:47.890856 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d06f59-dff0-4567-8a64-0a0d5ee45ed0 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:47.894629 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 877/1788] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:47.922463 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d06f59-dff0-4567-8a64-0a0d5ee45ed0 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:47.929346 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95d226-989b-497d-9a2f-0e6c982b446a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:47.930486 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95d226-989b-497d-9a2f-0e6c982b446a admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:47.935111 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95d226-989b-497d-9a2f-0e6c982b446a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:47.935422 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95d226-989b-497d-9a2f-0e6c982b446a admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:47.936160 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95d226-989b-497d-9a2f-0e6c982b446a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:47.946622 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95d226-989b-497d-9a2f-0e6c982b446a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:48.010069 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 912/1789] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:36:47 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:48.011617 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de91cf-8f35-438e-be2d-de028d7d6c5b service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:48.026333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de91cf-8f35-438e-be2d-de028d7d6c5b service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:48.221245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbacd31-501a-454e-bcff-d63c67687032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:48.223080 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbacd31-501a-454e-bcff-d63c67687032 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:48.223600 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbacd31-501a-454e-bcff-d63c67687032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:48.224150 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbacd31-501a-454e-bcff-d63c67687032 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:48.225693 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbacd31-501a-454e-bcff-d63c67687032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:48.229448 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbacd31-501a-454e-bcff-d63c67687032 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:48.269246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 878/1790] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:36:48 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:48.274183 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95d226-989b-497d-9a2f-0e6c982b446a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:48.294179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95d226-989b-497d-9a2f-0e6c982b446a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:48.306212 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f407917-0c84-4e06-8e87-f547159d72ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:48.307771 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f407917-0c84-4e06-8e87-f547159d72ec admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:48.308065 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f407917-0c84-4e06-8e87-f547159d72ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:48.308511 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f407917-0c84-4e06-8e87-f547159d72ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:48.310287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f407917-0c84-4e06-8e87-f547159d72ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:48.312074 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f407917-0c84-4e06-8e87-f547159d72ec admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:48.331851 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbacd31-501a-454e-bcff-d63c67687032 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:48.341831 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 913/1791] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:36:48.348540 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbacd31-501a-454e-bcff-d63c67687032 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:48.359527 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafbbd4-5828-417e-a58f-b2df4380a966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:48.360748 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafbbd4-5828-417e-a58f-b2df4380a966 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:48.361899 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafbbd4-5828-417e-a58f-b2df4380a966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:48.362592 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafbbd4-5828-417e-a58f-b2df4380a966 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:48.363583 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdafbbd4-5828-417e-a58f-b2df4380a966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:48.365617 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdafbbd4-5828-417e-a58f-b2df4380a966 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:48.397709 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 879/1792] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:48.402331 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f407917-0c84-4e06-8e87-f547159d72ec admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:48.414396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f407917-0c84-4e06-8e87-f547159d72ec admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:48.422174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcace0-4ad0-4e3b-b567-87e700ae6b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:48.423165 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcace0-4ad0-4e3b-b567-87e700ae6b74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:48.423520 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcace0-4ad0-4e3b-b567-87e700ae6b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:48.423866 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcace0-4ad0-4e3b-b567-87e700ae6b74 admin admin] PATH_INFO: `/v3/projects/ade78e65244640c180d24fd17cea8300/users/76b1cd5ad2e04c76b776a4f6c5412bd4/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:48.444111 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcace0-4ad0-4e3b-b567-87e700ae6b74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ade78e65244640c180d24fd17cea8300, user_id=76b1cd5ad2e04c76b776a4f6c5412bd4, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:48.447340 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcace0-4ad0-4e3b-b567-87e700ae6b74 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:48.465534 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 914/1793] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:48 2022] PUT /identity/v3/projects/ade78e65244640c180d24fd17cea8300/users/76b1cd5ad2e04c76b776a4f6c5412bd4/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:48.478459 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd060e0-472d-4a61-932c-1dc4526cd268 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:48.478870 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd060e0-472d-4a61-932c-1dc4526cd268 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:48.479217 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd060e0-472d-4a61-932c-1dc4526cd268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:48.518036 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-bbd060e0-472d-4a61-932c-1dc4526cd268 None None] MFA Rules not processed for user `76b1cd5ad2e04c76b776a4f6c5412bd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:48.519966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bbd060e0-472d-4a61-932c-1dc4526cd268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:48.620771 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 880/1794] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:36:48.622297 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcace0-4ad0-4e3b-b567-87e700ae6b74 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:48.730008 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcace0-4ad0-4e3b-b567-87e700ae6b74 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:48.744028 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa0dd4-a2ae-4086-8db6-f438a2ec6c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:48.745124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa0dd4-a2ae-4086-8db6-f438a2ec6c05 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:48.745516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa0dd4-a2ae-4086-8db6-f438a2ec6c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:48.745896 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa0dd4-a2ae-4086-8db6-f438a2ec6c05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:48.747290 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa0dd4-a2ae-4086-8db6-f438a2ec6c05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:48.749389 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa0dd4-a2ae-4086-8db6-f438a2ec6c05 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:48.791336 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 915/1795] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:36:48 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:36:48.791724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd060e0-472d-4a61-932c-1dc4526cd268 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:48.797813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa0dd4-a2ae-4086-8db6-f438a2ec6c05 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:48.800585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-05fa0dd4-a2ae-4086-8db6-f438a2ec6c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:48.809657 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd060e0-472d-4a61-932c-1dc4526cd268 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:48.822606 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:48.915539 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa0dd4-a2ae-4086-8db6-f438a2ec6c05 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:48.925775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda8a61-6bf7-4730-a181-5786406c287e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:48.927358 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda8a61-6bf7-4730-a181-5786406c287e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:48.927845 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda8a61-6bf7-4730-a181-5786406c287e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:48.929309 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda8a61-6bf7-4730-a181-5786406c287e admin admin] PATH_INFO: `/v3/projects/2ec1f7a889c54e229309d8c428f6dcfd` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:48.931484 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda8a61-6bf7-4730-a181-5786406c287e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ec1f7a889c54e229309d8c428f6dcfd)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:48.934473 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda8a61-6bf7-4730-a181-5786406c287e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:48.954833 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959a41a-be68-496b-97c8-ccf02f957010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:48.956499 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959a41a-be68-496b-97c8-ccf02f957010 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:48.957240 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959a41a-be68-496b-97c8-ccf02f957010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:48.957913 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959a41a-be68-496b-97c8-ccf02f957010 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:48.959982 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959a41a-be68-496b-97c8-ccf02f957010 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:48.962409 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959a41a-be68-496b-97c8-ccf02f957010 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:48.978094 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:49.000331 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 881/1796] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:36:48 2022] POST /identity/v3/users => generated 299 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:36:49.001450 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959a41a-be68-496b-97c8-ccf02f957010 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:49.016092 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959a41a-be68-496b-97c8-ccf02f957010 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:49.017475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-aeda8a61-6bf7-4730-a181-5786406c287e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ec1f7a889c54e229309d8c428f6dcfd', 'request_id': 'req-aeda8a61-6bf7-4730-a181-5786406c287e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:49.029221 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-aeda8a61-6bf7-4730-a181-5786406c287e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ec1f7a889c54e229309d8c428f6dcfd', 'request_id': 'req-aeda8a61-6bf7-4730-a181-5786406c287e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:49.042838 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-aeda8a61-6bf7-4730-a181-5786406c287e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ec1f7a889c54e229309d8c428f6dcfd', 'request_id': 'req-aeda8a61-6bf7-4730-a181-5786406c287e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:49.068783 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-aeda8a61-6bf7-4730-a181-5786406c287e admin admin] The token cache is being invalidate because project 2ec1f7a889c54e229309d8c428f6dcfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:36:49.069794 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-aeda8a61-6bf7-4730-a181-5786406c287e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:49.070902 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-aeda8a61-6bf7-4730-a181-5786406c287e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:49.078887 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 916/1797] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:36:48 2022] DELETE /identity/v3/projects/2ec1f7a889c54e229309d8c428f6dcfd => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:49.079866 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda8a61-6bf7-4730-a181-5786406c287e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:49.089806 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-aeda8a61-6bf7-4730-a181-5786406c287e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:49.138227 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf2c33-538c-40e6-b6a4-d3355f5fa22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:49.138923 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf2c33-538c-40e6-b6a4-d3355f5fa22b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:49.140072 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf2c33-538c-40e6-b6a4-d3355f5fa22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:49.140395 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf2c33-538c-40e6-b6a4-d3355f5fa22b admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:49.141427 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf2c33-538c-40e6-b6a4-d3355f5fa22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:49.146121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf2c33-538c-40e6-b6a4-d3355f5fa22b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:49.172946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 882/1798] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:49.180333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf2c33-538c-40e6-b6a4-d3355f5fa22b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:49.181495 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-41cf2c33-538c-40e6-b6a4-d3355f5fa22b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:49.196087 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf2c33-538c-40e6-b6a4-d3355f5fa22b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:49.201229 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47ec85-5b6b-47f7-aa5f-9aaf67cba9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:49.202212 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47ec85-5b6b-47f7-aa5f-9aaf67cba9c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:49.202503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47ec85-5b6b-47f7-aa5f-9aaf67cba9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:49.202924 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47ec85-5b6b-47f7-aa5f-9aaf67cba9c0 admin admin] PATH_INFO: `/v3/projects/204409a92bd540f3bbfb8a25857a1e7f/users/ecf376876f124a99b8055a281ba57531/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:49.248436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47ec85-5b6b-47f7-aa5f-9aaf67cba9c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=204409a92bd540f3bbfb8a25857a1e7f, user_id=ecf376876f124a99b8055a281ba57531, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:49.251222 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47ec85-5b6b-47f7-aa5f-9aaf67cba9c0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:49.262468 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda8a61-6bf7-4730-a181-5786406c287e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:49.279450 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec425be-386c-4288-8c75-465a2b902e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:49.280795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec425be-386c-4288-8c75-465a2b902e75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:49.281127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec425be-386c-4288-8c75-465a2b902e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:49.284484 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec425be-386c-4288-8c75-465a2b902e75 admin admin] PATH_INFO: `/v3/users/989f33ddcc8446d99758acfbd2d31d9b` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:49.289387 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 883/1799] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:49 2022] PUT /identity/v3/projects/204409a92bd540f3bbfb8a25857a1e7f/users/ecf376876f124a99b8055a281ba57531/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:49.289567 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec425be-386c-4288-8c75-465a2b902e75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=989f33ddcc8446d99758acfbd2d31d9b)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:49.290807 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47ec85-5b6b-47f7-aa5f-9aaf67cba9c0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:49.292875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec425be-386c-4288-8c75-465a2b902e75 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:49.390865 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:49.395975 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0ec425be-386c-4288-8c75-465a2b902e75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '989f33ddcc8446d99758acfbd2d31d9b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:49.415860 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0ec425be-386c-4288-8c75-465a2b902e75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '989f33ddcc8446d99758acfbd2d31d9b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:49.416776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0ec425be-386c-4288-8c75-465a2b902e75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '989f33ddcc8446d99758acfbd2d31d9b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:49.438395 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0ec425be-386c-4288-8c75-465a2b902e75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '989f33ddcc8446d99758acfbd2d31d9b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:49.454339 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0ec425be-386c-4288-8c75-465a2b902e75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '989f33ddcc8446d99758acfbd2d31d9b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:49.458642 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47ec85-5b6b-47f7-aa5f-9aaf67cba9c0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:49.465359 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 917/1800] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:36:49 2022] DELETE /identity/v3/users/989f33ddcc8446d99758acfbd2d31d9b => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:49.469051 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae8ebd-1748-498d-8d6e-7b53f42a36a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:49.469749 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae8ebd-1748-498d-8d6e-7b53f42a36a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:49.470032 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae8ebd-1748-498d-8d6e-7b53f42a36a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:49.471442 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae8ebd-1748-498d-8d6e-7b53f42a36a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:49.472324 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae8ebd-1748-498d-8d6e-7b53f42a36a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:49.473528 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae8ebd-1748-498d-8d6e-7b53f42a36a6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:49.498597 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec425be-386c-4288-8c75-465a2b902e75 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:49.500240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0ec425be-386c-4288-8c75-465a2b902e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:49.508895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 884/1801] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:49.577784 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec425be-386c-4288-8c75-465a2b902e75 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:49.585186 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b828f0-45be-4242-b51b-da760300de5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:49.586796 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b828f0-45be-4242-b51b-da760300de5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:49.586796 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b828f0-45be-4242-b51b-da760300de5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:49.586796 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b828f0-45be-4242-b51b-da760300de5a admin admin] PATH_INFO: `/v3/projects/204409a92bd540f3bbfb8a25857a1e7f/users/ecf376876f124a99b8055a281ba57531/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:49.590110 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b828f0-45be-4242-b51b-da760300de5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=204409a92bd540f3bbfb8a25857a1e7f, user_id=ecf376876f124a99b8055a281ba57531, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:49.595537 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b828f0-45be-4242-b51b-da760300de5a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:49.636678 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 918/1802] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:49 2022] PUT /identity/v3/projects/204409a92bd540f3bbfb8a25857a1e7f/users/ecf376876f124a99b8055a281ba57531/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:49.639808 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101927c-4956-4348-861d-ca95e19cd7cc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:49.640163 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101927c-4956-4348-861d-ca95e19cd7cc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:49.640548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101927c-4956-4348-861d-ca95e19cd7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:49.727916 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3101927c-4956-4348-861d-ca95e19cd7cc None None] MFA Rules not processed for user `ecf376876f124a99b8055a281ba57531`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:49.729599 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3101927c-4956-4348-861d-ca95e19cd7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:49.829216 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:49.913182 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 885/1803] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:49.930992 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b828f0-45be-4242-b51b-da760300de5a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:49.933314 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-73b828f0-45be-4242-b51b-da760300de5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:50.085363 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b828f0-45be-4242-b51b-da760300de5a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:50.102834 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b71ab1-f2ad-4485-90a3-acf055132684 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:50.103700 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b71ab1-f2ad-4485-90a3-acf055132684 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:50.104078 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b71ab1-f2ad-4485-90a3-acf055132684 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:50.104512 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b71ab1-f2ad-4485-90a3-acf055132684 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:50.125082 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b71ab1-f2ad-4485-90a3-acf055132684 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:50.126643 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b71ab1-f2ad-4485-90a3-acf055132684 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:50.157824 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 919/1804] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:50.185600 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3101927c-4956-4348-861d-ca95e19cd7cc None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:50.359688 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3101927c-4956-4348-861d-ca95e19cd7cc None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:50.367001 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d05a6-bf10-40ba-b738-14a9f11b16d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:50.367798 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d05a6-bf10-40ba-b738-14a9f11b16d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:50.368154 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d05a6-bf10-40ba-b738-14a9f11b16d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:50.368646 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d05a6-bf10-40ba-b738-14a9f11b16d5 admin admin] PATH_INFO: `/v3/users/76b1cd5ad2e04c76b776a4f6c5412bd4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:50.370455 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d05a6-bf10-40ba-b738-14a9f11b16d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76b1cd5ad2e04c76b776a4f6c5412bd4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:50.372550 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d05a6-bf10-40ba-b738-14a9f11b16d5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:50.470706 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8c4d05a6-bf10-40ba-b738-14a9f11b16d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76b1cd5ad2e04c76b776a4f6c5412bd4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:50.487680 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8c4d05a6-bf10-40ba-b738-14a9f11b16d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76b1cd5ad2e04c76b776a4f6c5412bd4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:50.490433 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8c4d05a6-bf10-40ba-b738-14a9f11b16d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76b1cd5ad2e04c76b776a4f6c5412bd4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:50.517024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8c4d05a6-bf10-40ba-b738-14a9f11b16d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76b1cd5ad2e04c76b776a4f6c5412bd4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:50.532463 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8c4d05a6-bf10-40ba-b738-14a9f11b16d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76b1cd5ad2e04c76b776a4f6c5412bd4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:50.544075 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 886/1805] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:36:50 2022] DELETE /identity/v3/users/76b1cd5ad2e04c76b776a4f6c5412bd4 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:50.548996 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96bf1a-c36c-42cf-8e6e-20ca840fc59f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:50.549526 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96bf1a-c36c-42cf-8e6e-20ca840fc59f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:50.549666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96bf1a-c36c-42cf-8e6e-20ca840fc59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:50.607518 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3f96bf1a-c36c-42cf-8e6e-20ca840fc59f None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:50.612242 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3f96bf1a-c36c-42cf-8e6e-20ca840fc59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:50.687754 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:50.705982 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 920/1806] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:36:50.714828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d05a6-bf10-40ba-b738-14a9f11b16d5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:50.716601 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8c4d05a6-bf10-40ba-b738-14a9f11b16d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:50.724711 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96bf1a-c36c-42cf-8e6e-20ca840fc59f None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:50.728163 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3f96bf1a-c36c-42cf-8e6e-20ca840fc59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:50.750312 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96bf1a-c36c-42cf-8e6e-20ca840fc59f None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:50.755820 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4901b4-7390-4e13-8f4a-f516afd30b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:50.758390 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4901b4-7390-4e13-8f4a-f516afd30b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:50.758679 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4901b4-7390-4e13-8f4a-f516afd30b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:50.758956 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4901b4-7390-4e13-8f4a-f516afd30b5c admin admin] PATH_INFO: `/v3/projects/0701dde4a0134a4fab671cf1aeebb02c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:50.760287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4901b4-7390-4e13-8f4a-f516afd30b5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0701dde4a0134a4fab671cf1aeebb02c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:50.770213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4901b4-7390-4e13-8f4a-f516afd30b5c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:50.805749 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d05a6-bf10-40ba-b738-14a9f11b16d5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:50.809615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29890e8-0b98-4143-befd-0a67ab7418be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:50.810275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29890e8-0b98-4143-befd-0a67ab7418be service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:50.810558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29890e8-0b98-4143-befd-0a67ab7418be service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:50.810959 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29890e8-0b98-4143-befd-0a67ab7418be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:50.821249 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29890e8-0b98-4143-befd-0a67ab7418be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:50.822708 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29890e8-0b98-4143-befd-0a67ab7418be service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:50.828933 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-dd4901b4-7390-4e13-8f4a-f516afd30b5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0701dde4a0134a4fab671cf1aeebb02c', 'request_id': 'req-dd4901b4-7390-4e13-8f4a-f516afd30b5c'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:50.834471 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 887/1807] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:36:50.837279 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-dd4901b4-7390-4e13-8f4a-f516afd30b5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0701dde4a0134a4fab671cf1aeebb02c', 'request_id': 'req-dd4901b4-7390-4e13-8f4a-f516afd30b5c'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:50.844811 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-dd4901b4-7390-4e13-8f4a-f516afd30b5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0701dde4a0134a4fab671cf1aeebb02c', 'request_id': 'req-dd4901b4-7390-4e13-8f4a-f516afd30b5c'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:50.859371 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-dd4901b4-7390-4e13-8f4a-f516afd30b5c admin admin] The token cache is being invalidate because project 0701dde4a0134a4fab671cf1aeebb02c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:36:50.859672 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-dd4901b4-7390-4e13-8f4a-f516afd30b5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:50.860392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-dd4901b4-7390-4e13-8f4a-f516afd30b5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:50.862285 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 921/1808] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:36:50 2022] DELETE /identity/v3/projects/0701dde4a0134a4fab671cf1aeebb02c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:50.868460 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf428b45-cf0c-40b0-8dd0-5d4b56e65253 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:50.868864 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf428b45-cf0c-40b0-8dd0-5d4b56e65253 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:50.869029 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf428b45-cf0c-40b0-8dd0-5d4b56e65253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:50.889482 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-bf428b45-cf0c-40b0-8dd0-5d4b56e65253 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:50.890678 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bf428b45-cf0c-40b0-8dd0-5d4b56e65253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:50.896355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:50.987255 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 888/1809] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:50.995948 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbba0af-a5f1-452f-bd6c-2965cf8ce656 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:50.996428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbba0af-a5f1-452f-bd6c-2965cf8ce656 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:50.996835 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbba0af-a5f1-452f-bd6c-2965cf8ce656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:51.022699 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6cbba0af-a5f1-452f-bd6c-2965cf8ce656 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:51.024062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6cbba0af-a5f1-452f-bd6c-2965cf8ce656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:51.035914 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 922/1810] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:51.038994 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf428b45-cf0c-40b0-8dd0-5d4b56e65253 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:51.050625 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf428b45-cf0c-40b0-8dd0-5d4b56e65253 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:51.056546 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f0130-0511-4989-87f2-6d0eb0bb865b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:51.057393 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f0130-0511-4989-87f2-6d0eb0bb865b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:51.057775 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f0130-0511-4989-87f2-6d0eb0bb865b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:51.058184 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f0130-0511-4989-87f2-6d0eb0bb865b admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:51.059037 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f0130-0511-4989-87f2-6d0eb0bb865b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:51.059465 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f0130-0511-4989-87f2-6d0eb0bb865b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:51.061286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f0130-0511-4989-87f2-6d0eb0bb865b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:51.079117 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 889/1811] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:51.080788 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbba0af-a5f1-452f-bd6c-2965cf8ce656 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:51.092066 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbba0af-a5f1-452f-bd6c-2965cf8ce656 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:51.097073 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568c451-6b2e-4108-befe-0bdf578d5136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:51.098404 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568c451-6b2e-4108-befe-0bdf578d5136 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:51.098404 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568c451-6b2e-4108-befe-0bdf578d5136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:51.098632 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568c451-6b2e-4108-befe-0bdf578d5136 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:51.099696 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568c451-6b2e-4108-befe-0bdf578d5136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:51.102326 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568c451-6b2e-4108-befe-0bdf578d5136 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:51.136366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 923/1812] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:36:51 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:51.138141 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f0130-0511-4989-87f2-6d0eb0bb865b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:51.150951 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f0130-0511-4989-87f2-6d0eb0bb865b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:51.298798 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6a220-c1ba-4085-9ff9-efefec04def6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:51.299498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6a220-c1ba-4085-9ff9-efefec04def6 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:51.299785 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6a220-c1ba-4085-9ff9-efefec04def6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:51.300069 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6a220-c1ba-4085-9ff9-efefec04def6 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:51.300946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6a220-c1ba-4085-9ff9-efefec04def6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:51.303868 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6a220-c1ba-4085-9ff9-efefec04def6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:51.339168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 890/1813] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:36:51 2022] POST /identity/v3/users => generated 284 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:51.343540 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568c451-6b2e-4108-befe-0bdf578d5136 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:51.370530 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568c451-6b2e-4108-befe-0bdf578d5136 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:51.381075 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89de15e-73f1-4527-b820-4f4572a37488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:51.382256 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89de15e-73f1-4527-b820-4f4572a37488 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:51.385327 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89de15e-73f1-4527-b820-4f4572a37488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:51.385756 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89de15e-73f1-4527-b820-4f4572a37488 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:51.386552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89de15e-73f1-4527-b820-4f4572a37488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:51.392167 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89de15e-73f1-4527-b820-4f4572a37488 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:51.427177 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 924/1814] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:51.428851 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6a220-c1ba-4085-9ff9-efefec04def6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:51.444622 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6a220-c1ba-4085-9ff9-efefec04def6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:51.449932 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c8f55-8884-4a03-98e2-bc40261d47d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:51.450803 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c8f55-8884-4a03-98e2-bc40261d47d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:51.452358 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c8f55-8884-4a03-98e2-bc40261d47d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:51.452479 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c8f55-8884-4a03-98e2-bc40261d47d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:51.453886 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c8f55-8884-4a03-98e2-bc40261d47d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:51.456139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c8f55-8884-4a03-98e2-bc40261d47d7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:51.473753 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 891/1815] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:51.474386 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89de15e-73f1-4527-b820-4f4572a37488 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:51.492443 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89de15e-73f1-4527-b820-4f4572a37488 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:51.499135 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9772fe8-4f08-4464-a9b3-8c6eceac765e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:51.500339 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9772fe8-4f08-4464-a9b3-8c6eceac765e admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:51.501784 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9772fe8-4f08-4464-a9b3-8c6eceac765e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:51.502246 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9772fe8-4f08-4464-a9b3-8c6eceac765e admin admin] PATH_INFO: `/v3/projects/439d8ef9f0714832bf92d09394477e34/users/40bfb479aa784e60be727cbe22694feb/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:51.540042 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9772fe8-4f08-4464-a9b3-8c6eceac765e admin admin] RBAC: Authorizing `identity:create_grant(project_id=439d8ef9f0714832bf92d09394477e34, user_id=40bfb479aa784e60be727cbe22694feb, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:51.543673 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9772fe8-4f08-4464-a9b3-8c6eceac765e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:51.570255 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 925/1816] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:51 2022] PUT /identity/v3/projects/439d8ef9f0714832bf92d09394477e34/users/40bfb479aa784e60be727cbe22694feb/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:51.584841 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174deea-4b79-4646-a00b-a0fda0fdcc1d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:51.585668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174deea-4b79-4646-a00b-a0fda0fdcc1d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:51.585668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174deea-4b79-4646-a00b-a0fda0fdcc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:51.651666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c174deea-4b79-4646-a00b-a0fda0fdcc1d None None] MFA Rules not processed for user `40bfb479aa784e60be727cbe22694feb`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:51.656864 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c174deea-4b79-4646-a00b-a0fda0fdcc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:51.702032 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acc60a-e3d7-4e7f-8a14-9df77f262205 None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:51.702624 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acc60a-e3d7-4e7f-8a14-9df77f262205 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:51.702885 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acc60a-e3d7-4e7f-8a14-9df77f262205 None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:51.705085 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 926/1817] 10.222.0.32 () {54 vars in 921 bytes} [Thu Jun 2 13:36:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:51.723431 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef12cf-5e9b-4213-b2bc-a8df87427600 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:51.724208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef12cf-5e9b-4213-b2bc-a8df87427600 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:51.727453 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef12cf-5e9b-4213-b2bc-a8df87427600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:51.783154 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-2cef12cf-5e9b-4213-b2bc-a8df87427600 None None] MFA Rules not processed for user `b2e5d9f3c4e04ca3bf52b28b67d2a4d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:51.784851 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2cef12cf-5e9b-4213-b2bc-a8df87427600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:51.838072 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 892/1818] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:51.846001 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174deea-4b79-4646-a00b-a0fda0fdcc1d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:51.855294 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:51.942620 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 927/1819] 10.222.0.32 () {58 vars in 1018 bytes} [Thu Jun 2 13:36:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:36:51.944443 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef12cf-5e9b-4213-b2bc-a8df87427600 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:51.945828 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2cef12cf-5e9b-4213-b2bc-a8df87427600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:51.960557 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:52.038480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174deea-4b79-4646-a00b-a0fda0fdcc1d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:52.045252 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c2599-6893-4bdf-a690-37a4149cf319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:52.046408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c2599-6893-4bdf-a690-37a4149cf319 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:52.046860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c2599-6893-4bdf-a690-37a4149cf319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:52.047292 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c2599-6893-4bdf-a690-37a4149cf319 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:52.048270 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c2599-6893-4bdf-a690-37a4149cf319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:52.050528 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c2599-6893-4bdf-a690-37a4149cf319 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:52.059347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef12cf-5e9b-4213-b2bc-a8df87427600 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:52.065945 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce84721-ba61-43ca-a49a-07665cc84e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:52.067245 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce84721-ba61-43ca-a49a-07665cc84e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:52.067638 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce84721-ba61-43ca-a49a-07665cc84e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:52.068020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce84721-ba61-43ca-a49a-07665cc84e90 admin admin] PATH_INFO: `/v3/projects/ade78e65244640c180d24fd17cea8300` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:52.070227 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce84721-ba61-43ca-a49a-07665cc84e90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ade78e65244640c180d24fd17cea8300)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:52.072705 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce84721-ba61-43ca-a49a-07665cc84e90 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:52.093692 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 893/1820] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:36:51 2022] POST /identity/v3/projects => generated 367 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:36:52.094780 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c2599-6893-4bdf-a690-37a4149cf319 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:52.149173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6ce84721-ba61-43ca-a49a-07665cc84e90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ade78e65244640c180d24fd17cea8300', 'request_id': 'req-6ce84721-ba61-43ca-a49a-07665cc84e90'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:52.166487 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6ce84721-ba61-43ca-a49a-07665cc84e90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ade78e65244640c180d24fd17cea8300', 'request_id': 'req-6ce84721-ba61-43ca-a49a-07665cc84e90'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:52.177997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6ce84721-ba61-43ca-a49a-07665cc84e90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ade78e65244640c180d24fd17cea8300', 'request_id': 'req-6ce84721-ba61-43ca-a49a-07665cc84e90'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:52.193952 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6ce84721-ba61-43ca-a49a-07665cc84e90 admin admin] The token cache is being invalidate because project ade78e65244640c180d24fd17cea8300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:36:52.194390 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6ce84721-ba61-43ca-a49a-07665cc84e90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:52.195190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6ce84721-ba61-43ca-a49a-07665cc84e90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:52.197331 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 928/1821] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:36:51 2022] DELETE /identity/v3/projects/ade78e65244640c180d24fd17cea8300 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:52.202020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce84721-ba61-43ca-a49a-07665cc84e90 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:52.203588 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6ce84721-ba61-43ca-a49a-07665cc84e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:52.228558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c2599-6893-4bdf-a690-37a4149cf319 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:52.311428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce84721-ba61-43ca-a49a-07665cc84e90 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:52.352791 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d405dd0-f969-44c3-ab80-cb35107ed79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:52.353937 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d405dd0-f969-44c3-ab80-cb35107ed79f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:52.354299 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d405dd0-f969-44c3-ab80-cb35107ed79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:52.354668 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d405dd0-f969-44c3-ab80-cb35107ed79f admin admin] PATH_INFO: `/v3/users/ecf376876f124a99b8055a281ba57531` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:52.360902 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d405dd0-f969-44c3-ab80-cb35107ed79f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecf376876f124a99b8055a281ba57531)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:52.363450 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d405dd0-f969-44c3-ab80-cb35107ed79f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:52.443814 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:52.447092 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb895f6-d708-4cb4-a006-20d32df7fec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:52.447882 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb895f6-d708-4cb4-a006-20d32df7fec3 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:52.448063 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb895f6-d708-4cb4-a006-20d32df7fec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:52.448630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb895f6-d708-4cb4-a006-20d32df7fec3 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:52.449759 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb895f6-d708-4cb4-a006-20d32df7fec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:52.452009 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb895f6-d708-4cb4-a006-20d32df7fec3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:52.460591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7d405dd0-f969-44c3-ab80-cb35107ed79f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecf376876f124a99b8055a281ba57531'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:52.475678 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7d405dd0-f969-44c3-ab80-cb35107ed79f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecf376876f124a99b8055a281ba57531'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:52.476610 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7d405dd0-f969-44c3-ab80-cb35107ed79f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecf376876f124a99b8055a281ba57531'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:52.487790 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 894/1822] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:36:52 2022] POST /identity/v3/users => generated 290 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:52.492674 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb895f6-d708-4cb4-a006-20d32df7fec3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:52.494017 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7d405dd0-f969-44c3-ab80-cb35107ed79f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecf376876f124a99b8055a281ba57531'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:52.494979 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6bb895f6-d708-4cb4-a006-20d32df7fec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:52.505763 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7d405dd0-f969-44c3-ab80-cb35107ed79f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecf376876f124a99b8055a281ba57531'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:52.511036 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb895f6-d708-4cb4-a006-20d32df7fec3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:52.518598 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 929/1823] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:36:52 2022] DELETE /identity/v3/users/ecf376876f124a99b8055a281ba57531 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:52.518811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69057278-5eed-405b-ada2-704b297b1220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:52.518811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69057278-5eed-405b-ada2-704b297b1220 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:52.518811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69057278-5eed-405b-ada2-704b297b1220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:52.518811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69057278-5eed-405b-ada2-704b297b1220 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:52.519661 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69057278-5eed-405b-ada2-704b297b1220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:52.522377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69057278-5eed-405b-ada2-704b297b1220 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:52.536002 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 895/1824] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:52.540081 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d405dd0-f969-44c3-ab80-cb35107ed79f admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:52.617839 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d405dd0-f969-44c3-ab80-cb35107ed79f admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:52.623872 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42058eb6-5856-47ee-9c74-316e046bb2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:52.625883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42058eb6-5856-47ee-9c74-316e046bb2a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:52.625883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42058eb6-5856-47ee-9c74-316e046bb2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:52.626634 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42058eb6-5856-47ee-9c74-316e046bb2a8 admin admin] PATH_INFO: `/v3/projects/b3b4c0ed15da480d9d670ed2ff03d6e3/users/620ac583d4424ed58a2b1280965d4b2d/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:52.655649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42058eb6-5856-47ee-9c74-316e046bb2a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b4c0ed15da480d9d670ed2ff03d6e3, user_id=620ac583d4424ed58a2b1280965d4b2d, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:52.658653 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42058eb6-5856-47ee-9c74-316e046bb2a8 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:52.677493 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 930/1825] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:52 2022] PUT /identity/v3/projects/b3b4c0ed15da480d9d670ed2ff03d6e3/users/620ac583d4424ed58a2b1280965d4b2d/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:52.681290 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69057278-5eed-405b-ada2-704b297b1220 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:52.693335 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69057278-5eed-405b-ada2-704b297b1220 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:52.738303 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:52.802238 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef79c0-4cf0-4e3c-84ad-37b780394740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:52.802996 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef79c0-4cf0-4e3c-84ad-37b780394740 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:52.803298 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef79c0-4cf0-4e3c-84ad-37b780394740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:52.803730 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42058eb6-5856-47ee-9c74-316e046bb2a8 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:52.803836 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef79c0-4cf0-4e3c-84ad-37b780394740 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:52.804561 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef79c0-4cf0-4e3c-84ad-37b780394740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:52.805604 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-42058eb6-5856-47ee-9c74-316e046bb2a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:52.806771 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef79c0-4cf0-4e3c-84ad-37b780394740 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:52.822743 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 896/1826] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:52.824714 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef79c0-4cf0-4e3c-84ad-37b780394740 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:52.839982 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef79c0-4cf0-4e3c-84ad-37b780394740 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:52.845868 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e18e1-f722-417c-a336-eca25847648a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:52.847337 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e18e1-f722-417c-a336-eca25847648a admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:52.847631 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e18e1-f722-417c-a336-eca25847648a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:52.847918 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e18e1-f722-417c-a336-eca25847648a admin admin] PATH_INFO: `/v3/projects/b3b4c0ed15da480d9d670ed2ff03d6e3/users/620ac583d4424ed58a2b1280965d4b2d/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:52.851240 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e18e1-f722-417c-a336-eca25847648a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b4c0ed15da480d9d670ed2ff03d6e3, user_id=620ac583d4424ed58a2b1280965d4b2d, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:52.855306 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e18e1-f722-417c-a336-eca25847648a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:52.900352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 897/1827] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:52 2022] PUT /identity/v3/projects/b3b4c0ed15da480d9d670ed2ff03d6e3/users/620ac583d4424ed58a2b1280965d4b2d/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:36:52.902699 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed9cb9-4dae-4353-82b2-e817345b9a9f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:52.902920 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed9cb9-4dae-4353-82b2-e817345b9a9f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:52.903168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed9cb9-4dae-4353-82b2-e817345b9a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:52.923576 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42058eb6-5856-47ee-9c74-316e046bb2a8 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:52.966013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-09ed9cb9-4dae-4353-82b2-e817345b9a9f None None] MFA Rules not processed for user `620ac583d4424ed58a2b1280965d4b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:52.967272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-09ed9cb9-4dae-4353-82b2-e817345b9a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:52.976832 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:53.045006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd109e56-8499-4593-95fa-8571673aeb0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:53.046119 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd109e56-8499-4593-95fa-8571673aeb0b service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:53.046719 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd109e56-8499-4593-95fa-8571673aeb0b service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:53.048001 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd109e56-8499-4593-95fa-8571673aeb0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:53.051288 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-dd109e56-8499-4593-95fa-8571673aeb0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:53.071279 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd109e56-8499-4593-95fa-8571673aeb0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:53.074129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd109e56-8499-4593-95fa-8571673aeb0b service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:53.087269 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 931/1828] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:53.102957 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 898/1829] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:52 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:36:53.129985 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd109e56-8499-4593-95fa-8571673aeb0b service nova] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:53.132185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-dd109e56-8499-4593-95fa-8571673aeb0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:53.215603 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd109e56-8499-4593-95fa-8571673aeb0b service nova] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:53.234904 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bc3fb-99e7-4761-a90c-a4d8406d3c30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:53.235735 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bc3fb-99e7-4761-a90c-a4d8406d3c30 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:53.236221 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bc3fb-99e7-4761-a90c-a4d8406d3c30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:53.236737 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bc3fb-99e7-4761-a90c-a4d8406d3c30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:53.252928 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8bc3fb-99e7-4761-a90c-a4d8406d3c30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:53.254853 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8bc3fb-99e7-4761-a90c-a4d8406d3c30 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:53.269702 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 932/1830] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:53 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:53.334395 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed9cb9-4dae-4353-82b2-e817345b9a9f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:53.336797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-09ed9cb9-4dae-4353-82b2-e817345b9a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:53.364555 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed9cb9-4dae-4353-82b2-e817345b9a9f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:53.377841 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941bcfd5-28f9-4c86-8b87-bc6643e147da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:53.380125 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bcfd5-28f9-4c86-8b87-bc6643e147da service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:53.380520 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bcfd5-28f9-4c86-8b87-bc6643e147da service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:53.380821 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bcfd5-28f9-4c86-8b87-bc6643e147da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:53.386112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-941bcfd5-28f9-4c86-8b87-bc6643e147da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:53.420633 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bc3fb-99e7-4761-a90c-a4d8406d3c30 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:53.422242 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0d8bc3fb-99e7-4761-a90c-a4d8406d3c30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:53.552386 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941bcfd5-28f9-4c86-8b87-bc6643e147da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:53.557119 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941bcfd5-28f9-4c86-8b87-bc6643e147da service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:53.581339 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 899/1831] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:53 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:53.599006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bc3fb-99e7-4761-a90c-a4d8406d3c30 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:53.610692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be07d80-dcf3-4516-8bdf-d963b9a36350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:53.611672 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be07d80-dcf3-4516-8bdf-d963b9a36350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:53.612023 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be07d80-dcf3-4516-8bdf-d963b9a36350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:53.612401 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be07d80-dcf3-4516-8bdf-d963b9a36350 admin admin] PATH_INFO: `/v3/projects/204409a92bd540f3bbfb8a25857a1e7f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:53.615436 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be07d80-dcf3-4516-8bdf-d963b9a36350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=204409a92bd540f3bbfb8a25857a1e7f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:53.617547 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be07d80-dcf3-4516-8bdf-d963b9a36350 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:53.708291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0be07d80-dcf3-4516-8bdf-d963b9a36350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '204409a92bd540f3bbfb8a25857a1e7f', 'request_id': 'req-0be07d80-dcf3-4516-8bdf-d963b9a36350'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:53.728204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0be07d80-dcf3-4516-8bdf-d963b9a36350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '204409a92bd540f3bbfb8a25857a1e7f', 'request_id': 'req-0be07d80-dcf3-4516-8bdf-d963b9a36350'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:53.754386 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0be07d80-dcf3-4516-8bdf-d963b9a36350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '204409a92bd540f3bbfb8a25857a1e7f', 'request_id': 'req-0be07d80-dcf3-4516-8bdf-d963b9a36350'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:53.775498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:53.786230 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0be07d80-dcf3-4516-8bdf-d963b9a36350 admin admin] The token cache is being invalidate because project 204409a92bd540f3bbfb8a25857a1e7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:36:53.790508 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0be07d80-dcf3-4516-8bdf-d963b9a36350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:53.791968 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0be07d80-dcf3-4516-8bdf-d963b9a36350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:53.795970 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 933/1832] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:36:53 2022] DELETE /identity/v3/projects/204409a92bd540f3bbfb8a25857a1e7f => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:36:53.800873 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb25bfd-23ca-4d94-bbf2-fb309dda3d8a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:53.801171 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb25bfd-23ca-4d94-bbf2-fb309dda3d8a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:53.801459 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb25bfd-23ca-4d94-bbf2-fb309dda3d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:53.831934 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-edb25bfd-23ca-4d94-bbf2-fb309dda3d8a None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:53.833646 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-edb25bfd-23ca-4d94-bbf2-fb309dda3d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:53.861380 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:53.927246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 900/1833] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:53.935977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8247668-4191-4017-871b-2eb665ff77b7 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:53.935977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8247668-4191-4017-871b-2eb665ff77b7 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:53.936261 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8247668-4191-4017-871b-2eb665ff77b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:53.960848 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d8247668-4191-4017-871b-2eb665ff77b7 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:53.962588 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d8247668-4191-4017-871b-2eb665ff77b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:53.971344 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 934/1834] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:36:53.977333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb25bfd-23ca-4d94-bbf2-fb309dda3d8a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:53.997624 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb25bfd-23ca-4d94-bbf2-fb309dda3d8a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:54.022490 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45072ef-2dce-4353-80b7-b5cd2e8d0fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:54.023236 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45072ef-2dce-4353-80b7-b5cd2e8d0fff admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:54.023524 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45072ef-2dce-4353-80b7-b5cd2e8d0fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:54.023898 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45072ef-2dce-4353-80b7-b5cd2e8d0fff admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:54.024735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45072ef-2dce-4353-80b7-b5cd2e8d0fff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:54.025656 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45072ef-2dce-4353-80b7-b5cd2e8d0fff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:54.027718 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45072ef-2dce-4353-80b7-b5cd2e8d0fff admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:54.056666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 901/1835] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:54.061388 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8247668-4191-4017-871b-2eb665ff77b7 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:54.085967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8247668-4191-4017-871b-2eb665ff77b7 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:54.099813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e6cfc-d58d-4288-8f21-07f391213d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:54.100537 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e6cfc-d58d-4288-8f21-07f391213d80 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:54.100821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e6cfc-d58d-4288-8f21-07f391213d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:54.101123 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e6cfc-d58d-4288-8f21-07f391213d80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:54.102205 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e6cfc-d58d-4288-8f21-07f391213d80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:54.104019 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e6cfc-d58d-4288-8f21-07f391213d80 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:54.177031 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 935/1836] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:36:54 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:54.181345 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45072ef-2dce-4353-80b7-b5cd2e8d0fff admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:54.198654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45072ef-2dce-4353-80b7-b5cd2e8d0fff admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:54.346724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55cc35-2a66-4a10-9e8d-220249358fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:54.347733 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55cc35-2a66-4a10-9e8d-220249358fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:54.348021 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55cc35-2a66-4a10-9e8d-220249358fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:54.348628 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55cc35-2a66-4a10-9e8d-220249358fd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:54.349050 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b55cc35-2a66-4a10-9e8d-220249358fd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:54.351056 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b55cc35-2a66-4a10-9e8d-220249358fd5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:54.376790 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 902/1837] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:36:54 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:54.378044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e6cfc-d58d-4288-8f21-07f391213d80 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:54.390154 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e6cfc-d58d-4288-8f21-07f391213d80 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:54.407248 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666e5aa-cd4b-45f7-8eba-c2a4f191aa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:54.408552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666e5aa-cd4b-45f7-8eba-c2a4f191aa91 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:54.409152 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666e5aa-cd4b-45f7-8eba-c2a4f191aa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:54.409578 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666e5aa-cd4b-45f7-8eba-c2a4f191aa91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:54.410722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c666e5aa-cd4b-45f7-8eba-c2a4f191aa91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:54.413028 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c666e5aa-cd4b-45f7-8eba-c2a4f191aa91 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:54.430086 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 936/1838] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:54.430979 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55cc35-2a66-4a10-9e8d-220249358fd5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:54.444262 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55cc35-2a66-4a10-9e8d-220249358fd5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:54.450862 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b7b1c-640d-4e8b-8fc2-2df4cfab9bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:54.452841 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b7b1c-640d-4e8b-8fc2-2df4cfab9bec admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:54.453435 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b7b1c-640d-4e8b-8fc2-2df4cfab9bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:54.453882 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b7b1c-640d-4e8b-8fc2-2df4cfab9bec admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:54.454771 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b7b1c-640d-4e8b-8fc2-2df4cfab9bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:54.456963 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b7b1c-640d-4e8b-8fc2-2df4cfab9bec admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:54.473491 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666e5aa-cd4b-45f7-8eba-c2a4f191aa91 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:54.475375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 903/1839] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:36:54.488458 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666e5aa-cd4b-45f7-8eba-c2a4f191aa91 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:54.495210 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04200d9e-40d8-4b6f-bb41-cbec48d9b558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:54.496402 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04200d9e-40d8-4b6f-bb41-cbec48d9b558 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:54.497357 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04200d9e-40d8-4b6f-bb41-cbec48d9b558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:54.497787 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04200d9e-40d8-4b6f-bb41-cbec48d9b558 admin admin] PATH_INFO: `/v3/projects/64e41608d1d5490ab2470061b34fbab1/users/9d7269a9501a4be5a1beba918e75e09a/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:54.518986 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04200d9e-40d8-4b6f-bb41-cbec48d9b558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e41608d1d5490ab2470061b34fbab1, user_id=9d7269a9501a4be5a1beba918e75e09a, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:54.522410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04200d9e-40d8-4b6f-bb41-cbec48d9b558 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:54.548347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 937/1840] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:54 2022] PUT /identity/v3/projects/64e41608d1d5490ab2470061b34fbab1/users/9d7269a9501a4be5a1beba918e75e09a/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:36:54.554429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0beef85-15e5-4b0e-aabb-8ea6e64845be None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:54.554918 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0beef85-15e5-4b0e-aabb-8ea6e64845be None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:54.555063 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0beef85-15e5-4b0e-aabb-8ea6e64845be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:54.589305 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b0beef85-15e5-4b0e-aabb-8ea6e64845be None None] MFA Rules not processed for user `9d7269a9501a4be5a1beba918e75e09a`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:54.600817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b0beef85-15e5-4b0e-aabb-8ea6e64845be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:54.721953 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 904/1841] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:54.727466 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04200d9e-40d8-4b6f-bb41-cbec48d9b558 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:54.805584 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04200d9e-40d8-4b6f-bb41-cbec48d9b558 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:54.810412 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb733f4e-365d-41c2-9137-c02b40b529dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:54.811111 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb733f4e-365d-41c2-9137-c02b40b529dc admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:54.811401 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb733f4e-365d-41c2-9137-c02b40b529dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:54.811684 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb733f4e-365d-41c2-9137-c02b40b529dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:54.812434 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb733f4e-365d-41c2-9137-c02b40b529dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:54.814842 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb733f4e-365d-41c2-9137-c02b40b529dc admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:54.845707 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 938/1842] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:36:54 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:54.851903 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0beef85-15e5-4b0e-aabb-8ea6e64845be None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:54.884131 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0beef85-15e5-4b0e-aabb-8ea6e64845be None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:54.905714 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:55.006541 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909bb85-6eea-4098-88d8-d202e5701818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:55.007987 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909bb85-6eea-4098-88d8-d202e5701818 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:55.008566 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909bb85-6eea-4098-88d8-d202e5701818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:55.008954 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909bb85-6eea-4098-88d8-d202e5701818 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:55.010696 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909bb85-6eea-4098-88d8-d202e5701818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:55.013609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909bb85-6eea-4098-88d8-d202e5701818 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:55.059653 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 905/1843] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:36:54 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:55.063679 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb733f4e-365d-41c2-9137-c02b40b529dc admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:55.088186 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb733f4e-365d-41c2-9137-c02b40b529dc admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:55.105201 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc4c79-2311-43ca-a533-be7ac3f0810f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:55.105897 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc4c79-2311-43ca-a533-be7ac3f0810f admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:55.106187 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc4c79-2311-43ca-a533-be7ac3f0810f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:55.106469 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc4c79-2311-43ca-a533-be7ac3f0810f admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:55.107213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc4c79-2311-43ca-a533-be7ac3f0810f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:55.112101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc4c79-2311-43ca-a533-be7ac3f0810f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:55.136465 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 939/1844] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:55.140324 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909bb85-6eea-4098-88d8-d202e5701818 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:55.155877 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909bb85-6eea-4098-88d8-d202e5701818 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:55.161792 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca2e59-9e5d-4e3d-b6de-4c62f373a1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:55.163174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca2e59-9e5d-4e3d-b6de-4c62f373a1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:55.163459 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca2e59-9e5d-4e3d-b6de-4c62f373a1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:55.163737 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca2e59-9e5d-4e3d-b6de-4c62f373a1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:55.164647 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca2e59-9e5d-4e3d-b6de-4c62f373a1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:55.166354 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca2e59-9e5d-4e3d-b6de-4c62f373a1f9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:55.177711 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 906/1845] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:55.183684 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc4c79-2311-43ca-a533-be7ac3f0810f admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:55.194696 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc4c79-2311-43ca-a533-be7ac3f0810f admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:55.200851 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2993a9-6b0b-4148-97ae-a1cf8cd968c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:55.202045 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2993a9-6b0b-4148-97ae-a1cf8cd968c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:55.202512 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2993a9-6b0b-4148-97ae-a1cf8cd968c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:55.203159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2993a9-6b0b-4148-97ae-a1cf8cd968c1 admin admin] PATH_INFO: `/v3/projects/05f37f206de248c6af7e3f9406279374/users/dbd485e10da24048886c3c3bfe6c7e4c/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:55.259968 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2993a9-6b0b-4148-97ae-a1cf8cd968c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f37f206de248c6af7e3f9406279374, user_id=dbd485e10da24048886c3c3bfe6c7e4c, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:55.262738 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2993a9-6b0b-4148-97ae-a1cf8cd968c1 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:55.295579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 940/1846] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:55 2022] PUT /identity/v3/projects/05f37f206de248c6af7e3f9406279374/users/dbd485e10da24048886c3c3bfe6c7e4c/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:55.297207 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1527f-a817-47aa-9ebd-2599e6c3c2cd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:55.297912 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1527f-a817-47aa-9ebd-2599e6c3c2cd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:55.297912 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1527f-a817-47aa-9ebd-2599e6c3c2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:55.344514 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-89b1527f-a817-47aa-9ebd-2599e6c3c2cd None None] MFA Rules not processed for user `dbd485e10da24048886c3c3bfe6c7e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:55.346008 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-89b1527f-a817-47aa-9ebd-2599e6c3c2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:55.484828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 907/1847] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:36:55.492111 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2993a9-6b0b-4148-97ae-a1cf8cd968c1 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:55.553878 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:55.576270 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2993a9-6b0b-4148-97ae-a1cf8cd968c1 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:55.581709 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ccf718-37e9-4d76-854f-f6b7871e001f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:55.582466 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccf718-37e9-4d76-854f-f6b7871e001f admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:55.582842 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccf718-37e9-4d76-854f-f6b7871e001f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:55.583215 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccf718-37e9-4d76-854f-f6b7871e001f admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:55.584020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ccf718-37e9-4d76-854f-f6b7871e001f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:55.587412 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ccf718-37e9-4d76-854f-f6b7871e001f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:55.615087 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 941/1848] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:36:55 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:36:55.619623 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1527f-a817-47aa-9ebd-2599e6c3c2cd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:55.632476 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1527f-a817-47aa-9ebd-2599e6c3c2cd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:55.707855 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcb0b5-1632-4718-9b95-a76040426a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:55.708741 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcb0b5-1632-4718-9b95-a76040426a0b admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:55.709026 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcb0b5-1632-4718-9b95-a76040426a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:55.709471 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcb0b5-1632-4718-9b95-a76040426a0b admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:55.710200 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bcb0b5-1632-4718-9b95-a76040426a0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:55.712098 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bcb0b5-1632-4718-9b95-a76040426a0b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:55.738023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 908/1849] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:36:55 2022] POST /identity/v3/users => generated 300 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:55.743111 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ccf718-37e9-4d76-854f-f6b7871e001f admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:55.755145 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ccf718-37e9-4d76-854f-f6b7871e001f admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:55.760915 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48acb94-00f4-4fe2-b1bc-6489f5695328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:55.761507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48acb94-00f4-4fe2-b1bc-6489f5695328 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:55.761795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48acb94-00f4-4fe2-b1bc-6489f5695328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:55.762070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48acb94-00f4-4fe2-b1bc-6489f5695328 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:55.762805 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48acb94-00f4-4fe2-b1bc-6489f5695328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:55.764454 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48acb94-00f4-4fe2-b1bc-6489f5695328 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:55.779149 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 942/1850] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:55.780360 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcb0b5-1632-4718-9b95-a76040426a0b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:55.792129 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcb0b5-1632-4718-9b95-a76040426a0b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:55.798024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921becd-194a-4681-b286-d3747357709c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:55.799238 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921becd-194a-4681-b286-d3747357709c admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:55.799582 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921becd-194a-4681-b286-d3747357709c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:55.799927 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921becd-194a-4681-b286-d3747357709c admin admin] PATH_INFO: `/v3/projects/7b3bceea62874371a04e2ae8ae4e2936/users/352f3f613ded458eb9d49978903889fe/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:55.816644 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:55.821252 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921becd-194a-4681-b286-d3747357709c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b3bceea62874371a04e2ae8ae4e2936, user_id=352f3f613ded458eb9d49978903889fe, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:55.824019 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921becd-194a-4681-b286-d3747357709c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:55.853232 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 909/1851] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:55 2022] PUT /identity/v3/projects/7b3bceea62874371a04e2ae8ae4e2936/users/352f3f613ded458eb9d49978903889fe/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:36:55.857549 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48acb94-00f4-4fe2-b1bc-6489f5695328 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:55.868854 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48acb94-00f4-4fe2-b1bc-6489f5695328 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:55.929974 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b667c-ae40-448b-b3cd-6f43bfb32bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:55.930869 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b667c-ae40-448b-b3cd-6f43bfb32bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:55.931742 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b667c-ae40-448b-b3cd-6f43bfb32bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:55.931742 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b667c-ae40-448b-b3cd-6f43bfb32bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:55.932507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b667c-ae40-448b-b3cd-6f43bfb32bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:55.934515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b667c-ae40-448b-b3cd-6f43bfb32bb6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:55.945649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 943/1852] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:36:55.949958 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921becd-194a-4681-b286-d3747357709c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:55.965601 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921becd-194a-4681-b286-d3747357709c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:55.974107 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c3b68-c40b-4bf9-b27e-543f95f0f94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:55.976062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c3b68-c40b-4bf9-b27e-543f95f0f94c admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:55.976522 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c3b68-c40b-4bf9-b27e-543f95f0f94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:55.976951 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c3b68-c40b-4bf9-b27e-543f95f0f94c admin admin] PATH_INFO: `/v3/projects/7b3bceea62874371a04e2ae8ae4e2936/users/352f3f613ded458eb9d49978903889fe/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:55.980685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c3b68-c40b-4bf9-b27e-543f95f0f94c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b3bceea62874371a04e2ae8ae4e2936, user_id=352f3f613ded458eb9d49978903889fe, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:55.983402 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c3b68-c40b-4bf9-b27e-543f95f0f94c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:55.995001 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 910/1853] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:55 2022] PUT /identity/v3/projects/7b3bceea62874371a04e2ae8ae4e2936/users/352f3f613ded458eb9d49978903889fe/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:56.004999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bec5c-0128-4000-8117-ad504a6376e2 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:56.005291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bec5c-0128-4000-8117-ad504a6376e2 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:56.005577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bec5c-0128-4000-8117-ad504a6376e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:56.034279 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-838bec5c-0128-4000-8117-ad504a6376e2 None None] MFA Rules not processed for user `352f3f613ded458eb9d49978903889fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:56.035791 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-838bec5c-0128-4000-8117-ad504a6376e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:56.117795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 944/1854] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:56.136674 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c3b68-c40b-4bf9-b27e-543f95f0f94c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:56.138390 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-393c3b68-c40b-4bf9-b27e-543f95f0f94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:56.202197 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c3b68-c40b-4bf9-b27e-543f95f0f94c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:56.206095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c08a15-270a-4653-aae6-165a0f45fcef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:56.206742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c08a15-270a-4653-aae6-165a0f45fcef service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:56.207026 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c08a15-270a-4653-aae6-165a0f45fcef service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:56.207300 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c08a15-270a-4653-aae6-165a0f45fcef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:56.216811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c08a15-270a-4653-aae6-165a0f45fcef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:56.218244 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c08a15-270a-4653-aae6-165a0f45fcef service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:56.228137 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 911/1855] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:56.869315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bec5c-0128-4000-8117-ad504a6376e2 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:56.879051 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bec5c-0128-4000-8117-ad504a6376e2 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:56.883187 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83843d02-4b45-4eae-9e5e-247236096d07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:56.883823 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83843d02-4b45-4eae-9e5e-247236096d07 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:56.884102 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83843d02-4b45-4eae-9e5e-247236096d07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:56.884413 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83843d02-4b45-4eae-9e5e-247236096d07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:56.923393 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:56.942946 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83843d02-4b45-4eae-9e5e-247236096d07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:56.944967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83843d02-4b45-4eae-9e5e-247236096d07 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:56.953911 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 945/1856] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:57.507905 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c08a15-270a-4653-aae6-165a0f45fcef service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:57.509420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-53c08a15-270a-4653-aae6-165a0f45fcef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:57.574336 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c08a15-270a-4653-aae6-165a0f45fcef service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:57.578873 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79ad87-a327-45e2-889d-cd5dddf7a891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:57.579743 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79ad87-a327-45e2-889d-cd5dddf7a891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:57.580032 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79ad87-a327-45e2-889d-cd5dddf7a891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:57.580592 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79ad87-a327-45e2-889d-cd5dddf7a891 admin admin] PATH_INFO: `/v3/users/40bfb479aa784e60be727cbe22694feb` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:57.581778 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79ad87-a327-45e2-889d-cd5dddf7a891 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40bfb479aa784e60be727cbe22694feb)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:57.583706 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79ad87-a327-45e2-889d-cd5dddf7a891 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:57.639949 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1a79ad87-a327-45e2-889d-cd5dddf7a891 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40bfb479aa784e60be727cbe22694feb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:57.649293 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1a79ad87-a327-45e2-889d-cd5dddf7a891 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40bfb479aa784e60be727cbe22694feb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:57.650047 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1a79ad87-a327-45e2-889d-cd5dddf7a891 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40bfb479aa784e60be727cbe22694feb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:57.675697 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1a79ad87-a327-45e2-889d-cd5dddf7a891 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40bfb479aa784e60be727cbe22694feb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:57.686866 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1a79ad87-a327-45e2-889d-cd5dddf7a891 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40bfb479aa784e60be727cbe22694feb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:57.690194 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:57.697457 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 912/1857] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:36:57 2022] DELETE /identity/v3/users/40bfb479aa784e60be727cbe22694feb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:57.701797 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2d665-c224-49ff-a3b5-92d597c2fa46 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:57.702470 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2d665-c224-49ff-a3b5-92d597c2fa46 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:57.702818 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2d665-c224-49ff-a3b5-92d597c2fa46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:57.733194 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-63e2d665-c224-49ff-a3b5-92d597c2fa46 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:57.737467 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-63e2d665-c224-49ff-a3b5-92d597c2fa46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:57.829776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 946/1858] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:57.838027 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79ad87-a327-45e2-889d-cd5dddf7a891 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:57.839806 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1a79ad87-a327-45e2-889d-cd5dddf7a891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:57.921325 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79ad87-a327-45e2-889d-cd5dddf7a891 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:57.925148 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549a418-a348-47a5-9466-b096e90fc724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:57.925863 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549a418-a348-47a5-9466-b096e90fc724 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:57.926217 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549a418-a348-47a5-9466-b096e90fc724 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:57.926558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549a418-a348-47a5-9466-b096e90fc724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:57.937160 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549a418-a348-47a5-9466-b096e90fc724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:57.938898 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549a418-a348-47a5-9466-b096e90fc724 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:57.949979 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 913/1859] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:36:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:36:58.289194 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2d665-c224-49ff-a3b5-92d597c2fa46 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:58.291267 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-63e2d665-c224-49ff-a3b5-92d597c2fa46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:58.310570 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2d665-c224-49ff-a3b5-92d597c2fa46 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:58.319644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbf157-6b95-4202-b45a-0d4ca2332407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:58.321503 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbf157-6b95-4202-b45a-0d4ca2332407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:58.322058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbf157-6b95-4202-b45a-0d4ca2332407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:58.322669 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbf157-6b95-4202-b45a-0d4ca2332407 admin admin] PATH_INFO: `/v3/projects/439d8ef9f0714832bf92d09394477e34` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:58.323946 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bbf157-6b95-4202-b45a-0d4ca2332407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=439d8ef9f0714832bf92d09394477e34)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:58.325980 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bbf157-6b95-4202-b45a-0d4ca2332407 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:58.474149 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a3bbf157-6b95-4202-b45a-0d4ca2332407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '439d8ef9f0714832bf92d09394477e34', 'request_id': 'req-a3bbf157-6b95-4202-b45a-0d4ca2332407'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:58.501347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a3bbf157-6b95-4202-b45a-0d4ca2332407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '439d8ef9f0714832bf92d09394477e34', 'request_id': 'req-a3bbf157-6b95-4202-b45a-0d4ca2332407'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:58.519229 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a3bbf157-6b95-4202-b45a-0d4ca2332407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '439d8ef9f0714832bf92d09394477e34', 'request_id': 'req-a3bbf157-6b95-4202-b45a-0d4ca2332407'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:58.544112 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a3bbf157-6b95-4202-b45a-0d4ca2332407 admin admin] The token cache is being invalidate because project 439d8ef9f0714832bf92d09394477e34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:36:58.544447 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a3bbf157-6b95-4202-b45a-0d4ca2332407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:58.547539 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a3bbf157-6b95-4202-b45a-0d4ca2332407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:58.550611 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 947/1860] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:36:58 2022] DELETE /identity/v3/projects/439d8ef9f0714832bf92d09394477e34 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:58.554304 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549a418-a348-47a5-9466-b096e90fc724 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:58.570226 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549a418-a348-47a5-9466-b096e90fc724 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:58.677218 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552916da-d051-494b-9477-76de79dd7133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:58.678690 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552916da-d051-494b-9477-76de79dd7133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:58.679080 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552916da-d051-494b-9477-76de79dd7133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:58.679293 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552916da-d051-494b-9477-76de79dd7133 admin admin] PATH_INFO: `/v3/users/620ac583d4424ed58a2b1280965d4b2d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:58.680650 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552916da-d051-494b-9477-76de79dd7133 admin admin] RBAC: Authorizing `identity:delete_user(user_id=620ac583d4424ed58a2b1280965d4b2d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:58.682798 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552916da-d051-494b-9477-76de79dd7133 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:58.739933 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-552916da-d051-494b-9477-76de79dd7133 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '620ac583d4424ed58a2b1280965d4b2d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:58.747564 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-552916da-d051-494b-9477-76de79dd7133 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '620ac583d4424ed58a2b1280965d4b2d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:58.748250 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-552916da-d051-494b-9477-76de79dd7133 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '620ac583d4424ed58a2b1280965d4b2d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:58.761206 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-552916da-d051-494b-9477-76de79dd7133 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '620ac583d4424ed58a2b1280965d4b2d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:58.768664 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-552916da-d051-494b-9477-76de79dd7133 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '620ac583d4424ed58a2b1280965d4b2d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:58.780218 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 914/1861] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:36:58 2022] DELETE /identity/v3/users/620ac583d4424ed58a2b1280965d4b2d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:59.062900 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbf157-6b95-4202-b45a-0d4ca2332407 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:59.064904 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a3bbf157-6b95-4202-b45a-0d4ca2332407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:59.083323 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbf157-6b95-4202-b45a-0d4ca2332407 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:59.147454 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956cbf6-b830-48b9-be04-0b25e1ce1801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:59.155296 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956cbf6-b830-48b9-be04-0b25e1ce1801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:59.155684 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956cbf6-b830-48b9-be04-0b25e1ce1801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:59.155869 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956cbf6-b830-48b9-be04-0b25e1ce1801 admin admin] PATH_INFO: `/v3/projects/b3b4c0ed15da480d9d670ed2ff03d6e3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:59.157252 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956cbf6-b830-48b9-be04-0b25e1ce1801 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3b4c0ed15da480d9d670ed2ff03d6e3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:59.159166 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956cbf6-b830-48b9-be04-0b25e1ce1801 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:59.162482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:59.209487 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4956cbf6-b830-48b9-be04-0b25e1ce1801 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3b4c0ed15da480d9d670ed2ff03d6e3', 'request_id': 'req-4956cbf6-b830-48b9-be04-0b25e1ce1801'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:59.217440 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4956cbf6-b830-48b9-be04-0b25e1ce1801 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3b4c0ed15da480d9d670ed2ff03d6e3', 'request_id': 'req-4956cbf6-b830-48b9-be04-0b25e1ce1801'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:59.225158 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4956cbf6-b830-48b9-be04-0b25e1ce1801 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3b4c0ed15da480d9d670ed2ff03d6e3', 'request_id': 'req-4956cbf6-b830-48b9-be04-0b25e1ce1801'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:59.248763 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4956cbf6-b830-48b9-be04-0b25e1ce1801 admin admin] The token cache is being invalidate because project b3b4c0ed15da480d9d670ed2ff03d6e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:36:59.249361 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4956cbf6-b830-48b9-be04-0b25e1ce1801 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:59.250107 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-4956cbf6-b830-48b9-be04-0b25e1ce1801 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:36:59.252331 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 948/1862] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:36:59 2022] DELETE /identity/v3/projects/b3b4c0ed15da480d9d670ed2ff03d6e3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:59.257986 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b703432-eb8e-4620-a4b0-208ffd7f4410 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:59.258559 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b703432-eb8e-4620-a4b0-208ffd7f4410 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:59.258915 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b703432-eb8e-4620-a4b0-208ffd7f4410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:59.280637 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2b703432-eb8e-4620-a4b0-208ffd7f4410 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:59.281869 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2b703432-eb8e-4620-a4b0-208ffd7f4410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:59.308175 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:59.362591 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 915/1863] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:59.371900 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95664ffc-91b9-4d01-bc5a-3743395b6f53 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:59.372575 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95664ffc-91b9-4d01-bc5a-3743395b6f53 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:59.372981 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95664ffc-91b9-4d01-bc5a-3743395b6f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:59.394736 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-95664ffc-91b9-4d01-bc5a-3743395b6f53 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:59.396083 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-95664ffc-91b9-4d01-bc5a-3743395b6f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:59.405117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 949/1864] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:59.409495 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b703432-eb8e-4620-a4b0-208ffd7f4410 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:59.419368 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b703432-eb8e-4620-a4b0-208ffd7f4410 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:59.424021 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f3bf1-5cd3-42d9-8dc0-34b2260a4334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:59.424721 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f3bf1-5cd3-42d9-8dc0-34b2260a4334 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:59.425010 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f3bf1-5cd3-42d9-8dc0-34b2260a4334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:59.425284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f3bf1-5cd3-42d9-8dc0-34b2260a4334 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:59.427283 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f3bf1-5cd3-42d9-8dc0-34b2260a4334 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:59.427283 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f3bf1-5cd3-42d9-8dc0-34b2260a4334 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:59.427951 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f3bf1-5cd3-42d9-8dc0-34b2260a4334 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:59.439977 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 916/1865] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:59.444622 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95664ffc-91b9-4d01-bc5a-3743395b6f53 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:59.453756 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95664ffc-91b9-4d01-bc5a-3743395b6f53 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:59.458714 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f00488-7ead-4975-9e56-d6b5c0907ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:59.459949 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f00488-7ead-4975-9e56-d6b5c0907ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:59.460248 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f00488-7ead-4975-9e56-d6b5c0907ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:59.460770 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f00488-7ead-4975-9e56-d6b5c0907ad4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:59.461735 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f00488-7ead-4975-9e56-d6b5c0907ad4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:59.463677 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f00488-7ead-4975-9e56-d6b5c0907ad4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:59.489081 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 950/1866] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:36:59 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:59.493184 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f3bf1-5cd3-42d9-8dc0-34b2260a4334 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:59.503149 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f3bf1-5cd3-42d9-8dc0-34b2260a4334 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:59.586074 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a0e09-01e7-4e84-8934-a8777ba4be68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:59.587070 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a0e09-01e7-4e84-8934-a8777ba4be68 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:59.587414 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a0e09-01e7-4e84-8934-a8777ba4be68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:59.587612 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a0e09-01e7-4e84-8934-a8777ba4be68 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:59.588353 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a0e09-01e7-4e84-8934-a8777ba4be68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:59.590534 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a0e09-01e7-4e84-8934-a8777ba4be68 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:59.613478 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 917/1867] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:36:59 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:36:59.617199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f00488-7ead-4975-9e56-d6b5c0907ad4 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:59.627535 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f00488-7ead-4975-9e56-d6b5c0907ad4 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:59.634002 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858269a3-de65-41f5-8252-7ef93a2d356c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:59.634746 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858269a3-de65-41f5-8252-7ef93a2d356c admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:59.635102 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858269a3-de65-41f5-8252-7ef93a2d356c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:59.635444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858269a3-de65-41f5-8252-7ef93a2d356c admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:59.636243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858269a3-de65-41f5-8252-7ef93a2d356c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:59.637918 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858269a3-de65-41f5-8252-7ef93a2d356c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:59.652871 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 951/1868] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:36:59.657060 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a0e09-01e7-4e84-8934-a8777ba4be68 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:59.669945 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a0e09-01e7-4e84-8934-a8777ba4be68 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:59.676239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56640c4c-2d5d-49d2-add6-4a0dca6fb34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:59.678367 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56640c4c-2d5d-49d2-add6-4a0dca6fb34e admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:59.678367 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56640c4c-2d5d-49d2-add6-4a0dca6fb34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:59.678367 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56640c4c-2d5d-49d2-add6-4a0dca6fb34e admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:59.678367 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56640c4c-2d5d-49d2-add6-4a0dca6fb34e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:59.679889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56640c4c-2d5d-49d2-add6-4a0dca6fb34e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:59.691346 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 918/1869] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:59.695571 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858269a3-de65-41f5-8252-7ef93a2d356c admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:59.706327 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858269a3-de65-41f5-8252-7ef93a2d356c admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:59.711990 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3fab6-7fbf-4b5d-88c5-f936b4991156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:59.713037 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3fab6-7fbf-4b5d-88c5-f936b4991156 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:59.713498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3fab6-7fbf-4b5d-88c5-f936b4991156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:59.713594 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3fab6-7fbf-4b5d-88c5-f936b4991156 admin admin] PATH_INFO: `/v3/projects/3146b6e17fff47e4bbe1e9b6f69f7ab7/users/643643d3194a40b2a4d961c8a3371d35/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:59.731591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3fab6-7fbf-4b5d-88c5-f936b4991156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3146b6e17fff47e4bbe1e9b6f69f7ab7, user_id=643643d3194a40b2a4d961c8a3371d35, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:59.734382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3fab6-7fbf-4b5d-88c5-f936b4991156 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:59.750572 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 952/1870] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:36:59 2022] PUT /identity/v3/projects/3146b6e17fff47e4bbe1e9b6f69f7ab7/users/643643d3194a40b2a4d961c8a3371d35/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:59.761373 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a45e31-156a-4f6a-9e52-e37ad2f936a1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:59.761687 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a45e31-156a-4f6a-9e52-e37ad2f936a1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:59.762068 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a45e31-156a-4f6a-9e52-e37ad2f936a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:59.790418 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-24a45e31-156a-4f6a-9e52-e37ad2f936a1 None None] MFA Rules not processed for user `643643d3194a40b2a4d961c8a3371d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:59.791678 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-24a45e31-156a-4f6a-9e52-e37ad2f936a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:59.865377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 919/1871] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:36:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:36:59.870430 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3fab6-7fbf-4b5d-88c5-f936b4991156 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:59.963189 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3fab6-7fbf-4b5d-88c5-f936b4991156 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:59.970212 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b693db-94e4-4e58-b6c1-50de99ee4d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:59.971145 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b693db-94e4-4e58-b6c1-50de99ee4d60 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:59.971783 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b693db-94e4-4e58-b6c1-50de99ee4d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:59.972094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b693db-94e4-4e58-b6c1-50de99ee4d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:59.976964 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b693db-94e4-4e58-b6c1-50de99ee4d60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:59.979808 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b693db-94e4-4e58-b6c1-50de99ee4d60 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:00.027959 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 953/1872] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:36:59 2022] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:00.032987 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a45e31-156a-4f6a-9e52-e37ad2f936a1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:00.062204 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a45e31-156a-4f6a-9e52-e37ad2f936a1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:00.099117 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:00.153564 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0d769-1838-4d19-8188-4fc94e01d42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:00.154240 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0d769-1838-4d19-8188-4fc94e01d42f admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:00.154523 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0d769-1838-4d19-8188-4fc94e01d42f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:00.154800 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0d769-1838-4d19-8188-4fc94e01d42f admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:00.155498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0d769-1838-4d19-8188-4fc94e01d42f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:00.157449 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0d769-1838-4d19-8188-4fc94e01d42f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:00.178198 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 920/1873] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:37:00 2022] POST /identity/v3/users => generated 296 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:00.182113 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b693db-94e4-4e58-b6c1-50de99ee4d60 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:00.192863 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b693db-94e4-4e58-b6c1-50de99ee4d60 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:00.198230 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9253e5-4df9-4e22-ac73-cf076bae72b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:00.198886 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9253e5-4df9-4e22-ac73-cf076bae72b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:00.199172 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9253e5-4df9-4e22-ac73-cf076bae72b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:00.199452 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9253e5-4df9-4e22-ac73-cf076bae72b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:00.200180 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9253e5-4df9-4e22-ac73-cf076bae72b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:00.201840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9253e5-4df9-4e22-ac73-cf076bae72b1 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:00.213300 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 954/1874] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:37:00.217645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0d769-1838-4d19-8188-4fc94e01d42f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:00.228012 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0d769-1838-4d19-8188-4fc94e01d42f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:00.232663 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed50b8-ccce-4fae-b5c9-ce13665fc459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:00.233554 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed50b8-ccce-4fae-b5c9-ce13665fc459 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:00.233838 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed50b8-ccce-4fae-b5c9-ce13665fc459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:00.234113 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed50b8-ccce-4fae-b5c9-ce13665fc459 admin admin] PATH_INFO: `/v3/projects/4003041927e944d7874bb66b4e0456c2/users/c2e94f665e674224b44ee6a3dc26ccdf/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:00.251673 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed50b8-ccce-4fae-b5c9-ce13665fc459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4003041927e944d7874bb66b4e0456c2, user_id=c2e94f665e674224b44ee6a3dc26ccdf, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:00.254525 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed50b8-ccce-4fae-b5c9-ce13665fc459 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:00.268424 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 921/1875] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:37:00 2022] PUT /identity/v3/projects/4003041927e944d7874bb66b4e0456c2/users/c2e94f665e674224b44ee6a3dc26ccdf/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:00.273234 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9253e5-4df9-4e22-ac73-cf076bae72b1 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:00.278430 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:00.285033 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9253e5-4df9-4e22-ac73-cf076bae72b1 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:00.353058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183a80b-c68f-497b-8627-361530e83333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:00.353668 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183a80b-c68f-497b-8627-361530e83333 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:00.354036 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183a80b-c68f-497b-8627-361530e83333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:00.354323 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183a80b-c68f-497b-8627-361530e83333 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:00.355644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6183a80b-c68f-497b-8627-361530e83333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:00.357693 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6183a80b-c68f-497b-8627-361530e83333 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:00.368518 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 955/1876] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:37:00.372573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed50b8-ccce-4fae-b5c9-ce13665fc459 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:00.383433 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed50b8-ccce-4fae-b5c9-ce13665fc459 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:00.388016 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4face16-11f0-47e1-a34b-a81ae51d69ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:00.388932 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4face16-11f0-47e1-a34b-a81ae51d69ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:00.389219 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4face16-11f0-47e1-a34b-a81ae51d69ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:00.389517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4face16-11f0-47e1-a34b-a81ae51d69ea admin admin] PATH_INFO: `/v3/projects/4003041927e944d7874bb66b4e0456c2/users/c2e94f665e674224b44ee6a3dc26ccdf/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:00.391469 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4face16-11f0-47e1-a34b-a81ae51d69ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=4003041927e944d7874bb66b4e0456c2, user_id=c2e94f665e674224b44ee6a3dc26ccdf, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:00.394142 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4face16-11f0-47e1-a34b-a81ae51d69ea admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:00.407010 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 922/1877] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:37:00 2022] PUT /identity/v3/projects/4003041927e944d7874bb66b4e0456c2/users/c2e94f665e674224b44ee6a3dc26ccdf/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:00.418109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8578223-326c-4765-af93-e36a1c744518 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:00.418594 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8578223-326c-4765-af93-e36a1c744518 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:00.418672 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8578223-326c-4765-af93-e36a1c744518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:00.466792 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b8578223-326c-4765-af93-e36a1c744518 None None] MFA Rules not processed for user `c2e94f665e674224b44ee6a3dc26ccdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:00.468376 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b8578223-326c-4765-af93-e36a1c744518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:00.582401 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 956/1878] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:00.594780 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4face16-11f0-47e1-a34b-a81ae51d69ea admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:00.596742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b4face16-11f0-47e1-a34b-a81ae51d69ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:00.668526 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4face16-11f0-47e1-a34b-a81ae51d69ea admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:00.673076 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a796a2-803a-47bf-8683-d6ad4ec2dc59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:00.673736 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a796a2-803a-47bf-8683-d6ad4ec2dc59 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:00.674060 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a796a2-803a-47bf-8683-d6ad4ec2dc59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:00.674487 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a796a2-803a-47bf-8683-d6ad4ec2dc59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:00.687054 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a796a2-803a-47bf-8683-d6ad4ec2dc59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:00.688685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a796a2-803a-47bf-8683-d6ad4ec2dc59 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:00.699940 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 923/1879] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:37:01.267781 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8578223-326c-4765-af93-e36a1c744518 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:01.349473 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8578223-326c-4765-af93-e36a1c744518 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:01.355006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69245bdc-019c-46a2-97eb-861b9f92f737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:01.355869 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69245bdc-019c-46a2-97eb-861b9f92f737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:01.356252 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69245bdc-019c-46a2-97eb-861b9f92f737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:01.356641 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69245bdc-019c-46a2-97eb-861b9f92f737 admin admin] PATH_INFO: `/v3/users/643643d3194a40b2a4d961c8a3371d35` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:01.358545 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69245bdc-019c-46a2-97eb-861b9f92f737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=643643d3194a40b2a4d961c8a3371d35)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:01.360997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69245bdc-019c-46a2-97eb-861b9f92f737 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:01.378867 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a796a2-803a-47bf-8683-d6ad4ec2dc59 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:01.391800 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a796a2-803a-47bf-8683-d6ad4ec2dc59 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:01.401635 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e355a94-c2c1-4baa-ab36-6bc35d8a81aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:01.402304 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e355a94-c2c1-4baa-ab36-6bc35d8a81aa service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:01.402597 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e355a94-c2c1-4baa-ab36-6bc35d8a81aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:01.402880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e355a94-c2c1-4baa-ab36-6bc35d8a81aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:01.407107 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6e355a94-c2c1-4baa-ab36-6bc35d8a81aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:01.418745 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:01.445659 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-69245bdc-019c-46a2-97eb-861b9f92f737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '643643d3194a40b2a4d961c8a3371d35'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:01.454312 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-69245bdc-019c-46a2-97eb-861b9f92f737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '643643d3194a40b2a4d961c8a3371d35'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:01.455048 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-69245bdc-019c-46a2-97eb-861b9f92f737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '643643d3194a40b2a4d961c8a3371d35'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:01.477995 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e355a94-c2c1-4baa-ab36-6bc35d8a81aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:01.478230 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-69245bdc-019c-46a2-97eb-861b9f92f737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '643643d3194a40b2a4d961c8a3371d35'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:01.479738 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e355a94-c2c1-4baa-ab36-6bc35d8a81aa service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:01.486898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-69245bdc-019c-46a2-97eb-861b9f92f737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '643643d3194a40b2a4d961c8a3371d35'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:01.492610 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 924/1880] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:37:01.506968 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 957/1881] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:37:01 2022] DELETE /identity/v3/users/643643d3194a40b2a4d961c8a3371d35 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:01.511933 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b8e37-a572-4847-9a0e-3401b2d3e8b9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:01.512548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b8e37-a572-4847-9a0e-3401b2d3e8b9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:01.513180 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b8e37-a572-4847-9a0e-3401b2d3e8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:01.543392 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d30b8e37-a572-4847-9a0e-3401b2d3e8b9 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:01.545510 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d30b8e37-a572-4847-9a0e-3401b2d3e8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:01.553688 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:01.633368 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 925/1882] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:37:01.645534 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69245bdc-019c-46a2-97eb-861b9f92f737 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:01.647331 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-69245bdc-019c-46a2-97eb-861b9f92f737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:01.723471 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69245bdc-019c-46a2-97eb-861b9f92f737 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:01.728265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787106b4-0c13-4a88-97a5-5285763b6a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:01.728941 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787106b4-0c13-4a88-97a5-5285763b6a00 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:01.729224 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787106b4-0c13-4a88-97a5-5285763b6a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:01.729497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787106b4-0c13-4a88-97a5-5285763b6a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:01.739646 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787106b4-0c13-4a88-97a5-5285763b6a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:01.741822 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787106b4-0c13-4a88-97a5-5285763b6a00 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:01.766850 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 958/1883] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:37:02.191666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b8e37-a572-4847-9a0e-3401b2d3e8b9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:02.193716 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d30b8e37-a572-4847-9a0e-3401b2d3e8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:02.218799 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b8e37-a572-4847-9a0e-3401b2d3e8b9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:02.224352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c280f6-928b-4f1f-80bc-a13409dd3559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:02.226236 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c280f6-928b-4f1f-80bc-a13409dd3559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:02.227361 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c280f6-928b-4f1f-80bc-a13409dd3559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:02.228043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c280f6-928b-4f1f-80bc-a13409dd3559 admin admin] PATH_INFO: `/v3/projects/3146b6e17fff47e4bbe1e9b6f69f7ab7` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:02.229526 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c280f6-928b-4f1f-80bc-a13409dd3559 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3146b6e17fff47e4bbe1e9b6f69f7ab7)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:02.248930 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c280f6-928b-4f1f-80bc-a13409dd3559 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:02.347111 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-28c280f6-928b-4f1f-80bc-a13409dd3559 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3146b6e17fff47e4bbe1e9b6f69f7ab7', 'request_id': 'req-28c280f6-928b-4f1f-80bc-a13409dd3559'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:02.354500 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-28c280f6-928b-4f1f-80bc-a13409dd3559 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3146b6e17fff47e4bbe1e9b6f69f7ab7', 'request_id': 'req-28c280f6-928b-4f1f-80bc-a13409dd3559'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:02.366721 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-28c280f6-928b-4f1f-80bc-a13409dd3559 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3146b6e17fff47e4bbe1e9b6f69f7ab7', 'request_id': 'req-28c280f6-928b-4f1f-80bc-a13409dd3559'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:02.406546 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-28c280f6-928b-4f1f-80bc-a13409dd3559 admin admin] The token cache is being invalidate because project 3146b6e17fff47e4bbe1e9b6f69f7ab7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:37:02.411411 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-28c280f6-928b-4f1f-80bc-a13409dd3559 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:02.414367 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-28c280f6-928b-4f1f-80bc-a13409dd3559 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:02.418731 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 926/1884] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:37:02 2022] DELETE /identity/v3/projects/3146b6e17fff47e4bbe1e9b6f69f7ab7 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:02.424281 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787106b4-0c13-4a88-97a5-5285763b6a00 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:02.444123 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787106b4-0c13-4a88-97a5-5285763b6a00 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:02.569753 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f237001-da28-415c-bebb-c290b626cea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:02.570810 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f237001-da28-415c-bebb-c290b626cea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:02.571241 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f237001-da28-415c-bebb-c290b626cea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:02.571618 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f237001-da28-415c-bebb-c290b626cea2 admin admin] PATH_INFO: `/v3/users/c2e94f665e674224b44ee6a3dc26ccdf` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:02.573354 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f237001-da28-415c-bebb-c290b626cea2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2e94f665e674224b44ee6a3dc26ccdf)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:02.575719 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f237001-da28-415c-bebb-c290b626cea2 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:02.643858 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0f237001-da28-415c-bebb-c290b626cea2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2e94f665e674224b44ee6a3dc26ccdf'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:02.645405 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:02.662855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0f237001-da28-415c-bebb-c290b626cea2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2e94f665e674224b44ee6a3dc26ccdf'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:02.663756 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0f237001-da28-415c-bebb-c290b626cea2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2e94f665e674224b44ee6a3dc26ccdf'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:02.683478 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0f237001-da28-415c-bebb-c290b626cea2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2e94f665e674224b44ee6a3dc26ccdf'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:02.695620 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0f237001-da28-415c-bebb-c290b626cea2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2e94f665e674224b44ee6a3dc26ccdf'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:02.708576 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 959/1885] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:37:02 2022] DELETE /identity/v3/users/c2e94f665e674224b44ee6a3dc26ccdf => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:03.246162 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c280f6-928b-4f1f-80bc-a13409dd3559 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:03.247722 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-28c280f6-928b-4f1f-80bc-a13409dd3559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:03.263034 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c280f6-928b-4f1f-80bc-a13409dd3559 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:03.332212 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b783f-262b-4d93-8d86-e22e89d7f7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:03.333040 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b783f-262b-4d93-8d86-e22e89d7f7da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:03.333329 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b783f-262b-4d93-8d86-e22e89d7f7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:03.333609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b783f-262b-4d93-8d86-e22e89d7f7da admin admin] PATH_INFO: `/v3/projects/4003041927e944d7874bb66b4e0456c2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:03.335384 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b783f-262b-4d93-8d86-e22e89d7f7da admin admin] RBAC: Authorizing `identity:delete_project(project_id=4003041927e944d7874bb66b4e0456c2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:03.337347 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b783f-262b-4d93-8d86-e22e89d7f7da admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:03.383945 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:03.396842 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-547b783f-262b-4d93-8d86-e22e89d7f7da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4003041927e944d7874bb66b4e0456c2', 'request_id': 'req-547b783f-262b-4d93-8d86-e22e89d7f7da'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:03.411456 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-547b783f-262b-4d93-8d86-e22e89d7f7da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4003041927e944d7874bb66b4e0456c2', 'request_id': 'req-547b783f-262b-4d93-8d86-e22e89d7f7da'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:03.426520 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-547b783f-262b-4d93-8d86-e22e89d7f7da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4003041927e944d7874bb66b4e0456c2', 'request_id': 'req-547b783f-262b-4d93-8d86-e22e89d7f7da'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:03.440218 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-547b783f-262b-4d93-8d86-e22e89d7f7da admin admin] The token cache is being invalidate because project 4003041927e944d7874bb66b4e0456c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:37:03.440546 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-547b783f-262b-4d93-8d86-e22e89d7f7da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:03.441196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-547b783f-262b-4d93-8d86-e22e89d7f7da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:03.442762 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 927/1886] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:37:03 2022] DELETE /identity/v3/projects/4003041927e944d7874bb66b4e0456c2 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:03.450113 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad482b7c-9793-43a8-b910-e253c1ae0078 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:03.450664 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad482b7c-9793-43a8-b910-e253c1ae0078 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:03.450797 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad482b7c-9793-43a8-b910-e253c1ae0078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:03.471207 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ad482b7c-9793-43a8-b910-e253c1ae0078 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:03.472666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ad482b7c-9793-43a8-b910-e253c1ae0078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:03.534842 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 960/1887] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:37:03.542444 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b584d-9579-4473-9712-1e9434a2f5ec None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:03.542760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b584d-9579-4473-9712-1e9434a2f5ec None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:03.543054 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b584d-9579-4473-9712-1e9434a2f5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:03.561456 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d29b584d-9579-4473-9712-1e9434a2f5ec None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:03.562629 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d29b584d-9579-4473-9712-1e9434a2f5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:03.571372 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 928/1888] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:03.577953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad482b7c-9793-43a8-b910-e253c1ae0078 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:03.590826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad482b7c-9793-43a8-b910-e253c1ae0078 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:03.595663 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b43584-e8d8-4e3b-b645-0d4cf89ca738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:03.596353 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b43584-e8d8-4e3b-b645-0d4cf89ca738 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:03.596647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b43584-e8d8-4e3b-b645-0d4cf89ca738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:03.596926 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b43584-e8d8-4e3b-b645-0d4cf89ca738 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:03.597667 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b43584-e8d8-4e3b-b645-0d4cf89ca738 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:03.597980 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b43584-e8d8-4e3b-b645-0d4cf89ca738 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:03.599579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b43584-e8d8-4e3b-b645-0d4cf89ca738 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:03.611090 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 961/1889] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:03.615966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b584d-9579-4473-9712-1e9434a2f5ec None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:03.632758 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b584d-9579-4473-9712-1e9434a2f5ec None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:03.637700 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07e1a4-8da1-4807-89e5-5520657c1447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:03.638362 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07e1a4-8da1-4807-89e5-5520657c1447 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:03.638643 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07e1a4-8da1-4807-89e5-5520657c1447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:03.638914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07e1a4-8da1-4807-89e5-5520657c1447 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:03.639680 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07e1a4-8da1-4807-89e5-5520657c1447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:03.641642 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07e1a4-8da1-4807-89e5-5520657c1447 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:03.671760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 929/1890] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:37:03 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:03.675981 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b43584-e8d8-4e3b-b645-0d4cf89ca738 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:03.689620 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b43584-e8d8-4e3b-b645-0d4cf89ca738 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:03.756219 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9766cb-4649-4ad1-902b-bec98cef381f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:03.756949 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9766cb-4649-4ad1-902b-bec98cef381f admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:03.757234 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9766cb-4649-4ad1-902b-bec98cef381f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:03.757507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9766cb-4649-4ad1-902b-bec98cef381f admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:03.758472 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9766cb-4649-4ad1-902b-bec98cef381f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:03.760600 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9766cb-4649-4ad1-902b-bec98cef381f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:03.801418 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 962/1891] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:37:03 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:03.803334 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07e1a4-8da1-4807-89e5-5520657c1447 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:03.814934 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07e1a4-8da1-4807-89e5-5520657c1447 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:03.821135 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4274b9-c9c5-42da-b1a0-2aa5e367260a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:03.821881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4274b9-c9c5-42da-b1a0-2aa5e367260a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:03.822259 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4274b9-c9c5-42da-b1a0-2aa5e367260a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:03.822629 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4274b9-c9c5-42da-b1a0-2aa5e367260a admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:03.823387 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4274b9-c9c5-42da-b1a0-2aa5e367260a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:03.825268 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4274b9-c9c5-42da-b1a0-2aa5e367260a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:03.839064 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 930/1892] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:37:03.843411 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9766cb-4649-4ad1-902b-bec98cef381f admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:03.856690 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9766cb-4649-4ad1-902b-bec98cef381f admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:03.866598 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4b99b-b219-4a5c-b7c9-584388e0395c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:03.867714 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4b99b-b219-4a5c-b7c9-584388e0395c admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:03.867899 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4b99b-b219-4a5c-b7c9-584388e0395c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:03.868292 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4b99b-b219-4a5c-b7c9-584388e0395c admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:03.869082 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4b99b-b219-4a5c-b7c9-584388e0395c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:03.872706 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4b99b-b219-4a5c-b7c9-584388e0395c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:03.894884 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 963/1893] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:37:03.896733 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4274b9-c9c5-42da-b1a0-2aa5e367260a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:03.909697 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4274b9-c9c5-42da-b1a0-2aa5e367260a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:03.915500 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94651e-6b25-411a-9f4f-23defa7bc71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:03.916755 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94651e-6b25-411a-9f4f-23defa7bc71a admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:03.917048 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94651e-6b25-411a-9f4f-23defa7bc71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:03.917358 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94651e-6b25-411a-9f4f-23defa7bc71a admin admin] PATH_INFO: `/v3/projects/78be05e479c647e48109896ef3ad2c5b/users/007e413e66cc4d7da6eb0b38e635154d/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:03.935041 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd94651e-6b25-411a-9f4f-23defa7bc71a admin admin] RBAC: Authorizing `identity:create_grant(project_id=78be05e479c647e48109896ef3ad2c5b, user_id=007e413e66cc4d7da6eb0b38e635154d, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:03.937784 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd94651e-6b25-411a-9f4f-23defa7bc71a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:03.954078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 931/1894] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:37:03 2022] PUT /identity/v3/projects/78be05e479c647e48109896ef3ad2c5b/users/007e413e66cc4d7da6eb0b38e635154d/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:37:03.965109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb5372-6c2d-4f92-b3f2-37a848ac0a12 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:03.965399 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb5372-6c2d-4f92-b3f2-37a848ac0a12 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:03.965682 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb5372-6c2d-4f92-b3f2-37a848ac0a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:03.997423 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-70eb5372-6c2d-4f92-b3f2-37a848ac0a12 None None] MFA Rules not processed for user `007e413e66cc4d7da6eb0b38e635154d`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:03.998946 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-70eb5372-6c2d-4f92-b3f2-37a848ac0a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:04.020038 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:04.084223 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 964/1895] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:04.098769 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94651e-6b25-411a-9f4f-23defa7bc71a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:04.101560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dd94651e-6b25-411a-9f4f-23defa7bc71a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:04.138519 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb5372-6c2d-4f92-b3f2-37a848ac0a12 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:04.139991 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-70eb5372-6c2d-4f92-b3f2-37a848ac0a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:04.170240 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94651e-6b25-411a-9f4f-23defa7bc71a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:04.175107 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1864908-c0fb-4812-b611-44322310caf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:04.175842 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1864908-c0fb-4812-b611-44322310caf7 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:04.176200 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1864908-c0fb-4812-b611-44322310caf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:04.176680 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1864908-c0fb-4812-b611-44322310caf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:04.187008 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1864908-c0fb-4812-b611-44322310caf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:04.188374 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1864908-c0fb-4812-b611-44322310caf7 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:04.198940 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 932/1896] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:37:04.222845 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb5372-6c2d-4f92-b3f2-37a848ac0a12 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:04.229006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9dc3cb-a584-4803-a797-ec2abfa34b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:04.229914 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9dc3cb-a584-4803-a797-ec2abfa34b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:04.230196 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9dc3cb-a584-4803-a797-ec2abfa34b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:04.230472 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9dc3cb-a584-4803-a797-ec2abfa34b92 admin admin] PATH_INFO: `/v3/users/9d7269a9501a4be5a1beba918e75e09a` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:04.231681 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9dc3cb-a584-4803-a797-ec2abfa34b92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d7269a9501a4be5a1beba918e75e09a)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:04.233761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9dc3cb-a584-4803-a797-ec2abfa34b92 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:04.316048 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7c9dc3cb-a584-4803-a797-ec2abfa34b92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d7269a9501a4be5a1beba918e75e09a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:04.326141 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7c9dc3cb-a584-4803-a797-ec2abfa34b92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d7269a9501a4be5a1beba918e75e09a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:04.327510 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7c9dc3cb-a584-4803-a797-ec2abfa34b92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d7269a9501a4be5a1beba918e75e09a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:04.344119 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7c9dc3cb-a584-4803-a797-ec2abfa34b92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d7269a9501a4be5a1beba918e75e09a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:04.354355 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7c9dc3cb-a584-4803-a797-ec2abfa34b92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d7269a9501a4be5a1beba918e75e09a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:04.367521 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 965/1897] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:37:04 2022] DELETE /identity/v3/users/9d7269a9501a4be5a1beba918e75e09a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:04.369861 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7c72a-9e9a-4ec7-b4d4-b5ae9dcc5eba None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:04.370346 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7c72a-9e9a-4ec7-b4d4-b5ae9dcc5eba None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:04.370493 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7c72a-9e9a-4ec7-b4d4-b5ae9dcc5eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:04.388560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a0f7c72a-9e9a-4ec7-b4d4-b5ae9dcc5eba None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:04.389780 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a0f7c72a-9e9a-4ec7-b4d4-b5ae9dcc5eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:04.494886 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 933/1898] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:04.503177 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9dc3cb-a584-4803-a797-ec2abfa34b92 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:04.504676 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7c9dc3cb-a584-4803-a797-ec2abfa34b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:04.562499 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:04.579412 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9dc3cb-a584-4803-a797-ec2abfa34b92 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:04.585419 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcde43-6c3f-4675-9b25-23639e738ca9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:04.586273 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcde43-6c3f-4675-9b25-23639e738ca9 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:04.586782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcde43-6c3f-4675-9b25-23639e738ca9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:04.587333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcde43-6c3f-4675-9b25-23639e738ca9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:04.598443 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcde43-6c3f-4675-9b25-23639e738ca9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:04.601151 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcde43-6c3f-4675-9b25-23639e738ca9 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:04.613682 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 966/1899] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:37:04.993543 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7c72a-9e9a-4ec7-b4d4-b5ae9dcc5eba None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:04.995031 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a0f7c72a-9e9a-4ec7-b4d4-b5ae9dcc5eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:05.004170 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:05.008318 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7c72a-9e9a-4ec7-b4d4-b5ae9dcc5eba None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:05.016834 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916be01d-e89a-4e42-aac0-6a22b3ec2a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:05.020480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916be01d-e89a-4e42-aac0-6a22b3ec2a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:05.024039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916be01d-e89a-4e42-aac0-6a22b3ec2a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:05.024925 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916be01d-e89a-4e42-aac0-6a22b3ec2a46 admin admin] PATH_INFO: `/v3/projects/64e41608d1d5490ab2470061b34fbab1` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:05.028635 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916be01d-e89a-4e42-aac0-6a22b3ec2a46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64e41608d1d5490ab2470061b34fbab1)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:05.032583 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916be01d-e89a-4e42-aac0-6a22b3ec2a46 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:05.105461 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcde43-6c3f-4675-9b25-23639e738ca9 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:05.107032 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-05fcde43-6c3f-4675-9b25-23639e738ca9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:05.112935 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-916be01d-e89a-4e42-aac0-6a22b3ec2a46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64e41608d1d5490ab2470061b34fbab1', 'request_id': 'req-916be01d-e89a-4e42-aac0-6a22b3ec2a46'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:05.119852 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-916be01d-e89a-4e42-aac0-6a22b3ec2a46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64e41608d1d5490ab2470061b34fbab1', 'request_id': 'req-916be01d-e89a-4e42-aac0-6a22b3ec2a46'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:05.125811 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcde43-6c3f-4675-9b25-23639e738ca9 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:05.130483 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-916be01d-e89a-4e42-aac0-6a22b3ec2a46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64e41608d1d5490ab2470061b34fbab1', 'request_id': 'req-916be01d-e89a-4e42-aac0-6a22b3ec2a46'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:05.145247 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-916be01d-e89a-4e42-aac0-6a22b3ec2a46 admin admin] The token cache is being invalidate because project 64e41608d1d5490ab2470061b34fbab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:37:05.145867 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-916be01d-e89a-4e42-aac0-6a22b3ec2a46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:05.147686 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-916be01d-e89a-4e42-aac0-6a22b3ec2a46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:05.150397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 934/1900] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:37:04 2022] DELETE /identity/v3/projects/64e41608d1d5490ab2470061b34fbab1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:05.156408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916be01d-e89a-4e42-aac0-6a22b3ec2a46 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:05.158383 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-916be01d-e89a-4e42-aac0-6a22b3ec2a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:05.208197 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9211a-93bf-4259-a8ed-4cda85e8d273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:05.209753 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9211a-93bf-4259-a8ed-4cda85e8d273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:05.210096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9211a-93bf-4259-a8ed-4cda85e8d273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:05.210334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9211a-93bf-4259-a8ed-4cda85e8d273 admin admin] PATH_INFO: `/v3/users/e75bb5d10f9540658386880801fbbf50` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:05.211799 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9211a-93bf-4259-a8ed-4cda85e8d273 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e75bb5d10f9540658386880801fbbf50)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:05.214297 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9211a-93bf-4259-a8ed-4cda85e8d273 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:05.268151 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916be01d-e89a-4e42-aac0-6a22b3ec2a46 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:05.275960 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf686a86-7a97-44c5-874e-3fc89f6b6e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:05.277729 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf686a86-7a97-44c5-874e-3fc89f6b6e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:05.278289 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf686a86-7a97-44c5-874e-3fc89f6b6e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:05.278904 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf686a86-7a97-44c5-874e-3fc89f6b6e9f admin admin] PATH_INFO: `/v3/users/dbd485e10da24048886c3c3bfe6c7e4c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:05.282075 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf686a86-7a97-44c5-874e-3fc89f6b6e9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbd485e10da24048886c3c3bfe6c7e4c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:05.286426 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf686a86-7a97-44c5-874e-3fc89f6b6e9f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:05.298534 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1bb9211a-93bf-4259-a8ed-4cda85e8d273 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e75bb5d10f9540658386880801fbbf50'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:05.315021 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1bb9211a-93bf-4259-a8ed-4cda85e8d273 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e75bb5d10f9540658386880801fbbf50'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:05.315836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1bb9211a-93bf-4259-a8ed-4cda85e8d273 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e75bb5d10f9540658386880801fbbf50'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:05.344658 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1bb9211a-93bf-4259-a8ed-4cda85e8d273 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e75bb5d10f9540658386880801fbbf50'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:05.360146 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1bb9211a-93bf-4259-a8ed-4cda85e8d273 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e75bb5d10f9540658386880801fbbf50'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:05.375989 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cf686a86-7a97-44c5-874e-3fc89f6b6e9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbd485e10da24048886c3c3bfe6c7e4c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:05.382474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 967/1901] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:37:05 2022] DELETE /identity/v3/users/e75bb5d10f9540658386880801fbbf50 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:37:05.386849 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cf686a86-7a97-44c5-874e-3fc89f6b6e9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbd485e10da24048886c3c3bfe6c7e4c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:05.387606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cf686a86-7a97-44c5-874e-3fc89f6b6e9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbd485e10da24048886c3c3bfe6c7e4c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:05.389012 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a03a85-029f-428e-bc93-7d897c308520 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:05.389857 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a03a85-029f-428e-bc93-7d897c308520 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:05.390341 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a03a85-029f-428e-bc93-7d897c308520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:05.403306 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cf686a86-7a97-44c5-874e-3fc89f6b6e9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbd485e10da24048886c3c3bfe6c7e4c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:05.414683 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-38a03a85-029f-428e-bc93-7d897c308520 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:05.414928 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cf686a86-7a97-44c5-874e-3fc89f6b6e9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbd485e10da24048886c3c3bfe6c7e4c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:05.416715 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-38a03a85-029f-428e-bc93-7d897c308520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:05.425354 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 935/1902] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:37:05 2022] DELETE /identity/v3/users/dbd485e10da24048886c3c3bfe6c7e4c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:05.487470 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 968/1903] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:37:05.517512 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf686a86-7a97-44c5-874e-3fc89f6b6e9f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:05.518906 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cf686a86-7a97-44c5-874e-3fc89f6b6e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:05.532559 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:05.596965 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf686a86-7a97-44c5-874e-3fc89f6b6e9f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:05.601405 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b965d-2109-43ce-9df6-445987428d92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:05.602060 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b965d-2109-43ce-9df6-445987428d92 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:05.602370 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b965d-2109-43ce-9df6-445987428d92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:05.602613 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b965d-2109-43ce-9df6-445987428d92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:05.701218 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b965d-2109-43ce-9df6-445987428d92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:05.702850 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b965d-2109-43ce-9df6-445987428d92 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:05.714665 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 936/1904] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:37:06.155406 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a03a85-029f-428e-bc93-7d897c308520 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:06.157470 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-38a03a85-029f-428e-bc93-7d897c308520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:06.165404 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:06.175705 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a03a85-029f-428e-bc93-7d897c308520 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:06.188333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb382d-280f-4f14-b1a4-ea94c6ce9a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:06.189718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb382d-280f-4f14-b1a4-ea94c6ce9a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:06.190152 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb382d-280f-4f14-b1a4-ea94c6ce9a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:06.190434 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb382d-280f-4f14-b1a4-ea94c6ce9a66 admin admin] PATH_INFO: `/v3/projects/05f37f206de248c6af7e3f9406279374` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:06.191897 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb382d-280f-4f14-b1a4-ea94c6ce9a66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05f37f206de248c6af7e3f9406279374)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:06.194364 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb382d-280f-4f14-b1a4-ea94c6ce9a66 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:06.238152 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b965d-2109-43ce-9df6-445987428d92 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:06.241398 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-723b965d-2109-43ce-9df6-445987428d92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:06.257213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-46eb382d-280f-4f14-b1a4-ea94c6ce9a66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05f37f206de248c6af7e3f9406279374', 'request_id': 'req-46eb382d-280f-4f14-b1a4-ea94c6ce9a66'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:06.267588 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b965d-2109-43ce-9df6-445987428d92 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:06.268618 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-46eb382d-280f-4f14-b1a4-ea94c6ce9a66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05f37f206de248c6af7e3f9406279374', 'request_id': 'req-46eb382d-280f-4f14-b1a4-ea94c6ce9a66'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:06.275765 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-46eb382d-280f-4f14-b1a4-ea94c6ce9a66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05f37f206de248c6af7e3f9406279374', 'request_id': 'req-46eb382d-280f-4f14-b1a4-ea94c6ce9a66'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:06.291156 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-46eb382d-280f-4f14-b1a4-ea94c6ce9a66 admin admin] The token cache is being invalidate because project 05f37f206de248c6af7e3f9406279374 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:37:06.292524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-46eb382d-280f-4f14-b1a4-ea94c6ce9a66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:06.293437 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-46eb382d-280f-4f14-b1a4-ea94c6ce9a66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:06.296141 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 969/1905] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:37:06 2022] DELETE /identity/v3/projects/05f37f206de248c6af7e3f9406279374 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:06.300275 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb382d-280f-4f14-b1a4-ea94c6ce9a66 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:06.301994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-46eb382d-280f-4f14-b1a4-ea94c6ce9a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:06.358149 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7278582-ea96-4e2c-9c51-b89666b1dd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:06.359148 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7278582-ea96-4e2c-9c51-b89666b1dd26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:06.359704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7278582-ea96-4e2c-9c51-b89666b1dd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:06.359704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7278582-ea96-4e2c-9c51-b89666b1dd26 admin admin] PATH_INFO: `/v3/projects/34a1f4057b1e483796ae68e4f464d359` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:06.361281 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7278582-ea96-4e2c-9c51-b89666b1dd26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34a1f4057b1e483796ae68e4f464d359)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:06.363537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7278582-ea96-4e2c-9c51-b89666b1dd26 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:06.385800 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb382d-280f-4f14-b1a4-ea94c6ce9a66 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:06.391178 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf230d4-7851-493a-8d8b-18972baa4d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:06.392248 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf230d4-7851-493a-8d8b-18972baa4d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:06.392592 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf230d4-7851-493a-8d8b-18972baa4d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:06.392874 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf230d4-7851-493a-8d8b-18972baa4d96 admin admin] PATH_INFO: `/v3/users/352f3f613ded458eb9d49978903889fe` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:06.394837 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf230d4-7851-493a-8d8b-18972baa4d96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=352f3f613ded458eb9d49978903889fe)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:06.397891 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf230d4-7851-493a-8d8b-18972baa4d96 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:06.428939 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a7278582-ea96-4e2c-9c51-b89666b1dd26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34a1f4057b1e483796ae68e4f464d359', 'request_id': 'req-a7278582-ea96-4e2c-9c51-b89666b1dd26'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:06.438834 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a7278582-ea96-4e2c-9c51-b89666b1dd26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34a1f4057b1e483796ae68e4f464d359', 'request_id': 'req-a7278582-ea96-4e2c-9c51-b89666b1dd26'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:06.441000 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:06.456905 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a7278582-ea96-4e2c-9c51-b89666b1dd26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34a1f4057b1e483796ae68e4f464d359', 'request_id': 'req-a7278582-ea96-4e2c-9c51-b89666b1dd26'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:06.470323 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1cf230d4-7851-493a-8d8b-18972baa4d96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '352f3f613ded458eb9d49978903889fe'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:06.477610 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a7278582-ea96-4e2c-9c51-b89666b1dd26 admin admin] The token cache is being invalidate because project 34a1f4057b1e483796ae68e4f464d359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:37:06.478282 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a7278582-ea96-4e2c-9c51-b89666b1dd26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:06.480462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1cf230d4-7851-493a-8d8b-18972baa4d96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '352f3f613ded458eb9d49978903889fe'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:06.480604 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a7278582-ea96-4e2c-9c51-b89666b1dd26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:06.481219 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1cf230d4-7851-493a-8d8b-18972baa4d96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '352f3f613ded458eb9d49978903889fe'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:06.482547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 937/1906] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:37:06 2022] DELETE /identity/v3/projects/34a1f4057b1e483796ae68e4f464d359 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:37:06.486526 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7278582-ea96-4e2c-9c51-b89666b1dd26 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:06.489045 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a7278582-ea96-4e2c-9c51-b89666b1dd26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:06.495723 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1cf230d4-7851-493a-8d8b-18972baa4d96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '352f3f613ded458eb9d49978903889fe'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:06.507354 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1cf230d4-7851-493a-8d8b-18972baa4d96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '352f3f613ded458eb9d49978903889fe'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:06.515467 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 970/1907] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:37:06 2022] DELETE /identity/v3/users/352f3f613ded458eb9d49978903889fe => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:06.606619 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7278582-ea96-4e2c-9c51-b89666b1dd26 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:06.691433 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5045f-9816-443d-9649-1e1947078a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:06.693525 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5045f-9816-443d-9649-1e1947078a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:06.694100 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5045f-9816-443d-9649-1e1947078a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:06.694572 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5045f-9816-443d-9649-1e1947078a1b admin admin] PATH_INFO: `/v3/users/11853611356d4c57b5eb25c61fc726d5` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:06.696920 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5045f-9816-443d-9649-1e1947078a1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=11853611356d4c57b5eb25c61fc726d5)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:06.700163 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5045f-9816-443d-9649-1e1947078a1b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:06.767039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-47c5045f-9816-443d-9649-1e1947078a1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11853611356d4c57b5eb25c61fc726d5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:06.776769 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-47c5045f-9816-443d-9649-1e1947078a1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11853611356d4c57b5eb25c61fc726d5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:06.777707 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-47c5045f-9816-443d-9649-1e1947078a1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11853611356d4c57b5eb25c61fc726d5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:06.793158 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-47c5045f-9816-443d-9649-1e1947078a1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11853611356d4c57b5eb25c61fc726d5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:06.806614 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-47c5045f-9816-443d-9649-1e1947078a1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11853611356d4c57b5eb25c61fc726d5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:06.815837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 938/1908] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:37:06 2022] DELETE /identity/v3/users/11853611356d4c57b5eb25c61fc726d5 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:37:06.925530 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf230d4-7851-493a-8d8b-18972baa4d96 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:06.927909 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1cf230d4-7851-493a-8d8b-18972baa4d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:06.945274 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:06.964607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf230d4-7851-493a-8d8b-18972baa4d96 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:07.089075 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d05a9-1204-49fa-95c3-592f7ebb03ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:07.090296 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d05a9-1204-49fa-95c3-592f7ebb03ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:07.090783 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d05a9-1204-49fa-95c3-592f7ebb03ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:07.091237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d05a9-1204-49fa-95c3-592f7ebb03ad admin admin] PATH_INFO: `/v3/projects/7b3bceea62874371a04e2ae8ae4e2936` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:07.092829 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d05a9-1204-49fa-95c3-592f7ebb03ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b3bceea62874371a04e2ae8ae4e2936)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:07.096946 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d05a9-1204-49fa-95c3-592f7ebb03ad admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:07.159091 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-828d05a9-1204-49fa-95c3-592f7ebb03ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b3bceea62874371a04e2ae8ae4e2936', 'request_id': 'req-828d05a9-1204-49fa-95c3-592f7ebb03ad'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:07.169381 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-828d05a9-1204-49fa-95c3-592f7ebb03ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b3bceea62874371a04e2ae8ae4e2936', 'request_id': 'req-828d05a9-1204-49fa-95c3-592f7ebb03ad'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:07.178113 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-828d05a9-1204-49fa-95c3-592f7ebb03ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b3bceea62874371a04e2ae8ae4e2936', 'request_id': 'req-828d05a9-1204-49fa-95c3-592f7ebb03ad'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:07.194410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-828d05a9-1204-49fa-95c3-592f7ebb03ad admin admin] The token cache is being invalidate because project 7b3bceea62874371a04e2ae8ae4e2936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:37:07.194410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-828d05a9-1204-49fa-95c3-592f7ebb03ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:07.195055 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-828d05a9-1204-49fa-95c3-592f7ebb03ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:07.196968 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 971/1909] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:37:06 2022] DELETE /identity/v3/projects/7b3bceea62874371a04e2ae8ae4e2936 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:07.203639 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646387c-b264-4884-8728-622dce2f6c43 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:07.203955 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646387c-b264-4884-8728-622dce2f6c43 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:07.204284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646387c-b264-4884-8728-622dce2f6c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:07.226824 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d646387c-b264-4884-8728-622dce2f6c43 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:07.228261 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d646387c-b264-4884-8728-622dce2f6c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:07.238154 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:07.303046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 939/1910] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:07.313267 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de24f2-e1f1-4616-8b84-7479a14e290e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:07.313395 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de24f2-e1f1-4616-8b84-7479a14e290e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:07.314692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de24f2-e1f1-4616-8b84-7479a14e290e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:07.342455 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-34de24f2-e1f1-4616-8b84-7479a14e290e None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:07.343706 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-34de24f2-e1f1-4616-8b84-7479a14e290e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:07.355536 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 972/1911] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:07.359857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646387c-b264-4884-8728-622dce2f6c43 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:07.378566 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646387c-b264-4884-8728-622dce2f6c43 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:07.385613 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b878c-ef19-4211-891f-0c3db3ca206a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:07.386687 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b878c-ef19-4211-891f-0c3db3ca206a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:07.387157 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b878c-ef19-4211-891f-0c3db3ca206a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:07.387578 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b878c-ef19-4211-891f-0c3db3ca206a admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:07.388492 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b878c-ef19-4211-891f-0c3db3ca206a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:07.388965 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b878c-ef19-4211-891f-0c3db3ca206a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:07.390749 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b878c-ef19-4211-891f-0c3db3ca206a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:07.410819 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 940/1912] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:07.411582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de24f2-e1f1-4616-8b84-7479a14e290e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:07.447255 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de24f2-e1f1-4616-8b84-7479a14e290e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:07.462998 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75afa62-9bbd-45f0-8001-72eb3cc5b8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:07.463937 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75afa62-9bbd-45f0-8001-72eb3cc5b8e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:07.464285 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75afa62-9bbd-45f0-8001-72eb3cc5b8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:07.464662 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75afa62-9bbd-45f0-8001-72eb3cc5b8e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:07.465435 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75afa62-9bbd-45f0-8001-72eb3cc5b8e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:07.467428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75afa62-9bbd-45f0-8001-72eb3cc5b8e0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:07.491349 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b878c-ef19-4211-891f-0c3db3ca206a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:07.493716 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-458b878c-ef19-4211-891f-0c3db3ca206a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:07.502476 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 973/1913] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:37:07 2022] POST /identity/v3/projects => generated 371 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:07.506379 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75afa62-9bbd-45f0-8001-72eb3cc5b8e0 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:07.513154 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b878c-ef19-4211-891f-0c3db3ca206a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:07.586752 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155e27d-792a-42e1-89fe-f733d6c16be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:07.587571 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75afa62-9bbd-45f0-8001-72eb3cc5b8e0 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:07.588266 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155e27d-792a-42e1-89fe-f733d6c16be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:07.588844 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155e27d-792a-42e1-89fe-f733d6c16be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:07.589306 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155e27d-792a-42e1-89fe-f733d6c16be3 admin admin] PATH_INFO: `/v3/projects/bfe7e34c2aa149f58c80d5f264a03e8e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:07.591573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155e27d-792a-42e1-89fe-f733d6c16be3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfe7e34c2aa149f58c80d5f264a03e8e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:07.594211 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aaa907-aac4-40f9-856e-f0f68e16b9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:07.594551 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155e27d-792a-42e1-89fe-f733d6c16be3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:07.595075 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaa907-aac4-40f9-856e-f0f68e16b9fc admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:07.595390 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaa907-aac4-40f9-856e-f0f68e16b9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:07.595665 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaa907-aac4-40f9-856e-f0f68e16b9fc admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:07.596448 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aaa907-aac4-40f9-856e-f0f68e16b9fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:07.600050 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aaa907-aac4-40f9-856e-f0f68e16b9fc admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:07.614007 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:07.639313 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 974/1914] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:37:07 2022] POST /identity/v3/users => generated 286 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:07.643029 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aaa907-aac4-40f9-856e-f0f68e16b9fc admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:07.653169 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aaa907-aac4-40f9-856e-f0f68e16b9fc admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:07.663444 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b155e27d-792a-42e1-89fe-f733d6c16be3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfe7e34c2aa149f58c80d5f264a03e8e', 'request_id': 'req-b155e27d-792a-42e1-89fe-f733d6c16be3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:07.670012 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b155e27d-792a-42e1-89fe-f733d6c16be3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfe7e34c2aa149f58c80d5f264a03e8e', 'request_id': 'req-b155e27d-792a-42e1-89fe-f733d6c16be3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:07.679436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b155e27d-792a-42e1-89fe-f733d6c16be3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfe7e34c2aa149f58c80d5f264a03e8e', 'request_id': 'req-b155e27d-792a-42e1-89fe-f733d6c16be3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:07.694874 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b155e27d-792a-42e1-89fe-f733d6c16be3 admin admin] The token cache is being invalidate because project bfe7e34c2aa149f58c80d5f264a03e8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:37:07.694874 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b155e27d-792a-42e1-89fe-f733d6c16be3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:07.696210 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b155e27d-792a-42e1-89fe-f733d6c16be3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:07.698637 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 941/1915] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:37:07 2022] DELETE /identity/v3/projects/bfe7e34c2aa149f58c80d5f264a03e8e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:07.704125 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebae720-f438-44a5-a109-783eaef67096 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:07.704645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebae720-f438-44a5-a109-783eaef67096 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:07.704934 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebae720-f438-44a5-a109-783eaef67096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:07.727478 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9ebae720-f438-44a5-a109-783eaef67096 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:07.728872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9ebae720-f438-44a5-a109-783eaef67096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:07.738523 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925ebf7-0af0-4087-a2c1-4850925e0128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:07.739448 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925ebf7-0af0-4087-a2c1-4850925e0128 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:07.740571 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925ebf7-0af0-4087-a2c1-4850925e0128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:07.741057 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925ebf7-0af0-4087-a2c1-4850925e0128 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:07.741980 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925ebf7-0af0-4087-a2c1-4850925e0128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:07.743817 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925ebf7-0af0-4087-a2c1-4850925e0128 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:07.757534 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:07.761465 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 975/1916] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:37:07.762779 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925ebf7-0af0-4087-a2c1-4850925e0128 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:07.765342 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a925ebf7-0af0-4087-a2c1-4850925e0128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:07.779002 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925ebf7-0af0-4087-a2c1-4850925e0128 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:07.784443 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477863de-7ec4-408e-9e9b-23f133afdb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:07.785349 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477863de-7ec4-408e-9e9b-23f133afdb6c admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:07.785689 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477863de-7ec4-408e-9e9b-23f133afdb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:07.785972 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477863de-7ec4-408e-9e9b-23f133afdb6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:07.787486 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477863de-7ec4-408e-9e9b-23f133afdb6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:07.789528 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477863de-7ec4-408e-9e9b-23f133afdb6c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:07.803269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 942/1917] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:37:07.811198 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700cf67-6246-461d-b307-b47f3b410429 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:07.811498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700cf67-6246-461d-b307-b47f3b410429 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:07.811777 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700cf67-6246-461d-b307-b47f3b410429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:07.820243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 976/1918] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:37:07.821341 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477863de-7ec4-408e-9e9b-23f133afdb6c admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:07.831255 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477863de-7ec4-408e-9e9b-23f133afdb6c admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:07.832377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8700cf67-6246-461d-b307-b47f3b410429 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:07.834253 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8700cf67-6246-461d-b307-b47f3b410429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:07.836620 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b576b9-431f-4b96-a05f-d67f7cb2e945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:07.837578 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b576b9-431f-4b96-a05f-d67f7cb2e945 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:07.837801 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b576b9-431f-4b96-a05f-d67f7cb2e945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:07.838079 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b576b9-431f-4b96-a05f-d67f7cb2e945 admin admin] PATH_INFO: `/v3/projects/c7f032eaa15049dc9ec191f3342d2393/users/a6d1c4d2c1b349d499b1e114a343a063/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:07.842944 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 943/1919] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:37:07.846762 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700cf67-6246-461d-b307-b47f3b410429 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:07.856803 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700cf67-6246-461d-b307-b47f3b410429 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:07.862165 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d73f7-df2b-4852-9ad1-216a25f46c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:07.862316 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b576b9-431f-4b96-a05f-d67f7cb2e945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7f032eaa15049dc9ec191f3342d2393, user_id=a6d1c4d2c1b349d499b1e114a343a063, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:07.862834 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d73f7-df2b-4852-9ad1-216a25f46c90 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:07.863119 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d73f7-df2b-4852-9ad1-216a25f46c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:07.863398 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d73f7-df2b-4852-9ad1-216a25f46c90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:07.864234 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d73f7-df2b-4852-9ad1-216a25f46c90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:07.864611 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d73f7-df2b-4852-9ad1-216a25f46c90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:07.867124 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d73f7-df2b-4852-9ad1-216a25f46c90 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:07.868846 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b576b9-431f-4b96-a05f-d67f7cb2e945 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:07.883715 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 944/1920] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:07.886208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 977/1921] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:37:07 2022] PUT /identity/v3/projects/c7f032eaa15049dc9ec191f3342d2393/users/a6d1c4d2c1b349d499b1e114a343a063/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:07.888039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d73f7-df2b-4852-9ad1-216a25f46c90 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:07.899025 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d73f7-df2b-4852-9ad1-216a25f46c90 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:07.899760 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c7f45-04f0-4221-b8de-668b26ac1603 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:07.900410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c7f45-04f0-4221-b8de-668b26ac1603 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:07.900769 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c7f45-04f0-4221-b8de-668b26ac1603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:07.929396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-172c7f45-04f0-4221-b8de-668b26ac1603 None None] MFA Rules not processed for user `a6d1c4d2c1b349d499b1e114a343a063`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:07.930723 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-172c7f45-04f0-4221-b8de-668b26ac1603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:07.970361 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3093e-d811-44cc-9a32-a7206252bc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:07.971036 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3093e-d811-44cc-9a32-a7206252bc2e admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:07.971322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3093e-d811-44cc-9a32-a7206252bc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:07.971600 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3093e-d811-44cc-9a32-a7206252bc2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:07.972897 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3093e-d811-44cc-9a32-a7206252bc2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:07.975668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3093e-d811-44cc-9a32-a7206252bc2e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:08.002485 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 978/1922] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:08.014551 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c7f45-04f0-4221-b8de-668b26ac1603 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:08.017104 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-172c7f45-04f0-4221-b8de-668b26ac1603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:08.018501 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 945/1923] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:37:07 2022] POST /identity/v3/projects => generated 387 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:08.022235 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3093e-d811-44cc-9a32-a7206252bc2e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:08.085515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:08.095240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c7f45-04f0-4221-b8de-668b26ac1603 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:08.105663 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3093e-d811-44cc-9a32-a7206252bc2e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:08.111294 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c630a-c679-4f44-b284-1ac0d7481135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:08.111804 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c630a-c679-4f44-b284-1ac0d7481135 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:08.112096 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c630a-c679-4f44-b284-1ac0d7481135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:08.112422 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c630a-c679-4f44-b284-1ac0d7481135 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:08.113139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c630a-c679-4f44-b284-1ac0d7481135 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:08.115807 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c630a-c679-4f44-b284-1ac0d7481135 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:08.156545 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 946/1924] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:37:08 2022] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:08.158934 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c630a-c679-4f44-b284-1ac0d7481135 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:08.164964 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409ccba-61e7-40fe-8946-7da9ac8e716d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e239e4e9b99433ca9d1a8db45e24b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:08.166442 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409ccba-61e7-40fe-8946-7da9ac8e716d service glance] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:08.166714 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409ccba-61e7-40fe-8946-7da9ac8e716d service glance] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:08.167421 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409ccba-61e7-40fe-8946-7da9ac8e716d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:08.169432 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c630a-c679-4f44-b284-1ac0d7481135 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:08.175876 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4de60c-65f9-43ff-a498-3bd30e866e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:08.176746 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4de60c-65f9-43ff-a498-3bd30e866e2f admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:08.176959 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4de60c-65f9-43ff-a498-3bd30e866e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:08.177743 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4de60c-65f9-43ff-a498-3bd30e866e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:08.178508 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4de60c-65f9-43ff-a498-3bd30e866e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:08.180122 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4de60c-65f9-43ff-a498-3bd30e866e2f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:08.191406 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 947/1925] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:37:08.195248 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4de60c-65f9-43ff-a498-3bd30e866e2f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:08.205798 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4de60c-65f9-43ff-a498-3bd30e866e2f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:08.211746 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8d25c-f010-49fa-bb55-501fb00ef656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:08.212760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8d25c-f010-49fa-bb55-501fb00ef656 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:08.212760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8d25c-f010-49fa-bb55-501fb00ef656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:08.213538 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8d25c-f010-49fa-bb55-501fb00ef656 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:08.214291 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8d25c-f010-49fa-bb55-501fb00ef656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:08.217272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8d25c-f010-49fa-bb55-501fb00ef656 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:08.232384 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 948/1926] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:37:08.235050 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8d25c-f010-49fa-bb55-501fb00ef656 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:08.239087 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409ccba-61e7-40fe-8946-7da9ac8e716d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:08.241349 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409ccba-61e7-40fe-8946-7da9ac8e716d service glance] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:08.246271 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:08.251193 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8d25c-f010-49fa-bb55-501fb00ef656 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:08.251330 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 979/1927] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:37:08.256984 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69c250-ed4b-496d-a769-85a6b0eced9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:08.258100 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69c250-ed4b-496d-a769-85a6b0eced9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:08.258392 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69c250-ed4b-496d-a769-85a6b0eced9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:08.258673 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69c250-ed4b-496d-a769-85a6b0eced9e admin admin] PATH_INFO: `/v3/projects/45e79d0e518b492b9f374872e98b17c7/users/462a4288391843babc8f4d4390addbf6/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:08.274794 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69c250-ed4b-496d-a769-85a6b0eced9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=45e79d0e518b492b9f374872e98b17c7, user_id=462a4288391843babc8f4d4390addbf6, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:08.277778 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69c250-ed4b-496d-a769-85a6b0eced9e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:08.303279 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 949/1928] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:37:08 2022] PUT /identity/v3/projects/45e79d0e518b492b9f374872e98b17c7/users/462a4288391843babc8f4d4390addbf6/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:37:08.304708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbced4-7120-453d-97fa-437935f61221 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:08.305046 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbced4-7120-453d-97fa-437935f61221 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:08.305335 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbced4-7120-453d-97fa-437935f61221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:08.336372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a3cbced4-7120-453d-97fa-437935f61221 None None] MFA Rules not processed for user `462a4288391843babc8f4d4390addbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:08.338073 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a3cbced4-7120-453d-97fa-437935f61221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:08.420508 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 980/1929] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:37:08.424649 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69c250-ed4b-496d-a769-85a6b0eced9e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:08.517529 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69c250-ed4b-496d-a769-85a6b0eced9e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:08.523777 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fcf87-581a-49f4-9ebb-fecbca0cef6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:08.524717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fcf87-581a-49f4-9ebb-fecbca0cef6c admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:08.525390 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fcf87-581a-49f4-9ebb-fecbca0cef6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:08.525886 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fcf87-581a-49f4-9ebb-fecbca0cef6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:08.526772 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91fcf87-581a-49f4-9ebb-fecbca0cef6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:08.529284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91fcf87-581a-49f4-9ebb-fecbca0cef6c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:08.567122 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 950/1930] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:37:08 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:08.571416 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cbced4-7120-453d-97fa-437935f61221 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:08.587063 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cbced4-7120-453d-97fa-437935f61221 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:08.642627 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:08.659788 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d13b8d-7081-4634-bb72-2e07681e4eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:08.661036 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d13b8d-7081-4634-bb72-2e07681e4eeb admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:08.661702 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d13b8d-7081-4634-bb72-2e07681e4eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:08.662602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d13b8d-7081-4634-bb72-2e07681e4eeb admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:08.663658 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d13b8d-7081-4634-bb72-2e07681e4eeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:08.666058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d13b8d-7081-4634-bb72-2e07681e4eeb admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:08.692401 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 981/1931] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:37:08 2022] POST /identity/v3/users => generated 299 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:08.696945 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fcf87-581a-49f4-9ebb-fecbca0cef6c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:08.716198 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fcf87-581a-49f4-9ebb-fecbca0cef6c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:08.722641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533cf31-0e10-4c52-838e-dc059abdd348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:08.723168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533cf31-0e10-4c52-838e-dc059abdd348 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:08.723465 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533cf31-0e10-4c52-838e-dc059abdd348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:08.723749 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533cf31-0e10-4c52-838e-dc059abdd348 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:08.725128 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533cf31-0e10-4c52-838e-dc059abdd348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:08.726742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533cf31-0e10-4c52-838e-dc059abdd348 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:08.738741 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 951/1932] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:37:08.744501 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d13b8d-7081-4634-bb72-2e07681e4eeb admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:08.755645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d13b8d-7081-4634-bb72-2e07681e4eeb admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:08.760544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ea5bd-9dc2-4f48-b9a0-d552c1f793b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:08.761576 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ea5bd-9dc2-4f48-b9a0-d552c1f793b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:08.761867 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ea5bd-9dc2-4f48-b9a0-d552c1f793b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:08.762146 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ea5bd-9dc2-4f48-b9a0-d552c1f793b5 admin admin] PATH_INFO: `/v3/projects/82021c0d38ac4306887b2b947152ee08/users/428744939fa14189a0af44262fdf151a/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:08.779233 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ea5bd-9dc2-4f48-b9a0-d552c1f793b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82021c0d38ac4306887b2b947152ee08, user_id=428744939fa14189a0af44262fdf151a, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:08.782287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ea5bd-9dc2-4f48-b9a0-d552c1f793b5 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:08.799281 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 982/1933] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:37:08 2022] PUT /identity/v3/projects/82021c0d38ac4306887b2b947152ee08/users/428744939fa14189a0af44262fdf151a/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:08.804811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533cf31-0e10-4c52-838e-dc059abdd348 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:08.823333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533cf31-0e10-4c52-838e-dc059abdd348 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:08.905814 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2328690-1718-4f6c-abe1-3adf45725fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:08.906496 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2328690-1718-4f6c-abe1-3adf45725fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:08.906799 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2328690-1718-4f6c-abe1-3adf45725fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:08.907071 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2328690-1718-4f6c-abe1-3adf45725fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:08.907804 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2328690-1718-4f6c-abe1-3adf45725fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:08.909457 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2328690-1718-4f6c-abe1-3adf45725fe0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:08.921086 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 952/1934] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:37:08.925456 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ea5bd-9dc2-4f48-b9a0-d552c1f793b5 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:08.935501 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ea5bd-9dc2-4f48-b9a0-d552c1f793b5 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:08.940107 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d733ad6-7477-40af-b69a-eeb7549c24bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:08.941012 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d733ad6-7477-40af-b69a-eeb7549c24bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:08.941294 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d733ad6-7477-40af-b69a-eeb7549c24bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:08.941577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d733ad6-7477-40af-b69a-eeb7549c24bd admin admin] PATH_INFO: `/v3/projects/82021c0d38ac4306887b2b947152ee08/users/428744939fa14189a0af44262fdf151a/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:08.943544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d733ad6-7477-40af-b69a-eeb7549c24bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=82021c0d38ac4306887b2b947152ee08, user_id=428744939fa14189a0af44262fdf151a, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:08.946200 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d733ad6-7477-40af-b69a-eeb7549c24bd admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:08.957490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 983/1935] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:37:08 2022] PUT /identity/v3/projects/82021c0d38ac4306887b2b947152ee08/users/428744939fa14189a0af44262fdf151a/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:08.968214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d8f43-b82f-4e22-ae63-3c9c55021939 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:08.968544 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d8f43-b82f-4e22-ae63-3c9c55021939 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:08.968832 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d8f43-b82f-4e22-ae63-3c9c55021939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:08.996642 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-741d8f43-b82f-4e22-ae63-3c9c55021939 None None] MFA Rules not processed for user `428744939fa14189a0af44262fdf151a`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:08.997851 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-741d8f43-b82f-4e22-ae63-3c9c55021939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:09.039315 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:09.072926 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 953/1936] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:09.085046 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d733ad6-7477-40af-b69a-eeb7549c24bd admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:09.086847 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3d733ad6-7477-40af-b69a-eeb7549c24bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:09.147687 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d733ad6-7477-40af-b69a-eeb7549c24bd admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:09.151215 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0d59d-5711-427e-a4a1-06cf41d51311 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:09.151853 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0d59d-5711-427e-a4a1-06cf41d51311 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:09.152136 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0d59d-5711-427e-a4a1-06cf41d51311 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:09.152446 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0d59d-5711-427e-a4a1-06cf41d51311 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:09.161873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0d59d-5711-427e-a4a1-06cf41d51311 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:09.163305 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0d59d-5711-427e-a4a1-06cf41d51311 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:09.176889 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 984/1937] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:37:09.321447 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d8f43-b82f-4e22-ae63-3c9c55021939 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:09.410081 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d8f43-b82f-4e22-ae63-3c9c55021939 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:09.414734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133b14d-aaaf-43fd-a6bc-e4513e70a885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:09.415612 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133b14d-aaaf-43fd-a6bc-e4513e70a885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:09.416017 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133b14d-aaaf-43fd-a6bc-e4513e70a885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:09.416797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133b14d-aaaf-43fd-a6bc-e4513e70a885 admin admin] PATH_INFO: `/v3/users/462a4288391843babc8f4d4390addbf6` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:09.417715 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133b14d-aaaf-43fd-a6bc-e4513e70a885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=462a4288391843babc8f4d4390addbf6)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:09.419646 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133b14d-aaaf-43fd-a6bc-e4513e70a885 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:09.472627 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3133b14d-aaaf-43fd-a6bc-e4513e70a885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '462a4288391843babc8f4d4390addbf6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:09.480327 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3133b14d-aaaf-43fd-a6bc-e4513e70a885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '462a4288391843babc8f4d4390addbf6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:09.481055 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3133b14d-aaaf-43fd-a6bc-e4513e70a885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '462a4288391843babc8f4d4390addbf6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:09.496822 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3133b14d-aaaf-43fd-a6bc-e4513e70a885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '462a4288391843babc8f4d4390addbf6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:09.504402 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3133b14d-aaaf-43fd-a6bc-e4513e70a885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '462a4288391843babc8f4d4390addbf6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:09.511650 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 954/1938] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:37:09 2022] DELETE /identity/v3/users/462a4288391843babc8f4d4390addbf6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:09.516229 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abb865-4875-49a0-b70b-594d3f0431ac None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:09.516607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abb865-4875-49a0-b70b-594d3f0431ac None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:09.516899 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abb865-4875-49a0-b70b-594d3f0431ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:09.536116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a9abb865-4875-49a0-b70b-594d3f0431ac None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:09.537486 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a9abb865-4875-49a0-b70b-594d3f0431ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:09.605804 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 985/1939] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:09.616408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133b14d-aaaf-43fd-a6bc-e4513e70a885 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:09.618438 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3133b14d-aaaf-43fd-a6bc-e4513e70a885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:09.685717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133b14d-aaaf-43fd-a6bc-e4513e70a885 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:09.690283 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5920bb-7fc8-4e76-93aa-d555093972cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:09.691150 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5920bb-7fc8-4e76-93aa-d555093972cc service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:09.691449 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5920bb-7fc8-4e76-93aa-d555093972cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:09.691816 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5920bb-7fc8-4e76-93aa-d555093972cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:09.704472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5920bb-7fc8-4e76-93aa-d555093972cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:09.706208 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5920bb-7fc8-4e76-93aa-d555093972cc service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:09.711023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:09.718775 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 955/1940] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:37:10.386743 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abb865-4875-49a0-b70b-594d3f0431ac None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:10.388413 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a9abb865-4875-49a0-b70b-594d3f0431ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:10.403794 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abb865-4875-49a0-b70b-594d3f0431ac None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:10.409782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92169eac-0c7d-4dfb-922e-d8013e946622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:10.410737 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92169eac-0c7d-4dfb-922e-d8013e946622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:10.411267 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92169eac-0c7d-4dfb-922e-d8013e946622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:10.411267 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92169eac-0c7d-4dfb-922e-d8013e946622 admin admin] PATH_INFO: `/v3/projects/45e79d0e518b492b9f374872e98b17c7` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:10.413670 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92169eac-0c7d-4dfb-922e-d8013e946622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45e79d0e518b492b9f374872e98b17c7)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:10.415224 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92169eac-0c7d-4dfb-922e-d8013e946622 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:10.471088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:10.484571 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-92169eac-0c7d-4dfb-922e-d8013e946622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45e79d0e518b492b9f374872e98b17c7', 'request_id': 'req-92169eac-0c7d-4dfb-922e-d8013e946622'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:10.492803 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-92169eac-0c7d-4dfb-922e-d8013e946622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45e79d0e518b492b9f374872e98b17c7', 'request_id': 'req-92169eac-0c7d-4dfb-922e-d8013e946622'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:10.498477 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-92169eac-0c7d-4dfb-922e-d8013e946622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45e79d0e518b492b9f374872e98b17c7', 'request_id': 'req-92169eac-0c7d-4dfb-922e-d8013e946622'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:10.510040 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-92169eac-0c7d-4dfb-922e-d8013e946622 admin admin] The token cache is being invalidate because project 45e79d0e518b492b9f374872e98b17c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:37:10.510450 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-92169eac-0c7d-4dfb-922e-d8013e946622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:10.511092 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-92169eac-0c7d-4dfb-922e-d8013e946622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:10.512689 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 986/1941] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:37:10 2022] DELETE /identity/v3/projects/45e79d0e518b492b9f374872e98b17c7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:10.516722 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5920bb-7fc8-4e76-93aa-d555093972cc service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:10.527134 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5920bb-7fc8-4e76-93aa-d555093972cc service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:10.592586 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cab5d8-2d20-418b-9c14-5c24f647e390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:10.593552 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cab5d8-2d20-418b-9c14-5c24f647e390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:10.593894 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cab5d8-2d20-418b-9c14-5c24f647e390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:10.594181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cab5d8-2d20-418b-9c14-5c24f647e390 admin admin] PATH_INFO: `/v3/users/428744939fa14189a0af44262fdf151a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:10.595368 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cab5d8-2d20-418b-9c14-5c24f647e390 admin admin] RBAC: Authorizing `identity:delete_user(user_id=428744939fa14189a0af44262fdf151a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:10.597521 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cab5d8-2d20-418b-9c14-5c24f647e390 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:10.650345 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a1cab5d8-2d20-418b-9c14-5c24f647e390 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '428744939fa14189a0af44262fdf151a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:10.659920 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a1cab5d8-2d20-418b-9c14-5c24f647e390 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '428744939fa14189a0af44262fdf151a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:10.661187 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a1cab5d8-2d20-418b-9c14-5c24f647e390 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '428744939fa14189a0af44262fdf151a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:10.676970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a1cab5d8-2d20-418b-9c14-5c24f647e390 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '428744939fa14189a0af44262fdf151a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:10.688897 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a1cab5d8-2d20-418b-9c14-5c24f647e390 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '428744939fa14189a0af44262fdf151a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:10.699313 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 956/1942] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:37:10 2022] DELETE /identity/v3/users/428744939fa14189a0af44262fdf151a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:10.971545 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92169eac-0c7d-4dfb-922e-d8013e946622 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:10.973185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-92169eac-0c7d-4dfb-922e-d8013e946622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:10.995189 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92169eac-0c7d-4dfb-922e-d8013e946622 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:11.121121 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e7aa1-647a-45f3-b219-eeac0ad26f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:11.122020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e7aa1-647a-45f3-b219-eeac0ad26f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:11.122307 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e7aa1-647a-45f3-b219-eeac0ad26f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:11.122588 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e7aa1-647a-45f3-b219-eeac0ad26f6f admin admin] PATH_INFO: `/v3/projects/82021c0d38ac4306887b2b947152ee08` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:11.123826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e7aa1-647a-45f3-b219-eeac0ad26f6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=82021c0d38ac4306887b2b947152ee08)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:11.125787 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e7aa1-647a-45f3-b219-eeac0ad26f6f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:11.173151 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-cf6e7aa1-647a-45f3-b219-eeac0ad26f6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82021c0d38ac4306887b2b947152ee08', 'request_id': 'req-cf6e7aa1-647a-45f3-b219-eeac0ad26f6f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:11.181746 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-cf6e7aa1-647a-45f3-b219-eeac0ad26f6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82021c0d38ac4306887b2b947152ee08', 'request_id': 'req-cf6e7aa1-647a-45f3-b219-eeac0ad26f6f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:11.187857 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-cf6e7aa1-647a-45f3-b219-eeac0ad26f6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82021c0d38ac4306887b2b947152ee08', 'request_id': 'req-cf6e7aa1-647a-45f3-b219-eeac0ad26f6f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:11.200190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-cf6e7aa1-647a-45f3-b219-eeac0ad26f6f admin admin] The token cache is being invalidate because project 82021c0d38ac4306887b2b947152ee08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:37:11.200516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-cf6e7aa1-647a-45f3-b219-eeac0ad26f6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:11.201253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-cf6e7aa1-647a-45f3-b219-eeac0ad26f6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:11.203382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 987/1943] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:37:10 2022] DELETE /identity/v3/projects/82021c0d38ac4306887b2b947152ee08 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:11.208576 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a6295-728d-4524-b567-92c5a8aaa3b6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:11.208931 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a6295-728d-4524-b567-92c5a8aaa3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:11.209221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a6295-728d-4524-b567-92c5a8aaa3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:11.227305 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8d2a6295-728d-4524-b567-92c5a8aaa3b6 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:11.228644 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8d2a6295-728d-4524-b567-92c5a8aaa3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:11.303071 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 957/1944] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:11.312012 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51dce3b-ba84-478a-9cd8-1e47f1bfaa5d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:11.312331 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51dce3b-ba84-478a-9cd8-1e47f1bfaa5d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:11.313093 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51dce3b-ba84-478a-9cd8-1e47f1bfaa5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:11.331717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f51dce3b-ba84-478a-9cd8-1e47f1bfaa5d None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:11.332941 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f51dce3b-ba84-478a-9cd8-1e47f1bfaa5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:11.340902 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 988/1945] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:11.345172 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a6295-728d-4524-b567-92c5a8aaa3b6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:11.357922 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a6295-728d-4524-b567-92c5a8aaa3b6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:11.362999 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018c747-2b41-45d0-b613-f53e060c7bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:11.363677 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018c747-2b41-45d0-b613-f53e060c7bbd admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:11.363965 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018c747-2b41-45d0-b613-f53e060c7bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:11.364246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018c747-2b41-45d0-b613-f53e060c7bbd admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:11.365642 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018c747-2b41-45d0-b613-f53e060c7bbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:11.365955 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018c747-2b41-45d0-b613-f53e060c7bbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:11.367574 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018c747-2b41-45d0-b613-f53e060c7bbd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:11.379893 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 958/1946] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:11.384396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51dce3b-ba84-478a-9cd8-1e47f1bfaa5d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:11.393469 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51dce3b-ba84-478a-9cd8-1e47f1bfaa5d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:11.398161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6bedc-68a6-4035-9a58-1c6be5c6c5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:11.398810 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6bedc-68a6-4035-9a58-1c6be5c6c5e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:11.399095 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6bedc-68a6-4035-9a58-1c6be5c6c5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:11.399375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6bedc-68a6-4035-9a58-1c6be5c6c5e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:11.400067 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be6bedc-68a6-4035-9a58-1c6be5c6c5e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:11.402007 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be6bedc-68a6-4035-9a58-1c6be5c6c5e6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:11.427080 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 989/1947] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:37:11 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:11.432532 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018c747-2b41-45d0-b613-f53e060c7bbd admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:11.442345 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:11.448505 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018c747-2b41-45d0-b613-f53e060c7bbd admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:11.531355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e4686-856a-4886-9bd9-5310b67b50e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:11.532033 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e4686-856a-4886-9bd9-5310b67b50e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:11.532338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e4686-856a-4886-9bd9-5310b67b50e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:11.532630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e4686-856a-4886-9bd9-5310b67b50e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:11.533320 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e4686-856a-4886-9bd9-5310b67b50e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:11.535246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e4686-856a-4886-9bd9-5310b67b50e8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:11.555837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 959/1948] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:37:11 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:11.561259 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6bedc-68a6-4035-9a58-1c6be5c6c5e6 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:11.572058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6bedc-68a6-4035-9a58-1c6be5c6c5e6 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:11.576841 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd7682-aad6-4515-8284-cbbe8b1e5fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:11.577502 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd7682-aad6-4515-8284-cbbe8b1e5fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:11.577789 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd7682-aad6-4515-8284-cbbe8b1e5fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:11.578067 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd7682-aad6-4515-8284-cbbe8b1e5fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:11.578801 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd7682-aad6-4515-8284-cbbe8b1e5fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:11.580753 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd7682-aad6-4515-8284-cbbe8b1e5fe9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:11.591813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 990/1949] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:37:11.595783 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e4686-856a-4886-9bd9-5310b67b50e8 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:11.605814 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e4686-856a-4886-9bd9-5310b67b50e8 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:11.610440 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47494cd2-17df-4970-9a4f-e31d18800c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:11.611090 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47494cd2-17df-4970-9a4f-e31d18800c1c admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:11.611376 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47494cd2-17df-4970-9a4f-e31d18800c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:11.611659 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47494cd2-17df-4970-9a4f-e31d18800c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:11.612414 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47494cd2-17df-4970-9a4f-e31d18800c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:11.614011 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47494cd2-17df-4970-9a4f-e31d18800c1c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:11.624896 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 960/1950] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:37:11.628782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd7682-aad6-4515-8284-cbbe8b1e5fe9 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:11.639242 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd7682-aad6-4515-8284-cbbe8b1e5fe9 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:11.643873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5616c-7f02-4676-bd37-e258a1ec9657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:11.644795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5616c-7f02-4676-bd37-e258a1ec9657 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:11.645088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5616c-7f02-4676-bd37-e258a1ec9657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:11.645368 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5616c-7f02-4676-bd37-e258a1ec9657 admin admin] PATH_INFO: `/v3/projects/2fb396640bc847fdbee6c3ccd3372f51/users/1b977840f36b4744a133188911f4aac5/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:11.658900 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:11.662517 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5616c-7f02-4676-bd37-e258a1ec9657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fb396640bc847fdbee6c3ccd3372f51, user_id=1b977840f36b4744a133188911f4aac5, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:11.666322 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5616c-7f02-4676-bd37-e258a1ec9657 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:11.681002 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 991/1951] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:37:11 2022] PUT /identity/v3/projects/2fb396640bc847fdbee6c3ccd3372f51/users/1b977840f36b4744a133188911f4aac5/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:37:11.686099 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a219048-efa7-40e5-be45-4e511224bb58 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:11.686598 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a219048-efa7-40e5-be45-4e511224bb58 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:11.686687 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a219048-efa7-40e5-be45-4e511224bb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:11.704872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1a219048-efa7-40e5-be45-4e511224bb58 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:11.706322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1a219048-efa7-40e5-be45-4e511224bb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:11.764018 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 961/1952] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:11.773331 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5616c-7f02-4676-bd37-e258a1ec9657 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:11.775026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b6a5616c-7f02-4676-bd37-e258a1ec9657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:11.838366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5616c-7f02-4676-bd37-e258a1ec9657 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:11.842756 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598411a-c1ba-4f41-92a7-173c67e759f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:11.843557 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598411a-c1ba-4f41-92a7-173c67e759f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:11.843934 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598411a-c1ba-4f41-92a7-173c67e759f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:11.844228 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598411a-c1ba-4f41-92a7-173c67e759f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:11.853864 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598411a-c1ba-4f41-92a7-173c67e759f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:11.855310 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598411a-c1ba-4f41-92a7-173c67e759f0 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:11.867106 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 992/1953] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:37:12.705513 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696411e7-7454-44d8-b374-568ad7074752 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:12.705965 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696411e7-7454-44d8-b374-568ad7074752 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:12.706089 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696411e7-7454-44d8-b374-568ad7074752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:12.735472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-696411e7-7454-44d8-b374-568ad7074752 None None] MFA Rules not processed for user `1b977840f36b4744a133188911f4aac5`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:12.736503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-696411e7-7454-44d8-b374-568ad7074752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:12.823785 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 962/1954] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:12.828482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598411a-c1ba-4f41-92a7-173c67e759f0 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:12.838658 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598411a-c1ba-4f41-92a7-173c67e759f0 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:12.843444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89356cc-5387-4b45-b472-c8430890e422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:12.844202 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89356cc-5387-4b45-b472-c8430890e422 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:12.844616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89356cc-5387-4b45-b472-c8430890e422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:12.844990 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89356cc-5387-4b45-b472-c8430890e422 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:12.845781 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89356cc-5387-4b45-b472-c8430890e422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:12.847842 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89356cc-5387-4b45-b472-c8430890e422 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:12.877912 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 993/1955] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:37:12 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:12.882219 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696411e7-7454-44d8-b374-568ad7074752 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:12.896152 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696411e7-7454-44d8-b374-568ad7074752 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:12.905707 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:12.940204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89356cc-5387-4b45-b472-c8430890e422 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:12.942071 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f89356cc-5387-4b45-b472-c8430890e422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:12.980434 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b404ac-2631-4c37-ae2f-51d02e2c8c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:12.981127 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b404ac-2631-4c37-ae2f-51d02e2c8c60 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:12.981412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b404ac-2631-4c37-ae2f-51d02e2c8c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:12.981687 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b404ac-2631-4c37-ae2f-51d02e2c8c60 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:12.982379 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b404ac-2631-4c37-ae2f-51d02e2c8c60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:12.984368 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b404ac-2631-4c37-ae2f-51d02e2c8c60 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:13.007567 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 963/1956] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:37:12 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:13.011458 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b404ac-2631-4c37-ae2f-51d02e2c8c60 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:13.023545 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b404ac-2631-4c37-ae2f-51d02e2c8c60 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:13.029008 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70a844-31b6-4c96-8c83-ce1ec80e0126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:13.029863 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70a844-31b6-4c96-8c83-ce1ec80e0126 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:13.030472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70a844-31b6-4c96-8c83-ce1ec80e0126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:13.031005 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70a844-31b6-4c96-8c83-ce1ec80e0126 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:13.032492 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70a844-31b6-4c96-8c83-ce1ec80e0126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:13.034522 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70a844-31b6-4c96-8c83-ce1ec80e0126 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:13.035092 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89356cc-5387-4b45-b472-c8430890e422 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:13.040396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0e4eb-1a1e-45bd-b141-912404c80cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:13.041278 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0e4eb-1a1e-45bd-b141-912404c80cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:13.041598 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0e4eb-1a1e-45bd-b141-912404c80cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:13.041880 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0e4eb-1a1e-45bd-b141-912404c80cf7 admin admin] PATH_INFO: `/v3/users/007e413e66cc4d7da6eb0b38e635154d` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:13.043114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0e4eb-1a1e-45bd-b141-912404c80cf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=007e413e66cc4d7da6eb0b38e635154d)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:13.045079 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0e4eb-1a1e-45bd-b141-912404c80cf7 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:13.049202 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 964/1957] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:37:13.053510 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70a844-31b6-4c96-8c83-ce1ec80e0126 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:13.063330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70a844-31b6-4c96-8c83-ce1ec80e0126 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:13.068754 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f78394-c8a3-445a-baf6-3986070ac853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:13.069622 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f78394-c8a3-445a-baf6-3986070ac853 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:13.069908 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f78394-c8a3-445a-baf6-3986070ac853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:13.070313 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f78394-c8a3-445a-baf6-3986070ac853 admin admin] PATH_INFO: `/v3/projects/bd940ff344bb4966bf1d66e7f66e9296/users/cf452d056b1943bebe53fe8924065369/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:13.088049 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f78394-c8a3-445a-baf6-3986070ac853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd940ff344bb4966bf1d66e7f66e9296, user_id=cf452d056b1943bebe53fe8924065369, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:13.091664 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f78394-c8a3-445a-baf6-3986070ac853 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:13.107214 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-efd0e4eb-1a1e-45bd-b141-912404c80cf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '007e413e66cc4d7da6eb0b38e635154d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:13.107851 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 965/1958] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:37:13 2022] PUT /identity/v3/projects/bd940ff344bb4966bf1d66e7f66e9296/users/cf452d056b1943bebe53fe8924065369/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:37:13.111362 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f78394-c8a3-445a-baf6-3986070ac853 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:13.114911 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-efd0e4eb-1a1e-45bd-b141-912404c80cf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '007e413e66cc4d7da6eb0b38e635154d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:13.115618 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-efd0e4eb-1a1e-45bd-b141-912404c80cf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '007e413e66cc4d7da6eb0b38e635154d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:13.130505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-efd0e4eb-1a1e-45bd-b141-912404c80cf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '007e413e66cc4d7da6eb0b38e635154d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:13.132186 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:13.152990 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-efd0e4eb-1a1e-45bd-b141-912404c80cf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '007e413e66cc4d7da6eb0b38e635154d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:13.168342 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 994/1959] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:37:12 2022] DELETE /identity/v3/users/007e413e66cc4d7da6eb0b38e635154d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:37:13.170768 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20ae5e-7071-4631-976e-d463a392ba26 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:13.171063 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20ae5e-7071-4631-976e-d463a392ba26 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:13.171346 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20ae5e-7071-4631-976e-d463a392ba26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:13.199182 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-2f20ae5e-7071-4631-976e-d463a392ba26 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:13.200468 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2f20ae5e-7071-4631-976e-d463a392ba26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:13.204628 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f78394-c8a3-445a-baf6-3986070ac853 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:13.269697 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dda3c9-328b-4f4b-a26c-033c73ecd0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:13.270418 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dda3c9-328b-4f4b-a26c-033c73ecd0ba admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:13.270706 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dda3c9-328b-4f4b-a26c-033c73ecd0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:13.271503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dda3c9-328b-4f4b-a26c-033c73ecd0ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:13.272237 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dda3c9-328b-4f4b-a26c-033c73ecd0ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:13.273940 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dda3c9-328b-4f4b-a26c-033c73ecd0ba admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:13.277792 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 995/1960] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:37:13.284349 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20ae5e-7071-4631-976e-d463a392ba26 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:13.285796 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2f20ae5e-7071-4631-976e-d463a392ba26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:13.296142 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 966/1961] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:37:13.297695 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dda3c9-328b-4f4b-a26c-033c73ecd0ba admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:13.299972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-27dda3c9-328b-4f4b-a26c-033c73ecd0ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:13.318812 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dda3c9-328b-4f4b-a26c-033c73ecd0ba admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:13.325082 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ac332-e88f-42f8-9029-d95251d5f1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:13.325983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ac332-e88f-42f8-9029-d95251d5f1bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:13.326263 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ac332-e88f-42f8-9029-d95251d5f1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:13.326544 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ac332-e88f-42f8-9029-d95251d5f1bf admin admin] PATH_INFO: `/v3/projects/bd940ff344bb4966bf1d66e7f66e9296/users/cf452d056b1943bebe53fe8924065369/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:13.328925 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ac332-e88f-42f8-9029-d95251d5f1bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd940ff344bb4966bf1d66e7f66e9296, user_id=cf452d056b1943bebe53fe8924065369, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:13.332560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ac332-e88f-42f8-9029-d95251d5f1bf admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:13.339422 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:13.348443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 967/1962] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:37:13 2022] PUT /identity/v3/projects/bd940ff344bb4966bf1d66e7f66e9296/users/cf452d056b1943bebe53fe8924065369/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:13.368166 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20ae5e-7071-4631-976e-d463a392ba26 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:13.433391 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6a0de-1d3a-4a49-97eb-664f575f5af8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:13.434616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6a0de-1d3a-4a49-97eb-664f575f5af8 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:13.435064 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6a0de-1d3a-4a49-97eb-664f575f5af8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:13.435440 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6a0de-1d3a-4a49-97eb-664f575f5af8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:13.526400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6a0de-1d3a-4a49-97eb-664f575f5af8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:13.528985 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6a0de-1d3a-4a49-97eb-664f575f5af8 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:13.540450 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:13.555960 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 996/1963] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:37:14.137258 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ac332-e88f-42f8-9029-d95251d5f1bf admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:14.139342 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8d6ac332-e88f-42f8-9029-d95251d5f1bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:14.155618 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ac332-e88f-42f8-9029-d95251d5f1bf admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:14.160805 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c7a2f-b1b8-452f-9700-f991bc867d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:14.162320 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c7a2f-b1b8-452f-9700-f991bc867d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:14.162676 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c7a2f-b1b8-452f-9700-f991bc867d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:14.163028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c7a2f-b1b8-452f-9700-f991bc867d5d admin admin] PATH_INFO: `/v3/projects/78be05e479c647e48109896ef3ad2c5b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:14.164336 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c7a2f-b1b8-452f-9700-f991bc867d5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=78be05e479c647e48109896ef3ad2c5b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:14.166356 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c7a2f-b1b8-452f-9700-f991bc867d5d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:14.259408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4b3c7a2f-b1b8-452f-9700-f991bc867d5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78be05e479c647e48109896ef3ad2c5b', 'request_id': 'req-4b3c7a2f-b1b8-452f-9700-f991bc867d5d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:14.269691 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4b3c7a2f-b1b8-452f-9700-f991bc867d5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78be05e479c647e48109896ef3ad2c5b', 'request_id': 'req-4b3c7a2f-b1b8-452f-9700-f991bc867d5d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:14.291123 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50df2d-2132-448b-bb5a-4dbf293d20d0 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:14.291619 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50df2d-2132-448b-bb5a-4dbf293d20d0 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:14.291776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50df2d-2132-448b-bb5a-4dbf293d20d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:14.294186 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4b3c7a2f-b1b8-452f-9700-f991bc867d5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78be05e479c647e48109896ef3ad2c5b', 'request_id': 'req-4b3c7a2f-b1b8-452f-9700-f991bc867d5d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:14.311379 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4b3c7a2f-b1b8-452f-9700-f991bc867d5d admin admin] The token cache is being invalidate because project 78be05e479c647e48109896ef3ad2c5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:37:14.311681 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4b3c7a2f-b1b8-452f-9700-f991bc867d5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:14.312375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4b3c7a2f-b1b8-452f-9700-f991bc867d5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:14.314382 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 968/1964] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:37:14 2022] DELETE /identity/v3/projects/78be05e479c647e48109896ef3ad2c5b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:14.319507 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35471ed-3bad-40fc-a7d0-111556a31397 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:14.319796 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35471ed-3bad-40fc-a7d0-111556a31397 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:14.320068 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35471ed-3bad-40fc-a7d0-111556a31397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:14.334610 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ba50df2d-2132-448b-bb5a-4dbf293d20d0 None None] MFA Rules not processed for user `cf452d056b1943bebe53fe8924065369`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:14.336009 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ba50df2d-2132-448b-bb5a-4dbf293d20d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:14.341795 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b35471ed-3bad-40fc-a7d0-111556a31397 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:14.343100 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b35471ed-3bad-40fc-a7d0-111556a31397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:14.418580 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 969/1965] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:14.428335 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bd635-d6be-4610-86b7-6fad5195b5c3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:14.428620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bd635-d6be-4610-86b7-6fad5195b5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:14.429005 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bd635-d6be-4610-86b7-6fad5195b5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:14.436289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 997/1966] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:37:14.449020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50df2d-2132-448b-bb5a-4dbf293d20d0 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:14.453261 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ba50df2d-2132-448b-bb5a-4dbf293d20d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:14.454034 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0a5bd635-d6be-4610-86b7-6fad5195b5c3 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:14.455478 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0a5bd635-d6be-4610-86b7-6fad5195b5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:14.464972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 970/1967] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:14.469440 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5bd635-d6be-4610-86b7-6fad5195b5c3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:14.479712 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5bd635-d6be-4610-86b7-6fad5195b5c3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:14.499736 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73ac4b-1229-4aea-999f-b0a06b950322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:14.504092 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73ac4b-1229-4aea-999f-b0a06b950322 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:14.504488 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73ac4b-1229-4aea-999f-b0a06b950322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:14.504832 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73ac4b-1229-4aea-999f-b0a06b950322 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:14.507067 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73ac4b-1229-4aea-999f-b0a06b950322 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:14.508474 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73ac4b-1229-4aea-999f-b0a06b950322 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:14.511461 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73ac4b-1229-4aea-999f-b0a06b950322 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:14.535114 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 971/1968] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:37:14.536516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73ac4b-1229-4aea-999f-b0a06b950322 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:14.550867 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50df2d-2132-448b-bb5a-4dbf293d20d0 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:14.570763 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73ac4b-1229-4aea-999f-b0a06b950322 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:14.572449 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd022b2-c469-4ce1-bb06-271cc4d6b20b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:14.573339 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd022b2-c469-4ce1-bb06-271cc4d6b20b service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:14.574526 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd022b2-c469-4ce1-bb06-271cc4d6b20b service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:14.574920 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd022b2-c469-4ce1-bb06-271cc4d6b20b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:14.577775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0bd022b2-c469-4ce1-bb06-271cc4d6b20b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:14.578112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f789a8-e2e0-4086-8adc-1fe4a10d51d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:14.578783 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f789a8-e2e0-4086-8adc-1fe4a10d51d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:14.579053 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f789a8-e2e0-4086-8adc-1fe4a10d51d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:14.579337 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f789a8-e2e0-4086-8adc-1fe4a10d51d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:14.580349 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f789a8-e2e0-4086-8adc-1fe4a10d51d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:14.582259 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f789a8-e2e0-4086-8adc-1fe4a10d51d2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:14.620787 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 972/1969] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:37:14 2022] POST /identity/v3/projects => generated 377 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:14.621746 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f789a8-e2e0-4086-8adc-1fe4a10d51d2 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:14.664001 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd022b2-c469-4ce1-bb06-271cc4d6b20b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:14.666553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd022b2-c469-4ce1-bb06-271cc4d6b20b service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:14.668370 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:14.680006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 998/1970] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:37:14.696696 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f789a8-e2e0-4086-8adc-1fe4a10d51d2 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:14.701394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9353f2d-0c3f-4052-b69e-c68f351afd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:14.702070 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9353f2d-0c3f-4052-b69e-c68f351afd75 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:14.702356 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9353f2d-0c3f-4052-b69e-c68f351afd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:14.702640 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9353f2d-0c3f-4052-b69e-c68f351afd75 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:14.703347 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9353f2d-0c3f-4052-b69e-c68f351afd75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:14.705570 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9353f2d-0c3f-4052-b69e-c68f351afd75 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:14.728653 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 973/1971] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:37:14 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:14.732748 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd022b2-c469-4ce1-bb06-271cc4d6b20b service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:14.746098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd022b2-c469-4ce1-bb06-271cc4d6b20b service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:14.751816 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25d910-074d-448d-9e87-6353b5ac69ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:14.752612 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25d910-074d-448d-9e87-6353b5ac69ca admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:14.753080 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25d910-074d-448d-9e87-6353b5ac69ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:14.753431 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25d910-074d-448d-9e87-6353b5ac69ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:14.754535 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25d910-074d-448d-9e87-6353b5ac69ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:14.756816 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25d910-074d-448d-9e87-6353b5ac69ca admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:14.771392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 999/1972] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:37:14.775492 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9353f2d-0c3f-4052-b69e-c68f351afd75 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:14.787410 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9353f2d-0c3f-4052-b69e-c68f351afd75 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:14.808855 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37669f5-309f-42fc-b8e6-a098f6b3edf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:14.809560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37669f5-309f-42fc-b8e6-a098f6b3edf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:14.809846 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37669f5-309f-42fc-b8e6-a098f6b3edf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:14.810124 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37669f5-309f-42fc-b8e6-a098f6b3edf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:14.811119 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37669f5-309f-42fc-b8e6-a098f6b3edf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:14.816494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37669f5-309f-42fc-b8e6-a098f6b3edf6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:14.844924 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 974/1973] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:37:14.845350 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25d910-074d-448d-9e87-6353b5ac69ca admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:14.857653 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25d910-074d-448d-9e87-6353b5ac69ca admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:14.867674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67bc75-0865-499a-9f8b-7cc48e2d5b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:14.871223 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67bc75-0865-499a-9f8b-7cc48e2d5b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:14.871656 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67bc75-0865-499a-9f8b-7cc48e2d5b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:14.872528 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67bc75-0865-499a-9f8b-7cc48e2d5b9d admin admin] PATH_INFO: `/v3/projects/11001eedbe0544d680ea8a5d7dc67208/users/9b76b4e646814e1f85a436f6f9aa90fc/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:14.910716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67bc75-0865-499a-9f8b-7cc48e2d5b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=11001eedbe0544d680ea8a5d7dc67208, user_id=9b76b4e646814e1f85a436f6f9aa90fc, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:14.914171 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67bc75-0865-499a-9f8b-7cc48e2d5b9d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:14.937450 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1000/1974] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:37:14 2022] PUT /identity/v3/projects/11001eedbe0544d680ea8a5d7dc67208/users/9b76b4e646814e1f85a436f6f9aa90fc/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:14.949148 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710ba47-05d7-40ff-90a1-a17c89235ad3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:14.949645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710ba47-05d7-40ff-90a1-a17c89235ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:14.950078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710ba47-05d7-40ff-90a1-a17c89235ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:14.981373 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7710ba47-05d7-40ff-90a1-a17c89235ad3 None None] MFA Rules not processed for user `9b76b4e646814e1f85a436f6f9aa90fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:14.982930 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7710ba47-05d7-40ff-90a1-a17c89235ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:15.081018 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 975/1975] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:15.094646 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67bc75-0865-499a-9f8b-7cc48e2d5b9d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:15.100792 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:15.216786 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67bc75-0865-499a-9f8b-7cc48e2d5b9d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:15.222393 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486efe22-0f3d-4966-a140-28a683c6d011 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:15.223185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486efe22-0f3d-4966-a140-28a683c6d011 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:15.223547 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486efe22-0f3d-4966-a140-28a683c6d011 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:15.224450 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486efe22-0f3d-4966-a140-28a683c6d011 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:15.233957 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486efe22-0f3d-4966-a140-28a683c6d011 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:15.235396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486efe22-0f3d-4966-a140-28a683c6d011 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:15.245564 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1001/1976] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:37:16.234656 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710ba47-05d7-40ff-90a1-a17c89235ad3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:16.236066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7710ba47-05d7-40ff-90a1-a17c89235ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:16.271213 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710ba47-05d7-40ff-90a1-a17c89235ad3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:16.274864 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a2cae-f4ab-4ad4-9529-e5e8437f6bfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:16.275531 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a2cae-f4ab-4ad4-9529-e5e8437f6bfb service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:16.275799 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a2cae-f4ab-4ad4-9529-e5e8437f6bfb service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:16.276075 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a2cae-f4ab-4ad4-9529-e5e8437f6bfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:16.344039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a2cae-f4ab-4ad4-9529-e5e8437f6bfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:16.345516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a2cae-f4ab-4ad4-9529-e5e8437f6bfb service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:16.356119 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 976/1977] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:37:25.241605 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=25 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:26.350920 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=78,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:31.410582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486efe22-0f3d-4966-a140-28a683c6d011 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:31.412721 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-486efe22-0f3d-4966-a140-28a683c6d011 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:31.480818 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486efe22-0f3d-4966-a140-28a683c6d011 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:31.485423 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8f99d-7692-4103-84c2-5056c483fdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:31.486226 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8f99d-7692-4103-84c2-5056c483fdd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:31.486508 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8f99d-7692-4103-84c2-5056c483fdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:31.486781 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8f99d-7692-4103-84c2-5056c483fdd2 admin admin] PATH_INFO: `/v3/users/24621111433b47458b429fb7cd862b18` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:31.487965 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8f99d-7692-4103-84c2-5056c483fdd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24621111433b47458b429fb7cd862b18)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:31.490666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8f99d-7692-4103-84c2-5056c483fdd2 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:31.536047 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-16c8f99d-7692-4103-84c2-5056c483fdd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24621111433b47458b429fb7cd862b18'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:31.543127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-16c8f99d-7692-4103-84c2-5056c483fdd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24621111433b47458b429fb7cd862b18'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:31.543798 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-16c8f99d-7692-4103-84c2-5056c483fdd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24621111433b47458b429fb7cd862b18'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:31.556208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-16c8f99d-7692-4103-84c2-5056c483fdd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24621111433b47458b429fb7cd862b18'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:31.563506 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-16c8f99d-7692-4103-84c2-5056c483fdd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24621111433b47458b429fb7cd862b18'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:31.570048 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1002/1978] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:37:31 2022] DELETE /identity/v3/users/24621111433b47458b429fb7cd862b18 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:31.739564 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a2cae-f4ab-4ad4-9529-e5e8437f6bfb service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:31.750626 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a2cae-f4ab-4ad4-9529-e5e8437f6bfb service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:31.812954 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ae813-ba79-45dd-a2ab-f6d47f1f82ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:31.813823 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ae813-ba79-45dd-a2ab-f6d47f1f82ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:31.814112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ae813-ba79-45dd-a2ab-f6d47f1f82ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:31.814392 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ae813-ba79-45dd-a2ab-f6d47f1f82ae admin admin] PATH_INFO: `/v3/projects/28aead0a91684b0eb7fcdeace101cd1b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:31.815620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ae813-ba79-45dd-a2ab-f6d47f1f82ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=28aead0a91684b0eb7fcdeace101cd1b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:31.818380 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ae813-ba79-45dd-a2ab-f6d47f1f82ae admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:31.873067 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4b8ae813-ba79-45dd-a2ab-f6d47f1f82ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28aead0a91684b0eb7fcdeace101cd1b', 'request_id': 'req-4b8ae813-ba79-45dd-a2ab-f6d47f1f82ae'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:31.881934 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4b8ae813-ba79-45dd-a2ab-f6d47f1f82ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28aead0a91684b0eb7fcdeace101cd1b', 'request_id': 'req-4b8ae813-ba79-45dd-a2ab-f6d47f1f82ae'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:31.892528 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4b8ae813-ba79-45dd-a2ab-f6d47f1f82ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28aead0a91684b0eb7fcdeace101cd1b', 'request_id': 'req-4b8ae813-ba79-45dd-a2ab-f6d47f1f82ae'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:31.906468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4b8ae813-ba79-45dd-a2ab-f6d47f1f82ae admin admin] The token cache is being invalidate because project 28aead0a91684b0eb7fcdeace101cd1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:37:31.907361 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4b8ae813-ba79-45dd-a2ab-f6d47f1f82ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:31.908027 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4b8ae813-ba79-45dd-a2ab-f6d47f1f82ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:31.910466 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 977/1979] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:37:31 2022] DELETE /identity/v3/projects/28aead0a91684b0eb7fcdeace101cd1b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:31.915268 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc3a73-d121-42c9-b9c4-60db033b6b67 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:31.915890 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc3a73-d121-42c9-b9c4-60db033b6b67 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:31.916456 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc3a73-d121-42c9-b9c4-60db033b6b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:31.941895 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3fcc3a73-d121-42c9-b9c4-60db033b6b67 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:31.944000 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3fcc3a73-d121-42c9-b9c4-60db033b6b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:32.019426 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1003/1980] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:37:32.027952 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b11b9-09c6-4e2b-9d8d-beb10da613cc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:32.028243 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b11b9-09c6-4e2b-9d8d-beb10da613cc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:32.028573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b11b9-09c6-4e2b-9d8d-beb10da613cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:32.050517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9b2b11b9-09c6-4e2b-9d8d-beb10da613cc None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:32.051747 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9b2b11b9-09c6-4e2b-9d8d-beb10da613cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:32.060750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 978/1981] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:32.064689 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc3a73-d121-42c9-b9c4-60db033b6b67 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:32.075045 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc3a73-d121-42c9-b9c4-60db033b6b67 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:32.081883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a596bc-750b-4ab3-a106-32e14bb9c3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:32.082539 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a596bc-750b-4ab3-a106-32e14bb9c3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:32.082964 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a596bc-750b-4ab3-a106-32e14bb9c3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:32.083382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a596bc-750b-4ab3-a106-32e14bb9c3f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:32.084238 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a596bc-750b-4ab3-a106-32e14bb9c3f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:32.084698 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a596bc-750b-4ab3-a106-32e14bb9c3f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:32.086442 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a596bc-750b-4ab3-a106-32e14bb9c3f5 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:32.102299 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1004/1982] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:32.105193 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b11b9-09c6-4e2b-9d8d-beb10da613cc None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:32.117430 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b11b9-09c6-4e2b-9d8d-beb10da613cc None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:32.124559 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c9b86-8182-431b-9b9b-177998afd873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:32.125353 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c9b86-8182-431b-9b9b-177998afd873 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:32.125698 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c9b86-8182-431b-9b9b-177998afd873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:32.126076 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c9b86-8182-431b-9b9b-177998afd873 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:32.126852 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c9b86-8182-431b-9b9b-177998afd873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:32.128788 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c9b86-8182-431b-9b9b-177998afd873 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:32.164411 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 979/1983] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:37:32 2022] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:37:32.168648 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a596bc-750b-4ab3-a106-32e14bb9c3f5 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:32.178989 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a596bc-750b-4ab3-a106-32e14bb9c3f5 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:32.182562 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:32.237078 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea928a-d765-48f6-87d4-f26d002aaf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:32.237737 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea928a-d765-48f6-87d4-f26d002aaf34 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:32.238020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea928a-d765-48f6-87d4-f26d002aaf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:32.238297 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea928a-d765-48f6-87d4-f26d002aaf34 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:32.238993 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea928a-d765-48f6-87d4-f26d002aaf34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:32.241618 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea928a-d765-48f6-87d4-f26d002aaf34 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:32.260333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1005/1984] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:37:32 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:32.264461 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c9b86-8182-431b-9b9b-177998afd873 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:32.274860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c9b86-8182-431b-9b9b-177998afd873 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:32.280404 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7dc5b-3f67-4d5f-a096-fc05c9ccf90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:32.281175 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7dc5b-3f67-4d5f-a096-fc05c9ccf90a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:32.281469 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7dc5b-3f67-4d5f-a096-fc05c9ccf90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:32.282629 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7dc5b-3f67-4d5f-a096-fc05c9ccf90a admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:32.282750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7dc5b-3f67-4d5f-a096-fc05c9ccf90a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:32.284856 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7dc5b-3f67-4d5f-a096-fc05c9ccf90a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:32.298690 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 980/1985] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:37:32.303340 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea928a-d765-48f6-87d4-f26d002aaf34 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:32.313676 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea928a-d765-48f6-87d4-f26d002aaf34 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:32.318318 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4f6c6-b8df-4e54-a035-04cc7802cdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:32.319012 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4f6c6-b8df-4e54-a035-04cc7802cdf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:32.319307 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4f6c6-b8df-4e54-a035-04cc7802cdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:32.319591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4f6c6-b8df-4e54-a035-04cc7802cdf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:32.320369 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4f6c6-b8df-4e54-a035-04cc7802cdf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:32.321973 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4f6c6-b8df-4e54-a035-04cc7802cdf4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:32.332510 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1006/1986] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:37:32.336615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7dc5b-3f67-4d5f-a096-fc05c9ccf90a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:32.347070 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7dc5b-3f67-4d5f-a096-fc05c9ccf90a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:32.352348 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c3033-7857-42f5-991f-9c19fdc2a280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:32.353227 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c3033-7857-42f5-991f-9c19fdc2a280 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:32.353515 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c3033-7857-42f5-991f-9c19fdc2a280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:32.353796 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c3033-7857-42f5-991f-9c19fdc2a280 admin admin] PATH_INFO: `/v3/projects/86f7f74b0b7841b6b9775f7f67baf503/users/7a361d06c95a4271a1a707237ab091fa/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:32.387496 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c3033-7857-42f5-991f-9c19fdc2a280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86f7f74b0b7841b6b9775f7f67baf503, user_id=7a361d06c95a4271a1a707237ab091fa, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:32.393277 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c3033-7857-42f5-991f-9c19fdc2a280 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:32.412389 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 981/1987] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:37:32 2022] PUT /identity/v3/projects/86f7f74b0b7841b6b9775f7f67baf503/users/7a361d06c95a4271a1a707237ab091fa/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:37:32.421021 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cd4f3-33c6-431d-8fd6-9a0528235b91 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:32.421532 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cd4f3-33c6-431d-8fd6-9a0528235b91 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:32.421627 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cd4f3-33c6-431d-8fd6-9a0528235b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:32.454660 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a53cd4f3-33c6-431d-8fd6-9a0528235b91 None None] MFA Rules not processed for user `7a361d06c95a4271a1a707237ab091fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:32.456199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a53cd4f3-33c6-431d-8fd6-9a0528235b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:32.537287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1007/1988] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:32.549048 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c3033-7857-42f5-991f-9c19fdc2a280 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:32.550751 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-112c3033-7857-42f5-991f-9c19fdc2a280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:32.592216 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:32.621231 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c3033-7857-42f5-991f-9c19fdc2a280 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:32.625283 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47505bc6-96cb-4c25-8d53-21331c73663e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:32.625996 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47505bc6-96cb-4c25-8d53-21331c73663e service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:32.626310 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47505bc6-96cb-4c25-8d53-21331c73663e service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:32.626619 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47505bc6-96cb-4c25-8d53-21331c73663e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:32.638009 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47505bc6-96cb-4c25-8d53-21331c73663e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:32.639839 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47505bc6-96cb-4c25-8d53-21331c73663e service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:32.650538 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 982/1989] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:37:40.919589 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53cd4f3-33c6-431d-8fd6-9a0528235b91 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:40.921072 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a53cd4f3-33c6-431d-8fd6-9a0528235b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:40.987197 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53cd4f3-33c6-431d-8fd6-9a0528235b91 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:40.991816 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9883d5-4ba7-442d-8ad7-2290f8fe4b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:40.992834 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9883d5-4ba7-442d-8ad7-2290f8fe4b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:40.993122 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9883d5-4ba7-442d-8ad7-2290f8fe4b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:40.993396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9883d5-4ba7-442d-8ad7-2290f8fe4b15 admin admin] PATH_INFO: `/v3/users/1b977840f36b4744a133188911f4aac5` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:40.994624 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9883d5-4ba7-442d-8ad7-2290f8fe4b15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b977840f36b4744a133188911f4aac5)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:40.996643 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9883d5-4ba7-442d-8ad7-2290f8fe4b15 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:41.018323 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:41.057652 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-cd9883d5-4ba7-442d-8ad7-2290f8fe4b15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b977840f36b4744a133188911f4aac5'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:41.064757 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-cd9883d5-4ba7-442d-8ad7-2290f8fe4b15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b977840f36b4744a133188911f4aac5'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:41.065508 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-cd9883d5-4ba7-442d-8ad7-2290f8fe4b15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b977840f36b4744a133188911f4aac5'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:41.077258 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-cd9883d5-4ba7-442d-8ad7-2290f8fe4b15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b977840f36b4744a133188911f4aac5'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:41.085969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-cd9883d5-4ba7-442d-8ad7-2290f8fe4b15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b977840f36b4744a133188911f4aac5'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:41.092651 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1008/1990] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:37:40 2022] DELETE /identity/v3/users/1b977840f36b4744a133188911f4aac5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:41.289767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47505bc6-96cb-4c25-8d53-21331c73663e service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:41.301380 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47505bc6-96cb-4c25-8d53-21331c73663e service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:41.362417 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4dfccf-d4e1-40f5-b738-2946cd06d0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:41.363285 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4dfccf-d4e1-40f5-b738-2946cd06d0b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:41.363573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4dfccf-d4e1-40f5-b738-2946cd06d0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:41.363855 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4dfccf-d4e1-40f5-b738-2946cd06d0b9 admin admin] PATH_INFO: `/v3/projects/2fb396640bc847fdbee6c3ccd3372f51` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:41.365099 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4dfccf-d4e1-40f5-b738-2946cd06d0b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fb396640bc847fdbee6c3ccd3372f51)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:41.367010 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4dfccf-d4e1-40f5-b738-2946cd06d0b9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:41.413404 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ad4dfccf-d4e1-40f5-b738-2946cd06d0b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fb396640bc847fdbee6c3ccd3372f51', 'request_id': 'req-ad4dfccf-d4e1-40f5-b738-2946cd06d0b9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:41.418890 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ad4dfccf-d4e1-40f5-b738-2946cd06d0b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fb396640bc847fdbee6c3ccd3372f51', 'request_id': 'req-ad4dfccf-d4e1-40f5-b738-2946cd06d0b9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:41.425077 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ad4dfccf-d4e1-40f5-b738-2946cd06d0b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fb396640bc847fdbee6c3ccd3372f51', 'request_id': 'req-ad4dfccf-d4e1-40f5-b738-2946cd06d0b9'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:41.436220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ad4dfccf-d4e1-40f5-b738-2946cd06d0b9 admin admin] The token cache is being invalidate because project 2fb396640bc847fdbee6c3ccd3372f51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:37:41.436538 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ad4dfccf-d4e1-40f5-b738-2946cd06d0b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:41.437164 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ad4dfccf-d4e1-40f5-b738-2946cd06d0b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:41.438675 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 983/1991] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:37:41 2022] DELETE /identity/v3/projects/2fb396640bc847fdbee6c3ccd3372f51 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:41.443123 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9883d5-4ba7-442d-8ad7-2290f8fe4b15 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:41.444680 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-cd9883d5-4ba7-442d-8ad7-2290f8fe4b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:41.458498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9883d5-4ba7-442d-8ad7-2290f8fe4b15 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:41.513648 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935cc7f3-32f5-4b87-a71e-7905712a53a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:41.514520 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cc7f3-32f5-4b87-a71e-7905712a53a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:41.514805 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cc7f3-32f5-4b87-a71e-7905712a53a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:41.515082 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cc7f3-32f5-4b87-a71e-7905712a53a7 admin admin] PATH_INFO: `/v3/users/cf452d056b1943bebe53fe8924065369` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:41.516320 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935cc7f3-32f5-4b87-a71e-7905712a53a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf452d056b1943bebe53fe8924065369)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:41.518253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935cc7f3-32f5-4b87-a71e-7905712a53a7 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:41.564240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-935cc7f3-32f5-4b87-a71e-7905712a53a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf452d056b1943bebe53fe8924065369'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:41.571662 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-935cc7f3-32f5-4b87-a71e-7905712a53a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf452d056b1943bebe53fe8924065369'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:41.572365 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-935cc7f3-32f5-4b87-a71e-7905712a53a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf452d056b1943bebe53fe8924065369'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:41.586011 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-935cc7f3-32f5-4b87-a71e-7905712a53a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf452d056b1943bebe53fe8924065369'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:41.593385 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-935cc7f3-32f5-4b87-a71e-7905712a53a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf452d056b1943bebe53fe8924065369'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:41.599473 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1009/1992] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:37:41 2022] DELETE /identity/v3/users/cf452d056b1943bebe53fe8924065369 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:41.771152 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4dfccf-d4e1-40f5-b738-2946cd06d0b9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:41.772610 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ad4dfccf-d4e1-40f5-b738-2946cd06d0b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:41.790266 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4dfccf-d4e1-40f5-b738-2946cd06d0b9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:41.850665 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed66dc9-275c-4274-b7ec-29106566dc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:41.851819 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed66dc9-275c-4274-b7ec-29106566dc9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:41.852100 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed66dc9-275c-4274-b7ec-29106566dc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:41.852408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed66dc9-275c-4274-b7ec-29106566dc9e admin admin] PATH_INFO: `/v3/projects/bd940ff344bb4966bf1d66e7f66e9296` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:41.853614 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed66dc9-275c-4274-b7ec-29106566dc9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd940ff344bb4966bf1d66e7f66e9296)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:41.855530 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed66dc9-275c-4274-b7ec-29106566dc9e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:41.857018 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:41.920184 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4ed66dc9-275c-4274-b7ec-29106566dc9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd940ff344bb4966bf1d66e7f66e9296', 'request_id': 'req-4ed66dc9-275c-4274-b7ec-29106566dc9e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:41.926025 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4ed66dc9-275c-4274-b7ec-29106566dc9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd940ff344bb4966bf1d66e7f66e9296', 'request_id': 'req-4ed66dc9-275c-4274-b7ec-29106566dc9e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:41.935314 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4ed66dc9-275c-4274-b7ec-29106566dc9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd940ff344bb4966bf1d66e7f66e9296', 'request_id': 'req-4ed66dc9-275c-4274-b7ec-29106566dc9e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:41.947847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4ed66dc9-275c-4274-b7ec-29106566dc9e admin admin] The token cache is being invalidate because project bd940ff344bb4966bf1d66e7f66e9296 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:37:41.948145 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4ed66dc9-275c-4274-b7ec-29106566dc9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:41.949529 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4ed66dc9-275c-4274-b7ec-29106566dc9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:41.951283 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 984/1993] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:37:41 2022] DELETE /identity/v3/projects/bd940ff344bb4966bf1d66e7f66e9296 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:37:41.956279 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6ced3-82ba-4f75-a997-2c174369e752 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:41.956761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6ced3-82ba-4f75-a997-2c174369e752 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:41.956877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6ced3-82ba-4f75-a997-2c174369e752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:41.978021 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c2e6ced3-82ba-4f75-a997-2c174369e752 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:41.979282 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c2e6ced3-82ba-4f75-a997-2c174369e752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:41.987913 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:42.043232 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1010/1994] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:42.052749 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3025d7-f08b-45dc-9a46-50e06197509b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:42.053045 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3025d7-f08b-45dc-9a46-50e06197509b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:42.053331 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3025d7-f08b-45dc-9a46-50e06197509b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:42.071327 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-bb3025d7-f08b-45dc-9a46-50e06197509b None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:42.072575 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bb3025d7-f08b-45dc-9a46-50e06197509b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:42.080763 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 985/1995] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:42.084860 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6ced3-82ba-4f75-a997-2c174369e752 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:42.094485 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6ced3-82ba-4f75-a997-2c174369e752 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:42.099526 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a44bc4-71b2-4fcc-940c-0f47cb88a08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:42.100169 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a44bc4-71b2-4fcc-940c-0f47cb88a08c admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:42.100516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a44bc4-71b2-4fcc-940c-0f47cb88a08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:42.100799 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a44bc4-71b2-4fcc-940c-0f47cb88a08c admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:42.101518 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a44bc4-71b2-4fcc-940c-0f47cb88a08c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:42.101824 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a44bc4-71b2-4fcc-940c-0f47cb88a08c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:42.103429 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a44bc4-71b2-4fcc-940c-0f47cb88a08c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:42.115741 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1011/1996] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:42.119752 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3025d7-f08b-45dc-9a46-50e06197509b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:42.128914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3025d7-f08b-45dc-9a46-50e06197509b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:42.133799 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c5a92-f8ed-4b39-a57a-8d108a6f314a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:42.134434 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c5a92-f8ed-4b39-a57a-8d108a6f314a admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:42.134723 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c5a92-f8ed-4b39-a57a-8d108a6f314a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:42.135007 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c5a92-f8ed-4b39-a57a-8d108a6f314a admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:42.135701 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c5a92-f8ed-4b39-a57a-8d108a6f314a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:42.137828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c5a92-f8ed-4b39-a57a-8d108a6f314a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:42.163803 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 986/1997] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:37:42 2022] POST /identity/v3/projects => generated 361 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:42.167771 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a44bc4-71b2-4fcc-940c-0f47cb88a08c admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:42.177983 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a44bc4-71b2-4fcc-940c-0f47cb88a08c admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:42.242002 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a9693-2f4b-44bc-ad44-90de1cadddb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:42.242755 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a9693-2f4b-44bc-ad44-90de1cadddb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:42.243042 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a9693-2f4b-44bc-ad44-90de1cadddb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:42.243380 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a9693-2f4b-44bc-ad44-90de1cadddb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:42.244085 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a9693-2f4b-44bc-ad44-90de1cadddb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:42.246077 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a9693-2f4b-44bc-ad44-90de1cadddb4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:42.267294 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1012/1998] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:37:42 2022] POST /identity/v3/users => generated 281 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:37:42.271581 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c5a92-f8ed-4b39-a57a-8d108a6f314a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:42.282638 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c5a92-f8ed-4b39-a57a-8d108a6f314a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:42.288580 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ff130-12a1-4505-896a-f9e89026ed0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:42.289256 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ff130-12a1-4505-896a-f9e89026ed0b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:42.289606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ff130-12a1-4505-896a-f9e89026ed0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:42.289887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ff130-12a1-4505-896a-f9e89026ed0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:42.290630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ff130-12a1-4505-896a-f9e89026ed0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:42.292399 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ff130-12a1-4505-896a-f9e89026ed0b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:42.304601 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 987/1999] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:37:42.308561 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a9693-2f4b-44bc-ad44-90de1cadddb4 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:42.321662 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a9693-2f4b-44bc-ad44-90de1cadddb4 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:42.326975 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d1940-f746-4c40-b8cf-fbd1edd75e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:42.327763 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d1940-f746-4c40-b8cf-fbd1edd75e35 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:42.328118 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d1940-f746-4c40-b8cf-fbd1edd75e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:42.328497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d1940-f746-4c40-b8cf-fbd1edd75e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:42.329351 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d1940-f746-4c40-b8cf-fbd1edd75e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:42.331272 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d1940-f746-4c40-b8cf-fbd1edd75e35 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:42.341561 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ff130-12a1-4505-896a-f9e89026ed0b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:42.346041 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1013/2000] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:37:42.346164 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9c1ff130-12a1-4505-896a-f9e89026ed0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:42.347025 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d1940-f746-4c40-b8cf-fbd1edd75e35 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:42.356575 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ff130-12a1-4505-896a-f9e89026ed0b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:42.359098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d1940-f746-4c40-b8cf-fbd1edd75e35 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:42.362244 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a7eaf-798b-4985-ba05-e0dd85adf816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:42.362945 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a7eaf-798b-4985-ba05-e0dd85adf816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:42.363213 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a7eaf-798b-4985-ba05-e0dd85adf816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:42.363510 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a7eaf-798b-4985-ba05-e0dd85adf816 admin admin] PATH_INFO: `/v3/users/9b76b4e646814e1f85a436f6f9aa90fc` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:42.364859 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a7eaf-798b-4985-ba05-e0dd85adf816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b76b4e646814e1f85a436f6f9aa90fc)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:42.365360 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee2957-cb2d-4606-9e2a-c1d8d9e0b736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:42.366594 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee2957-cb2d-4606-9e2a-c1d8d9e0b736 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:42.366833 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a7eaf-798b-4985-ba05-e0dd85adf816 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:42.366983 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee2957-cb2d-4606-9e2a-c1d8d9e0b736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:42.367194 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee2957-cb2d-4606-9e2a-c1d8d9e0b736 admin admin] PATH_INFO: `/v3/projects/55572186440d411e8407c3f6f2ab80d6/users/5ea7df55350a46dc87b57fd7b5e9f48d/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:42.384586 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee2957-cb2d-4606-9e2a-c1d8d9e0b736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55572186440d411e8407c3f6f2ab80d6, user_id=5ea7df55350a46dc87b57fd7b5e9f48d, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:42.387264 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee2957-cb2d-4606-9e2a-c1d8d9e0b736 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:42.425586 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e82a7eaf-798b-4985-ba05-e0dd85adf816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b76b4e646814e1f85a436f6f9aa90fc'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:42.438032 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1014/2001] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:37:42 2022] PUT /identity/v3/projects/55572186440d411e8407c3f6f2ab80d6/users/5ea7df55350a46dc87b57fd7b5e9f48d/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:42.441090 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e82a7eaf-798b-4985-ba05-e0dd85adf816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b76b4e646814e1f85a436f6f9aa90fc'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:42.441873 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e82a7eaf-798b-4985-ba05-e0dd85adf816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b76b4e646814e1f85a436f6f9aa90fc'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:42.448430 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51757304-14ce-4167-8cd9-68ef1ccc5b4b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:42.448836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51757304-14ce-4167-8cd9-68ef1ccc5b4b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:42.449020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51757304-14ce-4167-8cd9-68ef1ccc5b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:42.456705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e82a7eaf-798b-4985-ba05-e0dd85adf816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b76b4e646814e1f85a436f6f9aa90fc'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:42.467178 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e82a7eaf-798b-4985-ba05-e0dd85adf816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b76b4e646814e1f85a436f6f9aa90fc'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:42.475051 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 988/2002] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:37:42 2022] DELETE /identity/v3/users/9b76b4e646814e1f85a436f6f9aa90fc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:37:42.479837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f6abd-0b8e-4fd0-8ac7-4230669dc154 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:42.480263 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f6abd-0b8e-4fd0-8ac7-4230669dc154 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:42.480624 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f6abd-0b8e-4fd0-8ac7-4230669dc154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:42.480953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-51757304-14ce-4167-8cd9-68ef1ccc5b4b None None] MFA Rules not processed for user `5ea7df55350a46dc87b57fd7b5e9f48d`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:42.482186 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-51757304-14ce-4167-8cd9-68ef1ccc5b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:42.499352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8c6f6abd-0b8e-4fd0-8ac7-4230669dc154 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:42.501319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8c6f6abd-0b8e-4fd0-8ac7-4230669dc154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:42.519824 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:42.529571 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:42.563683 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1015/2003] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:37:42.574613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51757304-14ce-4167-8cd9-68ef1ccc5b4b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:42.575975 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-51757304-14ce-4167-8cd9-68ef1ccc5b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:42.580207 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 989/2004] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:37:42.590149 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f6abd-0b8e-4fd0-8ac7-4230669dc154 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:42.591454 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8c6f6abd-0b8e-4fd0-8ac7-4230669dc154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:42.642991 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51757304-14ce-4167-8cd9-68ef1ccc5b4b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:42.647770 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f30ff-35b2-4cf6-82f8-915df892ecac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:42.648448 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f30ff-35b2-4cf6-82f8-915df892ecac service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:42.648742 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f30ff-35b2-4cf6-82f8-915df892ecac service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:42.649021 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f30ff-35b2-4cf6-82f8-915df892ecac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:42.657924 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f30ff-35b2-4cf6-82f8-915df892ecac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:42.659385 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f30ff-35b2-4cf6-82f8-915df892ecac service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:42.659782 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f6abd-0b8e-4fd0-8ac7-4230669dc154 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:42.664103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3752b3-1d74-470f-be64-d6c6ebe32653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:42.664790 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3752b3-1d74-470f-be64-d6c6ebe32653 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:42.665079 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3752b3-1d74-470f-be64-d6c6ebe32653 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:42.665361 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3752b3-1d74-470f-be64-d6c6ebe32653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:42.669340 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1016/2005] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:37:42.676478 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3752b3-1d74-470f-be64-d6c6ebe32653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:42.677921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3752b3-1d74-470f-be64-d6c6ebe32653 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:42.688435 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 990/2006] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:37:42.971971 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f30ff-35b2-4cf6-82f8-915df892ecac service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:42.981758 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-214f30ff-35b2-4cf6-82f8-915df892ecac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:42.996698 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f30ff-35b2-4cf6-82f8-915df892ecac service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:43.003144 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7eaa56-560b-4f14-938c-242c26c9d865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:43.005342 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7eaa56-560b-4f14-938c-242c26c9d865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:43.005733 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7eaa56-560b-4f14-938c-242c26c9d865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:43.006113 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7eaa56-560b-4f14-938c-242c26c9d865 admin admin] PATH_INFO: `/v3/projects/11001eedbe0544d680ea8a5d7dc67208` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:43.007503 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7eaa56-560b-4f14-938c-242c26c9d865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11001eedbe0544d680ea8a5d7dc67208)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:43.010140 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7eaa56-560b-4f14-938c-242c26c9d865 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:43.067925 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ee7eaa56-560b-4f14-938c-242c26c9d865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11001eedbe0544d680ea8a5d7dc67208', 'request_id': 'req-ee7eaa56-560b-4f14-938c-242c26c9d865'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:43.075771 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ee7eaa56-560b-4f14-938c-242c26c9d865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11001eedbe0544d680ea8a5d7dc67208', 'request_id': 'req-ee7eaa56-560b-4f14-938c-242c26c9d865'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:43.081829 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ee7eaa56-560b-4f14-938c-242c26c9d865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11001eedbe0544d680ea8a5d7dc67208', 'request_id': 'req-ee7eaa56-560b-4f14-938c-242c26c9d865'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:43.094140 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ee7eaa56-560b-4f14-938c-242c26c9d865 admin admin] The token cache is being invalidate because project 11001eedbe0544d680ea8a5d7dc67208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:37:43.094295 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ee7eaa56-560b-4f14-938c-242c26c9d865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:43.094959 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ee7eaa56-560b-4f14-938c-242c26c9d865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:43.096599 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1017/2007] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:37:42 2022] DELETE /identity/v3/projects/11001eedbe0544d680ea8a5d7dc67208 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:43.101360 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73436965-ec7f-4206-804a-20b6fe17c4d0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:43.101654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73436965-ec7f-4206-804a-20b6fe17c4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:43.101938 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73436965-ec7f-4206-804a-20b6fe17c4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:43.121180 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-73436965-ec7f-4206-804a-20b6fe17c4d0 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:43.122392 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-73436965-ec7f-4206-804a-20b6fe17c4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:43.185597 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 991/2008] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:43.195054 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c26ed2-3829-40e8-85db-ce47932fd453 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:43.195348 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c26ed2-3829-40e8-85db-ce47932fd453 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:43.195632 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c26ed2-3829-40e8-85db-ce47932fd453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:43.214922 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f4c26ed2-3829-40e8-85db-ce47932fd453 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:43.221094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f4c26ed2-3829-40e8-85db-ce47932fd453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:43.229073 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1018/2009] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:43.233395 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73436965-ec7f-4206-804a-20b6fe17c4d0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:43.243645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73436965-ec7f-4206-804a-20b6fe17c4d0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:43.248178 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3ffc2-bd92-4c90-88bc-907dcc25255d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:43.248856 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3ffc2-bd92-4c90-88bc-907dcc25255d admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:43.249142 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3ffc2-bd92-4c90-88bc-907dcc25255d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:43.249422 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3ffc2-bd92-4c90-88bc-907dcc25255d admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:43.250147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac3ffc2-bd92-4c90-88bc-907dcc25255d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:43.250574 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac3ffc2-bd92-4c90-88bc-907dcc25255d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:43.252206 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac3ffc2-bd92-4c90-88bc-907dcc25255d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:43.264446 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 992/2010] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:43.268617 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c26ed2-3829-40e8-85db-ce47932fd453 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:43.277853 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c26ed2-3829-40e8-85db-ce47932fd453 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:43.282545 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3064a-0fc3-491c-a38d-f4dbb3043555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:43.283232 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3064a-0fc3-491c-a38d-f4dbb3043555 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:43.283515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3064a-0fc3-491c-a38d-f4dbb3043555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:43.283790 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3064a-0fc3-491c-a38d-f4dbb3043555 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:43.284529 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3064a-0fc3-491c-a38d-f4dbb3043555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:43.286472 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3064a-0fc3-491c-a38d-f4dbb3043555 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:43.315368 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1019/2011] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:37:43 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:37:43.320512 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3ffc2-bd92-4c90-88bc-907dcc25255d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:43.330702 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3ffc2-bd92-4c90-88bc-907dcc25255d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:43.378365 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:43.388186 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657eb1f-17cd-4f4c-b209-41b60df5836b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:43.388898 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657eb1f-17cd-4f4c-b209-41b60df5836b admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:43.389193 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657eb1f-17cd-4f4c-b209-41b60df5836b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:43.389476 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657eb1f-17cd-4f4c-b209-41b60df5836b admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:43.390180 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657eb1f-17cd-4f4c-b209-41b60df5836b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:43.392115 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657eb1f-17cd-4f4c-b209-41b60df5836b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:43.410970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 993/2012] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:37:43 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:43.415247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3064a-0fc3-491c-a38d-f4dbb3043555 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:43.425363 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3064a-0fc3-491c-a38d-f4dbb3043555 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:43.430449 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89045a70-9f7d-4b35-ba8f-5230cd5ff1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:43.431095 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89045a70-9f7d-4b35-ba8f-5230cd5ff1ed admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:43.431476 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89045a70-9f7d-4b35-ba8f-5230cd5ff1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:43.431848 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89045a70-9f7d-4b35-ba8f-5230cd5ff1ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:43.432664 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89045a70-9f7d-4b35-ba8f-5230cd5ff1ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:43.434465 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89045a70-9f7d-4b35-ba8f-5230cd5ff1ed admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:43.445360 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1020/2013] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:37:43.449290 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657eb1f-17cd-4f4c-b209-41b60df5836b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:43.459420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657eb1f-17cd-4f4c-b209-41b60df5836b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:43.464025 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb495a60-b8c1-4218-9e0f-186285ec3a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:43.464714 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb495a60-b8c1-4218-9e0f-186285ec3a14 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:43.465003 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb495a60-b8c1-4218-9e0f-186285ec3a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:43.465282 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb495a60-b8c1-4218-9e0f-186285ec3a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:43.466036 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb495a60-b8c1-4218-9e0f-186285ec3a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:43.467623 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb495a60-b8c1-4218-9e0f-186285ec3a14 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:43.478006 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 994/2014] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:37:43.481772 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89045a70-9f7d-4b35-ba8f-5230cd5ff1ed admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:43.491980 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89045a70-9f7d-4b35-ba8f-5230cd5ff1ed admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:43.496598 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616bce51-659b-48e6-9359-246d495d8b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:43.497456 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bce51-659b-48e6-9359-246d495d8b8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:43.497739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bce51-659b-48e6-9359-246d495d8b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:43.498018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bce51-659b-48e6-9359-246d495d8b8c admin admin] PATH_INFO: `/v3/projects/0c414f9989094beca424f5fbe626e4fb/users/db77c883d5694787b97927f78ec0533b/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:43.512018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616bce51-659b-48e6-9359-246d495d8b8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c414f9989094beca424f5fbe626e4fb, user_id=db77c883d5694787b97927f78ec0533b, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:43.514686 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616bce51-659b-48e6-9359-246d495d8b8c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:43.528396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1021/2015] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:37:43 2022] PUT /identity/v3/projects/0c414f9989094beca424f5fbe626e4fb/users/db77c883d5694787b97927f78ec0533b/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:43.538837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c982e-7bcf-40a0-9cdb-e885c65debcc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:43.539134 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c982e-7bcf-40a0-9cdb-e885c65debcc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:43.539419 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c982e-7bcf-40a0-9cdb-e885c65debcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:43.567708 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f84c982e-7bcf-40a0-9cdb-e885c65debcc None None] MFA Rules not processed for user `db77c883d5694787b97927f78ec0533b`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:43.568976 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f84c982e-7bcf-40a0-9cdb-e885c65debcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:43.636543 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 995/2016] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:43.649432 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616bce51-659b-48e6-9359-246d495d8b8c admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:43.651480 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-616bce51-659b-48e6-9359-246d495d8b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:43.662355 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:43.728454 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616bce51-659b-48e6-9359-246d495d8b8c admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:43.732046 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52926913-bf52-44c2-901e-e41b5391400c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:43.732794 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52926913-bf52-44c2-901e-e41b5391400c service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:43.733214 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52926913-bf52-44c2-901e-e41b5391400c service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:43.733525 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52926913-bf52-44c2-901e-e41b5391400c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:43.742437 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52926913-bf52-44c2-901e-e41b5391400c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:43.743882 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52926913-bf52-44c2-901e-e41b5391400c service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:43.752654 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1022/2017] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:37:44.174504 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c982e-7bcf-40a0-9cdb-e885c65debcc None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:44.176101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f84c982e-7bcf-40a0-9cdb-e885c65debcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:44.243204 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c982e-7bcf-40a0-9cdb-e885c65debcc None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:44.247819 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab17522-ca5f-40a9-b5d4-d3fc461661bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:44.248655 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab17522-ca5f-40a9-b5d4-d3fc461661bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:44.248951 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab17522-ca5f-40a9-b5d4-d3fc461661bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:44.249221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab17522-ca5f-40a9-b5d4-d3fc461661bf admin admin] PATH_INFO: `/v3/users/7a361d06c95a4271a1a707237ab091fa` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:44.250412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab17522-ca5f-40a9-b5d4-d3fc461661bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a361d06c95a4271a1a707237ab091fa)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:44.252351 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab17522-ca5f-40a9-b5d4-d3fc461661bf admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:44.308407 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6ab17522-ca5f-40a9-b5d4-d3fc461661bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a361d06c95a4271a1a707237ab091fa'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:44.315583 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6ab17522-ca5f-40a9-b5d4-d3fc461661bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a361d06c95a4271a1a707237ab091fa'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:44.316383 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6ab17522-ca5f-40a9-b5d4-d3fc461661bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a361d06c95a4271a1a707237ab091fa'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:44.322583 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:44.330831 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6ab17522-ca5f-40a9-b5d4-d3fc461661bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a361d06c95a4271a1a707237ab091fa'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:44.339423 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6ab17522-ca5f-40a9-b5d4-d3fc461661bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a361d06c95a4271a1a707237ab091fa'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:44.345734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 996/2018] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:37:44 2022] DELETE /identity/v3/users/7a361d06c95a4271a1a707237ab091fa => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:44.350319 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f5bab-5f8d-46cd-a7d4-b945ca6a621f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:44.350778 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f5bab-5f8d-46cd-a7d4-b945ca6a621f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:44.351036 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f5bab-5f8d-46cd-a7d4-b945ca6a621f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:44.377135 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-a85f5bab-5f8d-46cd-a7d4-b945ca6a621f None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:44.378699 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a85f5bab-5f8d-46cd-a7d4-b945ca6a621f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:44.450009 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1023/2019] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:44.460208 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab17522-ca5f-40a9-b5d4-d3fc461661bf admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:44.461715 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6ab17522-ca5f-40a9-b5d4-d3fc461661bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:44.524158 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab17522-ca5f-40a9-b5d4-d3fc461661bf admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:44.528866 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f71a6-db42-479c-8a92-5a744ae4d596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:44.529592 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f71a6-db42-479c-8a92-5a744ae4d596 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:44.529948 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f71a6-db42-479c-8a92-5a744ae4d596 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:44.530290 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f71a6-db42-479c-8a92-5a744ae4d596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:44.540200 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f71a6-db42-479c-8a92-5a744ae4d596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:44.541683 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f71a6-db42-479c-8a92-5a744ae4d596 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:44.552005 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 997/2020] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:37:44.822880 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f5bab-5f8d-46cd-a7d4-b945ca6a621f None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:44.824291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a85f5bab-5f8d-46cd-a7d4-b945ca6a621f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:44.839223 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f5bab-5f8d-46cd-a7d4-b945ca6a621f None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:44.844354 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34c9c9-fa96-44d5-8602-ef5920eb78e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:44.845673 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34c9c9-fa96-44d5-8602-ef5920eb78e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:44.845673 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34c9c9-fa96-44d5-8602-ef5920eb78e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:44.845904 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34c9c9-fa96-44d5-8602-ef5920eb78e0 admin admin] PATH_INFO: `/v3/projects/86f7f74b0b7841b6b9775f7f67baf503` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:44.846990 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34c9c9-fa96-44d5-8602-ef5920eb78e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86f7f74b0b7841b6b9775f7f67baf503)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:44.849041 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34c9c9-fa96-44d5-8602-ef5920eb78e0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:44.905150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5b34c9c9-fa96-44d5-8602-ef5920eb78e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86f7f74b0b7841b6b9775f7f67baf503', 'request_id': 'req-5b34c9c9-fa96-44d5-8602-ef5920eb78e0'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:44.912202 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5b34c9c9-fa96-44d5-8602-ef5920eb78e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86f7f74b0b7841b6b9775f7f67baf503', 'request_id': 'req-5b34c9c9-fa96-44d5-8602-ef5920eb78e0'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:44.917858 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5b34c9c9-fa96-44d5-8602-ef5920eb78e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86f7f74b0b7841b6b9775f7f67baf503', 'request_id': 'req-5b34c9c9-fa96-44d5-8602-ef5920eb78e0'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:44.929212 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5b34c9c9-fa96-44d5-8602-ef5920eb78e0 admin admin] The token cache is being invalidate because project 86f7f74b0b7841b6b9775f7f67baf503 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:37:44.929503 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5b34c9c9-fa96-44d5-8602-ef5920eb78e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:44.930135 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-5b34c9c9-fa96-44d5-8602-ef5920eb78e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:44.931688 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1024/2021] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:37:44 2022] DELETE /identity/v3/projects/86f7f74b0b7841b6b9775f7f67baf503 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:44.936760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87008a92-d8ab-42fb-9c72-f84b76b2cc1c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:44.937052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87008a92-d8ab-42fb-9c72-f84b76b2cc1c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:44.937331 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87008a92-d8ab-42fb-9c72-f84b76b2cc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:44.955519 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-87008a92-d8ab-42fb-9c72-f84b76b2cc1c None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:44.956759 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-87008a92-d8ab-42fb-9c72-f84b76b2cc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:45.020858 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 998/2022] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:45.028526 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca24251-4afa-4ecf-8056-efaf9853b560 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:45.028821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca24251-4afa-4ecf-8056-efaf9853b560 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:45.029105 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca24251-4afa-4ecf-8056-efaf9853b560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:45.047631 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-5ca24251-4afa-4ecf-8056-efaf9853b560 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:45.048841 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5ca24251-4afa-4ecf-8056-efaf9853b560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:45.057250 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1025/2023] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:45.061155 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87008a92-d8ab-42fb-9c72-f84b76b2cc1c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:45.071055 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87008a92-d8ab-42fb-9c72-f84b76b2cc1c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:45.075650 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb4ea7-0748-4809-901f-806ae929f4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:45.076330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb4ea7-0748-4809-901f-806ae929f4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:45.076612 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb4ea7-0748-4809-901f-806ae929f4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:45.076887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb4ea7-0748-4809-901f-806ae929f4a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:45.077607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb4ea7-0748-4809-901f-806ae929f4a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:45.077916 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb4ea7-0748-4809-901f-806ae929f4a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:45.079527 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb4ea7-0748-4809-901f-806ae929f4a7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:45.094183 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 999/2024] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:45.098937 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca24251-4afa-4ecf-8056-efaf9853b560 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:45.108766 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca24251-4afa-4ecf-8056-efaf9853b560 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:45.113878 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b492fdc-e667-4765-bbf3-7a9742db83c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:45.115313 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b492fdc-e667-4765-bbf3-7a9742db83c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:45.115607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b492fdc-e667-4765-bbf3-7a9742db83c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:45.115905 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b492fdc-e667-4765-bbf3-7a9742db83c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:45.116813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b492fdc-e667-4765-bbf3-7a9742db83c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:45.118817 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b492fdc-e667-4765-bbf3-7a9742db83c4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:45.145620 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1026/2025] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:37:45 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:45.150350 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb4ea7-0748-4809-901f-806ae929f4a7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:45.162155 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb4ea7-0748-4809-901f-806ae929f4a7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:45.229469 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d98bd-fa80-4cb4-b2fa-12d2eec06240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:45.230315 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d98bd-fa80-4cb4-b2fa-12d2eec06240 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:45.230676 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d98bd-fa80-4cb4-b2fa-12d2eec06240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:45.231034 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d98bd-fa80-4cb4-b2fa-12d2eec06240 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:45.231812 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d98bd-fa80-4cb4-b2fa-12d2eec06240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:45.233847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d98bd-fa80-4cb4-b2fa-12d2eec06240 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:45.251141 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:45.261365 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1000/2026] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:37:45 2022] POST /identity/v3/users => generated 303 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:45.264885 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b492fdc-e667-4765-bbf3-7a9742db83c4 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:45.272405 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:45.277058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b492fdc-e667-4765-bbf3-7a9742db83c4 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:45.283456 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812fd78-4439-49ab-bc6b-50201576e065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:45.284232 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812fd78-4439-49ab-bc6b-50201576e065 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:45.284766 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812fd78-4439-49ab-bc6b-50201576e065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:45.285042 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812fd78-4439-49ab-bc6b-50201576e065 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:45.286410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812fd78-4439-49ab-bc6b-50201576e065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:45.288081 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812fd78-4439-49ab-bc6b-50201576e065 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:45.300687 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1027/2027] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:37:45.303522 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d98bd-fa80-4cb4-b2fa-12d2eec06240 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:45.314650 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d98bd-fa80-4cb4-b2fa-12d2eec06240 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:45.319325 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe3357-8fc3-48ae-826f-536b5ba2fb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:45.319984 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe3357-8fc3-48ae-826f-536b5ba2fb9f admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:45.320271 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe3357-8fc3-48ae-826f-536b5ba2fb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:45.320574 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe3357-8fc3-48ae-826f-536b5ba2fb9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:45.321438 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe3357-8fc3-48ae-826f-536b5ba2fb9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:45.323055 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe3357-8fc3-48ae-826f-536b5ba2fb9f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:45.335799 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1001/2028] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:37:45.340222 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812fd78-4439-49ab-bc6b-50201576e065 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:45.351389 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812fd78-4439-49ab-bc6b-50201576e065 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:45.356536 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d526ede-4784-49a4-8afd-bd6f5e23414a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:45.357414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d526ede-4784-49a4-8afd-bd6f5e23414a admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:45.357703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d526ede-4784-49a4-8afd-bd6f5e23414a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:45.357985 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d526ede-4784-49a4-8afd-bd6f5e23414a admin admin] PATH_INFO: `/v3/projects/0e0fc87538344a0ebe9a83cae97ebe7e/users/cf9d4ae54ce74882adb78dbca661cdc1/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:45.373331 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d526ede-4784-49a4-8afd-bd6f5e23414a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e0fc87538344a0ebe9a83cae97ebe7e, user_id=cf9d4ae54ce74882adb78dbca661cdc1, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:45.376026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d526ede-4784-49a4-8afd-bd6f5e23414a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:45.390210 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1028/2029] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:37:45 2022] PUT /identity/v3/projects/0e0fc87538344a0ebe9a83cae97ebe7e/users/cf9d4ae54ce74882adb78dbca661cdc1/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:37:45.401763 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71b56f-c7af-4464-a757-e5eb9016a0fe None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:45.402054 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71b56f-c7af-4464-a757-e5eb9016a0fe None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:45.402359 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71b56f-c7af-4464-a757-e5eb9016a0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:45.434332 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ca71b56f-c7af-4464-a757-e5eb9016a0fe None None] MFA Rules not processed for user `cf9d4ae54ce74882adb78dbca661cdc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:45.434332 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ca71b56f-c7af-4464-a757-e5eb9016a0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:45.505466 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1002/2030] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:45 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:45.510007 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d526ede-4784-49a4-8afd-bd6f5e23414a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:45.583251 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d526ede-4784-49a4-8afd-bd6f5e23414a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:45.589298 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b367ac7-29d7-4563-8233-33738a3ad7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:45.590085 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b367ac7-29d7-4563-8233-33738a3ad7ee admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:45.590561 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b367ac7-29d7-4563-8233-33738a3ad7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:45.590821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b367ac7-29d7-4563-8233-33738a3ad7ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:45.591656 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b367ac7-29d7-4563-8233-33738a3ad7ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:45.593771 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b367ac7-29d7-4563-8233-33738a3ad7ee admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:45.633662 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1029/2031] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:37:45 2022] POST /identity/v3/projects => generated 405 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:37:45.637820 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71b56f-c7af-4464-a757-e5eb9016a0fe None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:45.650829 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71b56f-c7af-4464-a757-e5eb9016a0fe None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:45.737683 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac55db1-33b8-4e38-a1bc-9a01fcc0411e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:45.739803 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac55db1-33b8-4e38-a1bc-9a01fcc0411e admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:45.739803 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac55db1-33b8-4e38-a1bc-9a01fcc0411e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:45.739803 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac55db1-33b8-4e38-a1bc-9a01fcc0411e admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:45.740644 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac55db1-33b8-4e38-a1bc-9a01fcc0411e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:45.743093 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac55db1-33b8-4e38-a1bc-9a01fcc0411e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:45.770333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1003/2032] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:37:45 2022] POST /identity/v3/users => generated 309 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:37:45.773975 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b367ac7-29d7-4563-8233-33738a3ad7ee admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:45.787526 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b367ac7-29d7-4563-8233-33738a3ad7ee admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:45.791568 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602f1b7-d758-4d53-83a2-133258defa58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:45.792410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602f1b7-d758-4d53-83a2-133258defa58 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:45.792756 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602f1b7-d758-4d53-83a2-133258defa58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:45.793141 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602f1b7-d758-4d53-83a2-133258defa58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:45.793921 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0602f1b7-d758-4d53-83a2-133258defa58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:45.795555 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0602f1b7-d758-4d53-83a2-133258defa58 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:45.806952 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1030/2033] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:37:45.811083 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac55db1-33b8-4e38-a1bc-9a01fcc0411e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:45.821219 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac55db1-33b8-4e38-a1bc-9a01fcc0411e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:45.825970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397fb76-4581-42db-83e4-95fa2296acf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:45.826847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397fb76-4581-42db-83e4-95fa2296acf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:45.827134 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397fb76-4581-42db-83e4-95fa2296acf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:45.827414 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397fb76-4581-42db-83e4-95fa2296acf1 admin admin] PATH_INFO: `/v3/projects/58d9b5d5707942bdac23f97b04429971/users/848c51e36b414e74bd8e41429e4f2cae/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:45.842381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397fb76-4581-42db-83e4-95fa2296acf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58d9b5d5707942bdac23f97b04429971, user_id=848c51e36b414e74bd8e41429e4f2cae, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:45.845559 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397fb76-4581-42db-83e4-95fa2296acf1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:45.858606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1004/2034] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:37:45 2022] PUT /identity/v3/projects/58d9b5d5707942bdac23f97b04429971/users/848c51e36b414e74bd8e41429e4f2cae/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:37:45.862576 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602f1b7-d758-4d53-83a2-133258defa58 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:45.873236 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602f1b7-d758-4d53-83a2-133258defa58 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:45.930429 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754feceb-f7e9-4f59-9bc9-e8275130e279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:45.931092 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754feceb-f7e9-4f59-9bc9-e8275130e279 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:45.931380 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754feceb-f7e9-4f59-9bc9-e8275130e279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:45.931681 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754feceb-f7e9-4f59-9bc9-e8275130e279 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:45.932447 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754feceb-f7e9-4f59-9bc9-e8275130e279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:45.934049 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754feceb-f7e9-4f59-9bc9-e8275130e279 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:45.947370 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1031/2035] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:37:45.948693 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397fb76-4581-42db-83e4-95fa2296acf1 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:45.960896 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397fb76-4581-42db-83e4-95fa2296acf1 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:45.965743 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3ccb7-6085-4333-8131-da93d0f61d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:45.966728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3ccb7-6085-4333-8131-da93d0f61d5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:45.967075 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3ccb7-6085-4333-8131-da93d0f61d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:45.967419 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3ccb7-6085-4333-8131-da93d0f61d5a admin admin] PATH_INFO: `/v3/projects/58d9b5d5707942bdac23f97b04429971/users/848c51e36b414e74bd8e41429e4f2cae/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:45.970091 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3ccb7-6085-4333-8131-da93d0f61d5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=58d9b5d5707942bdac23f97b04429971, user_id=848c51e36b414e74bd8e41429e4f2cae, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:45.972799 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3ccb7-6085-4333-8131-da93d0f61d5a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:45.984036 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1005/2036] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:37:45 2022] PUT /identity/v3/projects/58d9b5d5707942bdac23f97b04429971/users/848c51e36b414e74bd8e41429e4f2cae/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:45.994593 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93773e29-3ff4-4b36-b356-0f265d2afa37 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:45.994975 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93773e29-3ff4-4b36-b356-0f265d2afa37 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:45.995383 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93773e29-3ff4-4b36-b356-0f265d2afa37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:46.025892 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-93773e29-3ff4-4b36-b356-0f265d2afa37 None None] MFA Rules not processed for user `848c51e36b414e74bd8e41429e4f2cae`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:46.027106 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-93773e29-3ff4-4b36-b356-0f265d2afa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:46.057784 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:46.103652 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1032/2037] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:45 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:46.114325 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3ccb7-6085-4333-8131-da93d0f61d5a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:46.116088 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-11b3ccb7-6085-4333-8131-da93d0f61d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:46.150488 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:46.174932 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3ccb7-6085-4333-8131-da93d0f61d5a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:46.178770 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce17f9-78c2-4a00-aae5-00d2b5fe4eda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:46.179409 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce17f9-78c2-4a00-aae5-00d2b5fe4eda service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:46.179694 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce17f9-78c2-4a00-aae5-00d2b5fe4eda service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:46.179977 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce17f9-78c2-4a00-aae5-00d2b5fe4eda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:46.188896 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce17f9-78c2-4a00-aae5-00d2b5fe4eda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:46.190325 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce17f9-78c2-4a00-aae5-00d2b5fe4eda service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:46.199952 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1006/2038] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:46 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:37:46.351210 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93773e29-3ff4-4b36-b356-0f265d2afa37 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:46.413118 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93773e29-3ff4-4b36-b356-0f265d2afa37 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:46.418134 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e2740-2e11-4212-ae5c-9ed81eb6f17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:46.419024 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e2740-2e11-4212-ae5c-9ed81eb6f17a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:46.419608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e2740-2e11-4212-ae5c-9ed81eb6f17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:46.420040 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e2740-2e11-4212-ae5c-9ed81eb6f17a admin admin] PATH_INFO: `/v3/users/cf9d4ae54ce74882adb78dbca661cdc1` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:46.421269 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e2740-2e11-4212-ae5c-9ed81eb6f17a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf9d4ae54ce74882adb78dbca661cdc1)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:46.423261 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e2740-2e11-4212-ae5c-9ed81eb6f17a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:46.471633 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0e1e2740-2e11-4212-ae5c-9ed81eb6f17a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf9d4ae54ce74882adb78dbca661cdc1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:46.478459 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0e1e2740-2e11-4212-ae5c-9ed81eb6f17a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf9d4ae54ce74882adb78dbca661cdc1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:46.479124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0e1e2740-2e11-4212-ae5c-9ed81eb6f17a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf9d4ae54ce74882adb78dbca661cdc1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:46.490799 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0e1e2740-2e11-4212-ae5c-9ed81eb6f17a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf9d4ae54ce74882adb78dbca661cdc1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:46.497839 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0e1e2740-2e11-4212-ae5c-9ed81eb6f17a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf9d4ae54ce74882adb78dbca661cdc1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:46.503757 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1033/2039] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:37:46 2022] DELETE /identity/v3/users/cf9d4ae54ce74882adb78dbca661cdc1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:46.508757 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4310632-e81b-4ba8-a094-a36e043157bf None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:46.509233 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4310632-e81b-4ba8-a094-a36e043157bf None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:46.509332 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4310632-e81b-4ba8-a094-a36e043157bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:46.527859 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a4310632-e81b-4ba8-a094-a36e043157bf None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:46.529088 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a4310632-e81b-4ba8-a094-a36e043157bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:46.590963 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1007/2040] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:46.600428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e2740-2e11-4212-ae5c-9ed81eb6f17a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:46.601834 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0e1e2740-2e11-4212-ae5c-9ed81eb6f17a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:46.649171 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:46.660506 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e2740-2e11-4212-ae5c-9ed81eb6f17a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:46.664171 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab8e57-54b5-40bf-ae89-b0aa44ccbf9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:46.664845 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab8e57-54b5-40bf-ae89-b0aa44ccbf9c service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:46.665129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab8e57-54b5-40bf-ae89-b0aa44ccbf9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:46.665404 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab8e57-54b5-40bf-ae89-b0aa44ccbf9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:46.675486 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab8e57-54b5-40bf-ae89-b0aa44ccbf9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:46.676962 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab8e57-54b5-40bf-ae89-b0aa44ccbf9c service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:46.686521 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1034/2041] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:37:46.971973 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4310632-e81b-4ba8-a094-a36e043157bf None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:46.973430 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a4310632-e81b-4ba8-a094-a36e043157bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:46.985116 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4310632-e81b-4ba8-a094-a36e043157bf None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:46.990187 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfcad9-bdee-4e4f-a9ca-9d6856e160f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:46.991049 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfcad9-bdee-4e4f-a9ca-9d6856e160f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:46.991329 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfcad9-bdee-4e4f-a9ca-9d6856e160f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:46.991602 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfcad9-bdee-4e4f-a9ca-9d6856e160f6 admin admin] PATH_INFO: `/v3/projects/0e0fc87538344a0ebe9a83cae97ebe7e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:46.992868 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dfcad9-bdee-4e4f-a9ca-9d6856e160f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e0fc87538344a0ebe9a83cae97ebe7e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:46.994779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dfcad9-bdee-4e4f-a9ca-9d6856e160f6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:47.043698 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-72dfcad9-bdee-4e4f-a9ca-9d6856e160f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e0fc87538344a0ebe9a83cae97ebe7e', 'request_id': 'req-72dfcad9-bdee-4e4f-a9ca-9d6856e160f6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:47.049873 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-72dfcad9-bdee-4e4f-a9ca-9d6856e160f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e0fc87538344a0ebe9a83cae97ebe7e', 'request_id': 'req-72dfcad9-bdee-4e4f-a9ca-9d6856e160f6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:47.057358 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-72dfcad9-bdee-4e4f-a9ca-9d6856e160f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e0fc87538344a0ebe9a83cae97ebe7e', 'request_id': 'req-72dfcad9-bdee-4e4f-a9ca-9d6856e160f6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:47.068923 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-72dfcad9-bdee-4e4f-a9ca-9d6856e160f6 admin admin] The token cache is being invalidate because project 0e0fc87538344a0ebe9a83cae97ebe7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:37:47.069213 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-72dfcad9-bdee-4e4f-a9ca-9d6856e160f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:47.069858 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-72dfcad9-bdee-4e4f-a9ca-9d6856e160f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:47.071401 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1008/2042] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:37:46 2022] DELETE /identity/v3/projects/0e0fc87538344a0ebe9a83cae97ebe7e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:47.075533 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab8e57-54b5-40bf-ae89-b0aa44ccbf9c service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:47.085653 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab8e57-54b5-40bf-ae89-b0aa44ccbf9c service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:47.143932 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba69a7-fd1d-44cf-ac65-d77b9e0a1dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:47.144847 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba69a7-fd1d-44cf-ac65-d77b9e0a1dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:47.145120 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba69a7-fd1d-44cf-ac65-d77b9e0a1dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:47.145393 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba69a7-fd1d-44cf-ac65-d77b9e0a1dc6 admin admin] PATH_INFO: `/v3/users/848c51e36b414e74bd8e41429e4f2cae` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:47.146584 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba69a7-fd1d-44cf-ac65-d77b9e0a1dc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=848c51e36b414e74bd8e41429e4f2cae)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:47.148590 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba69a7-fd1d-44cf-ac65-d77b9e0a1dc6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:47.196720 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7aba69a7-fd1d-44cf-ac65-d77b9e0a1dc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '848c51e36b414e74bd8e41429e4f2cae'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:47.203653 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7aba69a7-fd1d-44cf-ac65-d77b9e0a1dc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '848c51e36b414e74bd8e41429e4f2cae'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:47.204326 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7aba69a7-fd1d-44cf-ac65-d77b9e0a1dc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '848c51e36b414e74bd8e41429e4f2cae'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:47.216048 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7aba69a7-fd1d-44cf-ac65-d77b9e0a1dc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '848c51e36b414e74bd8e41429e4f2cae'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:47.224071 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7aba69a7-fd1d-44cf-ac65-d77b9e0a1dc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '848c51e36b414e74bd8e41429e4f2cae'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:47.230442 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1035/2043] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:37:47 2022] DELETE /identity/v3/users/848c51e36b414e74bd8e41429e4f2cae => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:47.499521 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfcad9-bdee-4e4f-a9ca-9d6856e160f6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:47.501117 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-72dfcad9-bdee-4e4f-a9ca-9d6856e160f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:47.514532 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfcad9-bdee-4e4f-a9ca-9d6856e160f6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:47.568434 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:47.575807 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ab2b6-535b-4ed0-b490-d14042a2a1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:47.577071 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ab2b6-535b-4ed0-b490-d14042a2a1a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:47.577535 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ab2b6-535b-4ed0-b490-d14042a2a1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:47.578027 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ab2b6-535b-4ed0-b490-d14042a2a1a7 admin admin] PATH_INFO: `/v3/projects/58d9b5d5707942bdac23f97b04429971` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:47.579362 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ab2b6-535b-4ed0-b490-d14042a2a1a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58d9b5d5707942bdac23f97b04429971)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:47.581605 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ab2b6-535b-4ed0-b490-d14042a2a1a7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:47.626330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fc5ab2b6-535b-4ed0-b490-d14042a2a1a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58d9b5d5707942bdac23f97b04429971', 'request_id': 'req-fc5ab2b6-535b-4ed0-b490-d14042a2a1a7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:47.631722 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fc5ab2b6-535b-4ed0-b490-d14042a2a1a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58d9b5d5707942bdac23f97b04429971', 'request_id': 'req-fc5ab2b6-535b-4ed0-b490-d14042a2a1a7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:47.638731 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fc5ab2b6-535b-4ed0-b490-d14042a2a1a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58d9b5d5707942bdac23f97b04429971', 'request_id': 'req-fc5ab2b6-535b-4ed0-b490-d14042a2a1a7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:47.649867 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fc5ab2b6-535b-4ed0-b490-d14042a2a1a7 admin admin] The token cache is being invalidate because project 58d9b5d5707942bdac23f97b04429971 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:37:47.650157 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fc5ab2b6-535b-4ed0-b490-d14042a2a1a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:47.650778 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fc5ab2b6-535b-4ed0-b490-d14042a2a1a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:47.652316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1009/2044] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:37:47 2022] DELETE /identity/v3/projects/58d9b5d5707942bdac23f97b04429971 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:47.657095 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a3a7d-5ac8-4b01-b740-ae9747742eb0 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:47.657547 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a3a7d-5ac8-4b01-b740-ae9747742eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:47.657776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a3a7d-5ac8-4b01-b740-ae9747742eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:47.675444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f64a3a7d-5ac8-4b01-b740-ae9747742eb0 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:47.676669 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f64a3a7d-5ac8-4b01-b740-ae9747742eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:47.737430 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1036/2045] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:37:47.745110 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36766c5-68da-4534-93b7-51d71ce5d513 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:47.745320 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36766c5-68da-4534-93b7-51d71ce5d513 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:47.745602 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36766c5-68da-4534-93b7-51d71ce5d513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:47.763732 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e36766c5-68da-4534-93b7-51d71ce5d513 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:47.764974 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e36766c5-68da-4534-93b7-51d71ce5d513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:47.773405 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1010/2046] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:47.777353 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a3a7d-5ac8-4b01-b740-ae9747742eb0 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:47.787433 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a3a7d-5ac8-4b01-b740-ae9747742eb0 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:47.791971 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d51cd0-4542-4cd2-826b-32c82c0d5175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:47.792657 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d51cd0-4542-4cd2-826b-32c82c0d5175 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:47.792944 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d51cd0-4542-4cd2-826b-32c82c0d5175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:47.793223 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d51cd0-4542-4cd2-826b-32c82c0d5175 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:47.793952 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d51cd0-4542-4cd2-826b-32c82c0d5175 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:47.794262 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d51cd0-4542-4cd2-826b-32c82c0d5175 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:47.795858 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d51cd0-4542-4cd2-826b-32c82c0d5175 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:47.797336 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:47.809444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1037/2047] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:37:47.813675 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36766c5-68da-4534-93b7-51d71ce5d513 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:47.822740 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36766c5-68da-4534-93b7-51d71ce5d513 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:47.827443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1e34e-0f38-4b22-b2eb-28dfe8f7b0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:47.828085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1e34e-0f38-4b22-b2eb-28dfe8f7b0ca admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:47.828404 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1e34e-0f38-4b22-b2eb-28dfe8f7b0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:47.828709 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1e34e-0f38-4b22-b2eb-28dfe8f7b0ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:47.829428 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1e34e-0f38-4b22-b2eb-28dfe8f7b0ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:47.831600 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1e34e-0f38-4b22-b2eb-28dfe8f7b0ca admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:47.862279 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1011/2048] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:37:47 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:47.863470 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d51cd0-4542-4cd2-826b-32c82c0d5175 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:47.870802 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1e34e-0f38-4b22-b2eb-28dfe8f7b0ca admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:47.872608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ace1e34e-0f38-4b22-b2eb-28dfe8f7b0ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:47.875077 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d51cd0-4542-4cd2-826b-32c82c0d5175 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:47.950086 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1e34e-0f38-4b22-b2eb-28dfe8f7b0ca admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:47.951972 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476e64e-8836-4f06-8a2c-d5a26b3729cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:47.952690 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476e64e-8836-4f06-8a2c-d5a26b3729cd admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:47.952980 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476e64e-8836-4f06-8a2c-d5a26b3729cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:47.953261 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476e64e-8836-4f06-8a2c-d5a26b3729cd admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:47.953987 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2476e64e-8836-4f06-8a2c-d5a26b3729cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:47.956175 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2476e64e-8836-4f06-8a2c-d5a26b3729cd admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:47.956694 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256da8cd-b6bc-4542-b1be-1b536dacc037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:47.958298 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256da8cd-b6bc-4542-b1be-1b536dacc037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:47.958641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256da8cd-b6bc-4542-b1be-1b536dacc037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:47.958981 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256da8cd-b6bc-4542-b1be-1b536dacc037 admin admin] PATH_INFO: `/v3/users/db77c883d5694787b97927f78ec0533b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:47.960260 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256da8cd-b6bc-4542-b1be-1b536dacc037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db77c883d5694787b97927f78ec0533b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:47.962272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256da8cd-b6bc-4542-b1be-1b536dacc037 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:47.981469 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1038/2049] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:37:47 2022] POST /identity/v3/users => generated 286 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:37:47.986265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476e64e-8836-4f06-8a2c-d5a26b3729cd admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:47.999700 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476e64e-8836-4f06-8a2c-d5a26b3729cd admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:48.005749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7e58f-6e9b-417f-a67e-eced38e7d1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:48.006412 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7e58f-6e9b-417f-a67e-eced38e7d1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:48.006692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7e58f-6e9b-417f-a67e-eced38e7d1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:48.006969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7e58f-6e9b-417f-a67e-eced38e7d1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:48.007720 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7e58f-6e9b-417f-a67e-eced38e7d1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:48.009597 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7e58f-6e9b-417f-a67e-eced38e7d1d7 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:48.023017 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1039/2050] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:37:48.023184 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-256da8cd-b6bc-4542-b1be-1b536dacc037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db77c883d5694787b97927f78ec0533b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:48.026744 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7e58f-6e9b-417f-a67e-eced38e7d1d7 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:48.030995 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-256da8cd-b6bc-4542-b1be-1b536dacc037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db77c883d5694787b97927f78ec0533b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:48.031717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-256da8cd-b6bc-4542-b1be-1b536dacc037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db77c883d5694787b97927f78ec0533b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:48.037558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:48.037862 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7e58f-6e9b-417f-a67e-eced38e7d1d7 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:48.043967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3595056-3609-4084-9ca9-53dab497e1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:48.044898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3595056-3609-4084-9ca9-53dab497e1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:48.045156 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3595056-3609-4084-9ca9-53dab497e1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:48.045463 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3595056-3609-4084-9ca9-53dab497e1c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:48.046197 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3595056-3609-4084-9ca9-53dab497e1c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:48.047795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3595056-3609-4084-9ca9-53dab497e1c0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:48.048828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-256da8cd-b6bc-4542-b1be-1b536dacc037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db77c883d5694787b97927f78ec0533b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:48.058285 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-256da8cd-b6bc-4542-b1be-1b536dacc037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db77c883d5694787b97927f78ec0533b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:48.063136 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1040/2051] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:37:48.064043 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3595056-3609-4084-9ca9-53dab497e1c0 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:48.066007 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b3595056-3609-4084-9ca9-53dab497e1c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:48.070716 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1012/2052] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:37:47 2022] DELETE /identity/v3/users/db77c883d5694787b97927f78ec0533b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:37:48.072148 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c214842-4b0a-4ba5-8229-db97c5be7a23 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:48.072616 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c214842-4b0a-4ba5-8229-db97c5be7a23 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:48.072997 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c214842-4b0a-4ba5-8229-db97c5be7a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:48.079592 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3595056-3609-4084-9ca9-53dab497e1c0 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:48.093415 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6c214842-4b0a-4ba5-8229-db97c5be7a23 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:48.094873 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6c214842-4b0a-4ba5-8229-db97c5be7a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:48.149931 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06f98d-dabb-43d0-9fcd-5b6e22c8b4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:48.150961 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06f98d-dabb-43d0-9fcd-5b6e22c8b4ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:48.151374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06f98d-dabb-43d0-9fcd-5b6e22c8b4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:48.151490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06f98d-dabb-43d0-9fcd-5b6e22c8b4ce admin admin] PATH_INFO: `/v3/projects/8850fba2d17b4f5b8e7eed0f41badd10/users/9e285bdea58444d68d008c3c1e0f3b79/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:48.163385 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1013/2053] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:48.169414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06f98d-dabb-43d0-9fcd-5b6e22c8b4ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=8850fba2d17b4f5b8e7eed0f41badd10, user_id=9e285bdea58444d68d008c3c1e0f3b79, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:48.172283 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06f98d-dabb-43d0-9fcd-5b6e22c8b4ce admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:48.173654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c214842-4b0a-4ba5-8229-db97c5be7a23 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:48.175016 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6c214842-4b0a-4ba5-8229-db97c5be7a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:48.199384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1041/2054] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:37:48 2022] PUT /identity/v3/projects/8850fba2d17b4f5b8e7eed0f41badd10/users/9e285bdea58444d68d008c3c1e0f3b79/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:48.211390 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d7a3a-1f1c-4387-b707-62af8003cb86 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:48.211678 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d7a3a-1f1c-4387-b707-62af8003cb86 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:48.211957 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d7a3a-1f1c-4387-b707-62af8003cb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:48.241659 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f48d7a3a-1f1c-4387-b707-62af8003cb86 None None] MFA Rules not processed for user `9e285bdea58444d68d008c3c1e0f3b79`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:48.242796 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f48d7a3a-1f1c-4387-b707-62af8003cb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:48.274307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c214842-4b0a-4ba5-8229-db97c5be7a23 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:48.290394 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:48.338691 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9bde1-c295-4514-be44-1a3e01f5bb79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:48.339281 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9bde1-c295-4514-be44-1a3e01f5bb79 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:48.339568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9bde1-c295-4514-be44-1a3e01f5bb79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:48.339842 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9bde1-c295-4514-be44-1a3e01f5bb79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:48.340273 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1042/2055] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:37:48.344712 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d7a3a-1f1c-4387-b707-62af8003cb86 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:48.399313 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:48.416688 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9bde1-c295-4514-be44-1a3e01f5bb79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:48.418258 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9bde1-c295-4514-be44-1a3e01f5bb79 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:48.430842 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d7a3a-1f1c-4387-b707-62af8003cb86 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:48.432947 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1014/2056] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:37:48.435641 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271e9a9-2fa1-4d43-908f-19a70cad6382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:48.436218 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271e9a9-2fa1-4d43-908f-19a70cad6382 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:48.436534 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271e9a9-2fa1-4d43-908f-19a70cad6382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:48.436816 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271e9a9-2fa1-4d43-908f-19a70cad6382 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:48.437708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271e9a9-2fa1-4d43-908f-19a70cad6382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:48.439415 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271e9a9-2fa1-4d43-908f-19a70cad6382 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:48.469392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1043/2057] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:37:48 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:37:48.471161 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9bde1-c295-4514-be44-1a3e01f5bb79 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:48.480834 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9bde1-c295-4514-be44-1a3e01f5bb79 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:48.539577 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cd1eb-43ec-4627-8de1-dd53e51ee2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:48.540341 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cd1eb-43ec-4627-8de1-dd53e51ee2bc admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:48.540584 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cd1eb-43ec-4627-8de1-dd53e51ee2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:48.540860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cd1eb-43ec-4627-8de1-dd53e51ee2bc admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:48.541539 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74cd1eb-43ec-4627-8de1-dd53e51ee2bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:48.543721 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74cd1eb-43ec-4627-8de1-dd53e51ee2bc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:48.569318 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1015/2058] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:37:48 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:48.570804 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271e9a9-2fa1-4d43-908f-19a70cad6382 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:48.592138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271e9a9-2fa1-4d43-908f-19a70cad6382 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:48.597353 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72eedf-4119-4d2a-8d7f-5e9c0f6fd261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:48.598051 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72eedf-4119-4d2a-8d7f-5e9c0f6fd261 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:48.598331 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72eedf-4119-4d2a-8d7f-5e9c0f6fd261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:48.598610 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72eedf-4119-4d2a-8d7f-5e9c0f6fd261 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:48.599470 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72eedf-4119-4d2a-8d7f-5e9c0f6fd261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:48.601164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72eedf-4119-4d2a-8d7f-5e9c0f6fd261 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:48.612168 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1044/2059] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:37:48.616927 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cd1eb-43ec-4627-8de1-dd53e51ee2bc admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:48.627280 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cd1eb-43ec-4627-8de1-dd53e51ee2bc admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:48.632636 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98bb5d-ab70-4947-9123-9c53ce0e8e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:48.633593 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98bb5d-ab70-4947-9123-9c53ce0e8e97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:48.633951 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98bb5d-ab70-4947-9123-9c53ce0e8e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:48.634344 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98bb5d-ab70-4947-9123-9c53ce0e8e97 admin admin] PATH_INFO: `/v3/projects/d5504c57065f4e05a3a92080cd29d353/users/11b29b04ecab45aeb820f08a38590575/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:48.649124 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98bb5d-ab70-4947-9123-9c53ce0e8e97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5504c57065f4e05a3a92080cd29d353, user_id=11b29b04ecab45aeb820f08a38590575, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:48.651918 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98bb5d-ab70-4947-9123-9c53ce0e8e97 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:48.665400 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1016/2060] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:37:48 2022] PUT /identity/v3/projects/d5504c57065f4e05a3a92080cd29d353/users/11b29b04ecab45aeb820f08a38590575/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:48.669474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72eedf-4119-4d2a-8d7f-5e9c0f6fd261 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:48.680057 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72eedf-4119-4d2a-8d7f-5e9c0f6fd261 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:48.708945 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98bb5d-ab70-4947-9123-9c53ce0e8e97 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:48.710548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5f98bb5d-ab70-4947-9123-9c53ce0e8e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:48.748440 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633f427-8610-4cf5-aaf4-8259a4e48cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:48.749204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633f427-8610-4cf5-aaf4-8259a4e48cbd admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:48.749493 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633f427-8610-4cf5-aaf4-8259a4e48cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:48.749770 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633f427-8610-4cf5-aaf4-8259a4e48cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:48.750501 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633f427-8610-4cf5-aaf4-8259a4e48cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:48.752100 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633f427-8610-4cf5-aaf4-8259a4e48cbd admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:48.765361 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1045/2061] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:37:48.766569 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633f427-8610-4cf5-aaf4-8259a4e48cbd admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:48.775958 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633f427-8610-4cf5-aaf4-8259a4e48cbd admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:48.781124 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98bb5d-ab70-4947-9123-9c53ce0e8e97 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:48.781286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c470e12-5628-4dc7-bdcc-871cf52d4549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:48.781900 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c470e12-5628-4dc7-bdcc-871cf52d4549 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:48.782183 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c470e12-5628-4dc7-bdcc-871cf52d4549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:48.782486 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c470e12-5628-4dc7-bdcc-871cf52d4549 admin admin] PATH_INFO: `/v3/projects/d5504c57065f4e05a3a92080cd29d353/users/11b29b04ecab45aeb820f08a38590575/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:48.784465 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c470e12-5628-4dc7-bdcc-871cf52d4549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5504c57065f4e05a3a92080cd29d353, user_id=11b29b04ecab45aeb820f08a38590575, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:48.786497 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d23a8-4772-480e-972a-9dd7c240a0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:48.787358 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d23a8-4772-480e-972a-9dd7c240a0b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:48.787625 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c470e12-5628-4dc7-bdcc-871cf52d4549 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:48.787728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d23a8-4772-480e-972a-9dd7c240a0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:48.787923 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d23a8-4772-480e-972a-9dd7c240a0b6 admin admin] PATH_INFO: `/v3/projects/0c414f9989094beca424f5fbe626e4fb` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:48.789119 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d23a8-4772-480e-972a-9dd7c240a0b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c414f9989094beca424f5fbe626e4fb)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:48.791114 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d23a8-4772-480e-972a-9dd7c240a0b6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:48.798267 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1046/2062] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:37:48 2022] PUT /identity/v3/projects/d5504c57065f4e05a3a92080cd29d353/users/11b29b04ecab45aeb820f08a38590575/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:37:48.809224 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88affb11-c9cd-4d91-84e3-a0e704d93b7e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:48.809509 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88affb11-c9cd-4d91-84e3-a0e704d93b7e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:48.809786 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88affb11-c9cd-4d91-84e3-a0e704d93b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:48.836508 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-88affb11-c9cd-4d91-84e3-a0e704d93b7e None None] MFA Rules not processed for user `11b29b04ecab45aeb820f08a38590575`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:48.837700 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-88affb11-c9cd-4d91-84e3-a0e704d93b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:48.840078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c23d23a8-4772-480e-972a-9dd7c240a0b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c414f9989094beca424f5fbe626e4fb', 'request_id': 'req-c23d23a8-4772-480e-972a-9dd7c240a0b6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:48.842156 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:48.846390 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c23d23a8-4772-480e-972a-9dd7c240a0b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c414f9989094beca424f5fbe626e4fb', 'request_id': 'req-c23d23a8-4772-480e-972a-9dd7c240a0b6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:48.855317 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c23d23a8-4772-480e-972a-9dd7c240a0b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c414f9989094beca424f5fbe626e4fb', 'request_id': 'req-c23d23a8-4772-480e-972a-9dd7c240a0b6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:48.858148 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:48.868520 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c23d23a8-4772-480e-972a-9dd7c240a0b6 admin admin] The token cache is being invalidate because project 0c414f9989094beca424f5fbe626e4fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:37:48.868808 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c23d23a8-4772-480e-972a-9dd7c240a0b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:48.869621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c23d23a8-4772-480e-972a-9dd7c240a0b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:48.872918 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1017/2063] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:37:48 2022] DELETE /identity/v3/projects/0c414f9989094beca424f5fbe626e4fb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:37:48.878478 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d57c4-d5f2-486d-b033-b719fb828921 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:48.878757 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d57c4-d5f2-486d-b033-b719fb828921 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:48.879038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d57c4-d5f2-486d-b033-b719fb828921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:48.897094 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3c2d57c4-d5f2-486d-b033-b719fb828921 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:48.898303 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3c2d57c4-d5f2-486d-b033-b719fb828921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:48.915649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1047/2064] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:37:48.927625 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88affb11-c9cd-4d91-84e3-a0e704d93b7e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:48.928969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-88affb11-c9cd-4d91-84e3-a0e704d93b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:48.961065 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1018/2065] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:48.968423 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a5d10-7cf9-4a25-ab6f-57e05d99378d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:48.968716 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a5d10-7cf9-4a25-ab6f-57e05d99378d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:48.968995 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a5d10-7cf9-4a25-ab6f-57e05d99378d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:48.990653 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7c0a5d10-7cf9-4a25-ab6f-57e05d99378d None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:48.991865 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7c0a5d10-7cf9-4a25-ab6f-57e05d99378d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:48.995034 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88affb11-c9cd-4d91-84e3-a0e704d93b7e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:48.998608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d6596-8b4f-4e19-9668-e26aa1a1a780 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:48.999267 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d6596-8b4f-4e19-9668-e26aa1a1a780 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:48.999551 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d6596-8b4f-4e19-9668-e26aa1a1a780 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:48.999811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1019/2066] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:37:48.999905 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d6596-8b4f-4e19-9668-e26aa1a1a780 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:49.003767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a5d10-7cf9-4a25-ab6f-57e05d99378d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:49.009395 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d6596-8b4f-4e19-9668-e26aa1a1a780 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:49.010848 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d6596-8b4f-4e19-9668-e26aa1a1a780 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:49.013298 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a5d10-7cf9-4a25-ab6f-57e05d99378d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:49.020351 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc82c9-06cd-4255-8f18-0fefc302940a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:49.021023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc82c9-06cd-4255-8f18-0fefc302940a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:49.021135 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1048/2067] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:37:49.021315 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc82c9-06cd-4255-8f18-0fefc302940a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:49.021587 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc82c9-06cd-4255-8f18-0fefc302940a admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:49.022311 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc82c9-06cd-4255-8f18-0fefc302940a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:49.022617 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc82c9-06cd-4255-8f18-0fefc302940a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:49.024220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc82c9-06cd-4255-8f18-0fefc302940a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:49.039030 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1020/2068] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:37:49.042384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d6596-8b4f-4e19-9668-e26aa1a1a780 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:49.053375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d6596-8b4f-4e19-9668-e26aa1a1a780 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:49.058030 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28807e3-5ee3-4fa7-92c9-97b1273b9cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:49.058675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28807e3-5ee3-4fa7-92c9-97b1273b9cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:49.058955 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28807e3-5ee3-4fa7-92c9-97b1273b9cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:49.059228 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28807e3-5ee3-4fa7-92c9-97b1273b9cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:49.059914 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28807e3-5ee3-4fa7-92c9-97b1273b9cb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:49.061822 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28807e3-5ee3-4fa7-92c9-97b1273b9cb5 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:49.088497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1049/2069] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:37:49 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:49.092116 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc82c9-06cd-4255-8f18-0fefc302940a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:49.102611 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc82c9-06cd-4255-8f18-0fefc302940a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:49.165561 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9b0ff-2d7d-4d99-a361-bc3208a2bfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:49.166240 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9b0ff-2d7d-4d99-a361-bc3208a2bfe6 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:49.166528 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9b0ff-2d7d-4d99-a361-bc3208a2bfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:49.166810 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9b0ff-2d7d-4d99-a361-bc3208a2bfe6 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:49.167517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9b0ff-2d7d-4d99-a361-bc3208a2bfe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:49.169768 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9b0ff-2d7d-4d99-a361-bc3208a2bfe6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:49.194342 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1021/2070] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:37:49 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:49.195479 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28807e3-5ee3-4fa7-92c9-97b1273b9cb5 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:49.206282 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28807e3-5ee3-4fa7-92c9-97b1273b9cb5 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:49.211612 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643fd11-c317-44a4-b9f8-045184140980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:49.212276 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643fd11-c317-44a4-b9f8-045184140980 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:49.212610 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643fd11-c317-44a4-b9f8-045184140980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:49.212913 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643fd11-c317-44a4-b9f8-045184140980 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:49.213734 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643fd11-c317-44a4-b9f8-045184140980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:49.215351 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643fd11-c317-44a4-b9f8-045184140980 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:49.229617 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1050/2071] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:37:49.230780 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9b0ff-2d7d-4d99-a361-bc3208a2bfe6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:49.241107 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9b0ff-2d7d-4d99-a361-bc3208a2bfe6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:49.248612 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbbb92-8038-44f9-860e-367944f6028e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:49.249395 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbbb92-8038-44f9-860e-367944f6028e admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:49.249685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbbb92-8038-44f9-860e-367944f6028e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:49.250252 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbbb92-8038-44f9-860e-367944f6028e admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:49.250966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fbbb92-8038-44f9-860e-367944f6028e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:49.252913 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fbbb92-8038-44f9-860e-367944f6028e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:49.267053 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1022/2072] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:37:49.271351 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643fd11-c317-44a4-b9f8-045184140980 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:49.282749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643fd11-c317-44a4-b9f8-045184140980 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:49.292999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c6778-3f19-42ec-953b-65b045b4fa0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:49.294209 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c6778-3f19-42ec-953b-65b045b4fa0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:49.294500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c6778-3f19-42ec-953b-65b045b4fa0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:49.294779 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c6778-3f19-42ec-953b-65b045b4fa0d admin admin] PATH_INFO: `/v3/projects/ab5827c9a24b46c2bc87931928d3adda/users/5a57e55f8a0b4ae2b63a8c8d9e98bc71/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:49.310973 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c6778-3f19-42ec-953b-65b045b4fa0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab5827c9a24b46c2bc87931928d3adda, user_id=5a57e55f8a0b4ae2b63a8c8d9e98bc71, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:49.314124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c6778-3f19-42ec-953b-65b045b4fa0d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:49.327790 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1051/2073] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:37:49 2022] PUT /identity/v3/projects/ab5827c9a24b46c2bc87931928d3adda/users/5a57e55f8a0b4ae2b63a8c8d9e98bc71/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:37:49.343624 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b2c36-62a4-4571-b9c6-3f9b0889569a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:49.344696 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b2c36-62a4-4571-b9c6-3f9b0889569a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:49.345090 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b2c36-62a4-4571-b9c6-3f9b0889569a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:49.383532 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-213b2c36-62a4-4571-b9c6-3f9b0889569a None None] MFA Rules not processed for user `5a57e55f8a0b4ae2b63a8c8d9e98bc71`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:49.384904 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-213b2c36-62a4-4571-b9c6-3f9b0889569a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:49.421951 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:49.435166 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c6778-3f19-42ec-953b-65b045b4fa0d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:49.440820 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7e7c6778-3f19-42ec-953b-65b045b4fa0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:49.474938 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1023/2074] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:37:49.480500 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b2c36-62a4-4571-b9c6-3f9b0889569a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:49.517420 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c6778-3f19-42ec-953b-65b045b4fa0d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:49.524823 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5d614-4968-4036-8591-e98b40e27ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:49.527875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5d614-4968-4036-8591-e98b40e27ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:49.528414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5d614-4968-4036-8591-e98b40e27ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:49.528785 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5d614-4968-4036-8591-e98b40e27ccc admin admin] PATH_INFO: `/v3/users/9e285bdea58444d68d008c3c1e0f3b79` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:49.530179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5d614-4968-4036-8591-e98b40e27ccc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e285bdea58444d68d008c3c1e0f3b79)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:49.532803 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5d614-4968-4036-8591-e98b40e27ccc admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:49.536094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:49.570521 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b2c36-62a4-4571-b9c6-3f9b0889569a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:49.578202 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0e65a-1e46-4f3b-9cbd-b9d4cd1b3f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:49.579114 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0e65a-1e46-4f3b-9cbd-b9d4cd1b3f9e admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:49.579926 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0e65a-1e46-4f3b-9cbd-b9d4cd1b3f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:49.580418 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0e65a-1e46-4f3b-9cbd-b9d4cd1b3f9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:49.581342 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0e65a-1e46-4f3b-9cbd-b9d4cd1b3f9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:49.585122 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0e65a-1e46-4f3b-9cbd-b9d4cd1b3f9e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:49.615967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1ea5d614-4968-4036-8591-e98b40e27ccc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e285bdea58444d68d008c3c1e0f3b79'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:49.623329 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1ea5d614-4968-4036-8591-e98b40e27ccc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e285bdea58444d68d008c3c1e0f3b79'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:49.624286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1ea5d614-4968-4036-8591-e98b40e27ccc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e285bdea58444d68d008c3c1e0f3b79'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:49.640834 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1ea5d614-4968-4036-8591-e98b40e27ccc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e285bdea58444d68d008c3c1e0f3b79'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:49.649182 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1024/2075] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:37:49 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:49.651141 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1ea5d614-4968-4036-8591-e98b40e27ccc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e285bdea58444d68d008c3c1e0f3b79'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:49.653166 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0e65a-1e46-4f3b-9cbd-b9d4cd1b3f9e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:49.655525 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-53f0e65a-1e46-4f3b-9cbd-b9d4cd1b3f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:49.667809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1052/2076] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:37:49 2022] DELETE /identity/v3/users/9e285bdea58444d68d008c3c1e0f3b79 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:49.667809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604cb90-9c1c-41d6-a01c-634b1aea23ed None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:49.667809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604cb90-9c1c-41d6-a01c-634b1aea23ed None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:49.667809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604cb90-9c1c-41d6-a01c-634b1aea23ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:49.684528 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3604cb90-9c1c-41d6-a01c-634b1aea23ed None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:49.686370 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3604cb90-9c1c-41d6-a01c-634b1aea23ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:49.740250 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0e65a-1e46-4f3b-9cbd-b9d4cd1b3f9e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:49.753467 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1053/2077] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:37:49.763453 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604cb90-9c1c-41d6-a01c-634b1aea23ed None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:49.764999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3604cb90-9c1c-41d6-a01c-634b1aea23ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:49.798407 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974d51e-362d-499d-b110-4f6c70b8093f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:49.799083 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974d51e-362d-499d-b110-4f6c70b8093f admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:49.799374 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974d51e-362d-499d-b110-4f6c70b8093f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:49.799653 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974d51e-362d-499d-b110-4f6c70b8093f admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:49.800448 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974d51e-362d-499d-b110-4f6c70b8093f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:49.802421 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974d51e-362d-499d-b110-4f6c70b8093f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:49.810058 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:49.827442 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1025/2078] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:37:49 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:49.827623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604cb90-9c1c-41d6-a01c-634b1aea23ed None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:49.828470 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974d51e-362d-499d-b110-4f6c70b8093f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:49.830088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeda21b-4ccd-4946-8a51-4618f52a09d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:49.830803 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeda21b-4ccd-4946-8a51-4618f52a09d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:49.831097 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeda21b-4ccd-4946-8a51-4618f52a09d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:49.831389 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeda21b-4ccd-4946-8a51-4618f52a09d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:49.839772 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974d51e-362d-499d-b110-4f6c70b8093f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:49.841237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeda21b-4ccd-4946-8a51-4618f52a09d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:49.842678 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeda21b-4ccd-4946-8a51-4618f52a09d1 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:49.844823 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d386c7-40d5-493b-a9ac-7b99ac6fc0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:49.845593 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d386c7-40d5-493b-a9ac-7b99ac6fc0fa admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:49.845923 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d386c7-40d5-493b-a9ac-7b99ac6fc0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:49.846272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d386c7-40d5-493b-a9ac-7b99ac6fc0fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:49.846999 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d386c7-40d5-493b-a9ac-7b99ac6fc0fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:49.848639 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d386c7-40d5-493b-a9ac-7b99ac6fc0fa admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:49.852660 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1054/2079] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:37:49.862888 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1026/2080] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:37:49.868048 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeda21b-4ccd-4946-8a51-4618f52a09d1 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:49.878369 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeda21b-4ccd-4946-8a51-4618f52a09d1 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:49.883695 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118da49-937f-4a08-9aa7-b9ebe96b70df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:49.884378 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118da49-937f-4a08-9aa7-b9ebe96b70df admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:49.884670 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118da49-937f-4a08-9aa7-b9ebe96b70df admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:49.884978 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118da49-937f-4a08-9aa7-b9ebe96b70df admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:49.885710 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118da49-937f-4a08-9aa7-b9ebe96b70df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:49.887335 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118da49-937f-4a08-9aa7-b9ebe96b70df admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:49.898474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1055/2081] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:37:49.902962 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d386c7-40d5-493b-a9ac-7b99ac6fc0fa admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:49.914683 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d386c7-40d5-493b-a9ac-7b99ac6fc0fa admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:49.920348 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff753c5a-af25-4aee-baa1-d25b3d31017c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:49.921456 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff753c5a-af25-4aee-baa1-d25b3d31017c admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:49.921813 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff753c5a-af25-4aee-baa1-d25b3d31017c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:49.922098 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff753c5a-af25-4aee-baa1-d25b3d31017c admin admin] PATH_INFO: `/v3/projects/83e197209db54e5d8d6413c03b6287b8/users/a3b1ac65a82d4e789d345a3367f87b13/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:49.938206 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff753c5a-af25-4aee-baa1-d25b3d31017c admin admin] RBAC: Authorizing `identity:create_grant(project_id=83e197209db54e5d8d6413c03b6287b8, user_id=a3b1ac65a82d4e789d345a3367f87b13, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:49.940945 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff753c5a-af25-4aee-baa1-d25b3d31017c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:49.955652 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1027/2082] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:37:49 2022] PUT /identity/v3/projects/83e197209db54e5d8d6413c03b6287b8/users/a3b1ac65a82d4e789d345a3367f87b13/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:49.965855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f6ab7-219d-4495-915b-3510fab1d3f5 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:49.966135 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f6ab7-219d-4495-915b-3510fab1d3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:49.966417 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f6ab7-219d-4495-915b-3510fab1d3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:49.990394 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:49.995000 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-1a9f6ab7-219d-4495-915b-3510fab1d3f5 None None] MFA Rules not processed for user `a3b1ac65a82d4e789d345a3367f87b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:49.996484 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1a9f6ab7-219d-4495-915b-3510fab1d3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:50.086086 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1056/2083] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:50.090463 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff753c5a-af25-4aee-baa1-d25b3d31017c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:50.142209 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f6ab7-219d-4495-915b-3510fab1d3f5 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:50.143745 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1a9f6ab7-219d-4495-915b-3510fab1d3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:50.161553 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff753c5a-af25-4aee-baa1-d25b3d31017c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:50.168018 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53483303-418a-41ab-a9e1-c262922e0cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:50.168826 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53483303-418a-41ab-a9e1-c262922e0cda admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:50.169011 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53483303-418a-41ab-a9e1-c262922e0cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:50.169293 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53483303-418a-41ab-a9e1-c262922e0cda admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:50.170439 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53483303-418a-41ab-a9e1-c262922e0cda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:50.172709 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53483303-418a-41ab-a9e1-c262922e0cda admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:50.202709 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1028/2084] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:37:50 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:50.204571 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53483303-418a-41ab-a9e1-c262922e0cda admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:50.217545 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f6ab7-219d-4495-915b-3510fab1d3f5 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:50.267761 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53483303-418a-41ab-a9e1-c262922e0cda admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:50.273066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c5a37-831b-406c-9efc-d3ef28024e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:50.273736 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c5a37-831b-406c-9efc-d3ef28024e11 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:50.273912 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166a926-e159-41bf-b688-4874d492c5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:50.274050 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c5a37-831b-406c-9efc-d3ef28024e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:50.274291 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c5a37-831b-406c-9efc-d3ef28024e11 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:50.274772 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166a926-e159-41bf-b688-4874d492c5a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:50.274984 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c5a37-831b-406c-9efc-d3ef28024e11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:50.275089 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166a926-e159-41bf-b688-4874d492c5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:50.275323 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166a926-e159-41bf-b688-4874d492c5a5 admin admin] PATH_INFO: `/v3/projects/8850fba2d17b4f5b8e7eed0f41badd10` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:50.276553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166a926-e159-41bf-b688-4874d492c5a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8850fba2d17b4f5b8e7eed0f41badd10)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:50.276976 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c5a37-831b-406c-9efc-d3ef28024e11 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:50.278471 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166a926-e159-41bf-b688-4874d492c5a5 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:50.296760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1029/2085] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:37:50 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:50.300888 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c5a37-831b-406c-9efc-d3ef28024e11 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:50.311298 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c5a37-831b-406c-9efc-d3ef28024e11 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:50.324954 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a166a926-e159-41bf-b688-4874d492c5a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8850fba2d17b4f5b8e7eed0f41badd10', 'request_id': 'req-a166a926-e159-41bf-b688-4874d492c5a5'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:50.327357 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:50.335256 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a166a926-e159-41bf-b688-4874d492c5a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8850fba2d17b4f5b8e7eed0f41badd10', 'request_id': 'req-a166a926-e159-41bf-b688-4874d492c5a5'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:50.342705 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a166a926-e159-41bf-b688-4874d492c5a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8850fba2d17b4f5b8e7eed0f41badd10', 'request_id': 'req-a166a926-e159-41bf-b688-4874d492c5a5'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:50.343435 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:50.355596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a166a926-e159-41bf-b688-4874d492c5a5 admin admin] The token cache is being invalidate because project 8850fba2d17b4f5b8e7eed0f41badd10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:37:50.355910 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a166a926-e159-41bf-b688-4874d492c5a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:50.356663 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a166a926-e159-41bf-b688-4874d492c5a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:50.358212 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1057/2086] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:37:50 2022] DELETE /identity/v3/projects/8850fba2d17b4f5b8e7eed0f41badd10 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:37:50.362509 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166a926-e159-41bf-b688-4874d492c5a5 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:50.363955 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a166a926-e159-41bf-b688-4874d492c5a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:50.373615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d09f1d-32cd-406a-bda4-9d1f00c73c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:50.374291 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d09f1d-32cd-406a-bda4-9d1f00c73c75 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:50.374576 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d09f1d-32cd-406a-bda4-9d1f00c73c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:50.374893 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d09f1d-32cd-406a-bda4-9d1f00c73c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:50.375649 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d09f1d-32cd-406a-bda4-9d1f00c73c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:50.377312 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d09f1d-32cd-406a-bda4-9d1f00c73c75 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:50.391020 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1030/2087] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:37:50.392017 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d09f1d-32cd-406a-bda4-9d1f00c73c75 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:50.393794 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-57d09f1d-32cd-406a-bda4-9d1f00c73c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:50.406518 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d09f1d-32cd-406a-bda4-9d1f00c73c75 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:50.411313 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a743b3-efbf-47b2-9d2b-f9ec1805bc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:50.412175 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a743b3-efbf-47b2-9d2b-f9ec1805bc90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:50.412507 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a743b3-efbf-47b2-9d2b-f9ec1805bc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:50.412777 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a743b3-efbf-47b2-9d2b-f9ec1805bc90 admin admin] PATH_INFO: `/v3/projects/1fe22a60b5364f15b92211e4e80d2d28/users/0ebc9364ed4646bd901f1740ac12095e/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:50.427747 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a743b3-efbf-47b2-9d2b-f9ec1805bc90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fe22a60b5364f15b92211e4e80d2d28, user_id=0ebc9364ed4646bd901f1740ac12095e, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:50.427899 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166a926-e159-41bf-b688-4874d492c5a5 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:50.430478 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a743b3-efbf-47b2-9d2b-f9ec1805bc90 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:50.432544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63003c-5106-475e-9836-7ab7487fe1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:50.433406 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63003c-5106-475e-9836-7ab7487fe1e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:50.433686 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63003c-5106-475e-9836-7ab7487fe1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:50.433959 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63003c-5106-475e-9836-7ab7487fe1e8 admin admin] PATH_INFO: `/v3/users/11b29b04ecab45aeb820f08a38590575` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:50.435269 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63003c-5106-475e-9836-7ab7487fe1e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11b29b04ecab45aeb820f08a38590575)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:50.437399 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63003c-5106-475e-9836-7ab7487fe1e8 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:50.445206 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1031/2088] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:37:50 2022] PUT /identity/v3/projects/1fe22a60b5364f15b92211e4e80d2d28/users/0ebc9364ed4646bd901f1740ac12095e/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:37:50.449180 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a743b3-efbf-47b2-9d2b-f9ec1805bc90 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:50.485981 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9b63003c-5106-475e-9836-7ab7487fe1e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11b29b04ecab45aeb820f08a38590575'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:50.492925 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9b63003c-5106-475e-9836-7ab7487fe1e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11b29b04ecab45aeb820f08a38590575'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:50.493635 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9b63003c-5106-475e-9836-7ab7487fe1e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11b29b04ecab45aeb820f08a38590575'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:50.506176 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9b63003c-5106-475e-9836-7ab7487fe1e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11b29b04ecab45aeb820f08a38590575'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:50.513474 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a743b3-efbf-47b2-9d2b-f9ec1805bc90 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:50.513782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9b63003c-5106-475e-9836-7ab7487fe1e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11b29b04ecab45aeb820f08a38590575'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:50.518317 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0734f-b63b-4edf-b98d-bd1691f450b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:50.518972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0734f-b63b-4edf-b98d-bd1691f450b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:50.519252 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0734f-b63b-4edf-b98d-bd1691f450b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:50.519524 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0734f-b63b-4edf-b98d-bd1691f450b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:50.520590 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1058/2089] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:37:50 2022] DELETE /identity/v3/users/11b29b04ecab45aeb820f08a38590575 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:37:50.520830 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0734f-b63b-4edf-b98d-bd1691f450b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:50.522442 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0734f-b63b-4edf-b98d-bd1691f450b3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:50.535648 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1032/2090] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:37:50.536906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63003c-5106-475e-9836-7ab7487fe1e8 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:50.538386 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9b63003c-5106-475e-9836-7ab7487fe1e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:50.605906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63003c-5106-475e-9836-7ab7487fe1e8 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:50.610598 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094341a3-079e-4bd2-a94a-b023b8ca8c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:50.611483 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094341a3-079e-4bd2-a94a-b023b8ca8c2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:50.611770 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094341a3-079e-4bd2-a94a-b023b8ca8c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:50.612047 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094341a3-079e-4bd2-a94a-b023b8ca8c2d admin admin] PATH_INFO: `/v3/projects/1fe22a60b5364f15b92211e4e80d2d28/users/0ebc9364ed4646bd901f1740ac12095e/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:50.614603 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094341a3-079e-4bd2-a94a-b023b8ca8c2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fe22a60b5364f15b92211e4e80d2d28, user_id=0ebc9364ed4646bd901f1740ac12095e, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:50.617321 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094341a3-079e-4bd2-a94a-b023b8ca8c2d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:50.619752 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:50.630535 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1059/2091] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:37:50 2022] PUT /identity/v3/projects/1fe22a60b5364f15b92211e4e80d2d28/users/0ebc9364ed4646bd901f1740ac12095e/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:50.640618 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1062f5-2b74-4916-ba9e-dbe91ab46b11 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:50.641146 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1062f5-2b74-4916-ba9e-dbe91ab46b11 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:50.641146 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1062f5-2b74-4916-ba9e-dbe91ab46b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:50.671072 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9b1062f5-2b74-4916-ba9e-dbe91ab46b11 None None] MFA Rules not processed for user `0ebc9364ed4646bd901f1740ac12095e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:50.672477 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9b1062f5-2b74-4916-ba9e-dbe91ab46b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:50.761320 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1033/2092] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:50.773178 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094341a3-079e-4bd2-a94a-b023b8ca8c2d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:50.775611 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-094341a3-079e-4bd2-a94a-b023b8ca8c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:50.826730 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1062f5-2b74-4916-ba9e-dbe91ab46b11 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:50.828374 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9b1062f5-2b74-4916-ba9e-dbe91ab46b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:50.859711 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094341a3-079e-4bd2-a94a-b023b8ca8c2d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:50.862193 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:50.864553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902d09b-d0af-43f1-9c74-a0160fa1e774 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:50.865274 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902d09b-d0af-43f1-9c74-a0160fa1e774 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:50.865555 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902d09b-d0af-43f1-9c74-a0160fa1e774 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:50.865825 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902d09b-d0af-43f1-9c74-a0160fa1e774 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:50.868521 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c902d09b-d0af-43f1-9c74-a0160fa1e774 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:50.904743 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1062f5-2b74-4916-ba9e-dbe91ab46b11 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:50.909437 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b1505-42e3-40dc-b464-66dad2e1c0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:50.910291 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b1505-42e3-40dc-b464-66dad2e1c0eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:50.910609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b1505-42e3-40dc-b464-66dad2e1c0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:50.910882 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b1505-42e3-40dc-b464-66dad2e1c0eb admin admin] PATH_INFO: `/v3/projects/d5504c57065f4e05a3a92080cd29d353` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:50.912080 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b1505-42e3-40dc-b464-66dad2e1c0eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5504c57065f4e05a3a92080cd29d353)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:50.914042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b1505-42e3-40dc-b464-66dad2e1c0eb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:50.929973 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902d09b-d0af-43f1-9c74-a0160fa1e774 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:50.931409 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902d09b-d0af-43f1-9c74-a0160fa1e774 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:50.940518 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1060/2093] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:37:50.963388 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c70b1505-42e3-40dc-b464-66dad2e1c0eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5504c57065f4e05a3a92080cd29d353', 'request_id': 'req-c70b1505-42e3-40dc-b464-66dad2e1c0eb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:50.968764 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c70b1505-42e3-40dc-b464-66dad2e1c0eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5504c57065f4e05a3a92080cd29d353', 'request_id': 'req-c70b1505-42e3-40dc-b464-66dad2e1c0eb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:50.977269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c70b1505-42e3-40dc-b464-66dad2e1c0eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5504c57065f4e05a3a92080cd29d353', 'request_id': 'req-c70b1505-42e3-40dc-b464-66dad2e1c0eb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:50.988600 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c70b1505-42e3-40dc-b464-66dad2e1c0eb admin admin] The token cache is being invalidate because project d5504c57065f4e05a3a92080cd29d353 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:37:50.989399 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c70b1505-42e3-40dc-b464-66dad2e1c0eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:50.990081 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c70b1505-42e3-40dc-b464-66dad2e1c0eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:50.991640 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1034/2094] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:37:50 2022] DELETE /identity/v3/projects/d5504c57065f4e05a3a92080cd29d353 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:37:50.996747 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3da43-d40a-445c-b8a6-72e0b3396866 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:50.997043 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3da43-d40a-445c-b8a6-72e0b3396866 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:50.997329 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3da43-d40a-445c-b8a6-72e0b3396866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:51.016524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-adc3da43-d40a-445c-b8a6-72e0b3396866 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:51.017789 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-adc3da43-d40a-445c-b8a6-72e0b3396866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:51.081039 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1061/2095] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:51.091562 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f9a31-18a3-44c1-bfc1-7b592429d5bc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:51.091997 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f9a31-18a3-44c1-bfc1-7b592429d5bc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:51.092357 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f9a31-18a3-44c1-bfc1-7b592429d5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:51.117397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-494f9a31-18a3-44c1-bfc1-7b592429d5bc None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:51.118609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-494f9a31-18a3-44c1-bfc1-7b592429d5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:51.126888 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1035/2096] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:51.131394 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3da43-d40a-445c-b8a6-72e0b3396866 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:51.141395 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3da43-d40a-445c-b8a6-72e0b3396866 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:51.147405 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00f7b0-6497-41da-b67b-924d7cf5fdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:51.148063 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00f7b0-6497-41da-b67b-924d7cf5fdaa admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:51.148376 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00f7b0-6497-41da-b67b-924d7cf5fdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:51.148655 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00f7b0-6497-41da-b67b-924d7cf5fdaa admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:51.149400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00f7b0-6497-41da-b67b-924d7cf5fdaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:51.149713 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00f7b0-6497-41da-b67b-924d7cf5fdaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:51.152102 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00f7b0-6497-41da-b67b-924d7cf5fdaa admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:51.165715 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1062/2097] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:51.170279 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f9a31-18a3-44c1-bfc1-7b592429d5bc None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:51.181868 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f9a31-18a3-44c1-bfc1-7b592429d5bc None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:51.186748 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08312ba-cd33-44e4-820b-a35fd3850cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:51.187473 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08312ba-cd33-44e4-820b-a35fd3850cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:51.187767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08312ba-cd33-44e4-820b-a35fd3850cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:51.188046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08312ba-cd33-44e4-820b-a35fd3850cf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:51.188802 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08312ba-cd33-44e4-820b-a35fd3850cf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:51.190768 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08312ba-cd33-44e4-820b-a35fd3850cf1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:51.228783 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1036/2098] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:37:51 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:51.229873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00f7b0-6497-41da-b67b-924d7cf5fdaa admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:51.243876 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00f7b0-6497-41da-b67b-924d7cf5fdaa admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:51.283499 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:51.310479 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d669639-6431-4adb-b061-67184ba87026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:51.311134 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d669639-6431-4adb-b061-67184ba87026 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:51.311414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d669639-6431-4adb-b061-67184ba87026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:51.311687 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d669639-6431-4adb-b061-67184ba87026 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:51.312410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d669639-6431-4adb-b061-67184ba87026 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:51.314321 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d669639-6431-4adb-b061-67184ba87026 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:51.333716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1063/2099] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:37:51 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:51.337974 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08312ba-cd33-44e4-820b-a35fd3850cf1 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:51.349066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08312ba-cd33-44e4-820b-a35fd3850cf1 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:51.354096 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5a626-cb0d-4952-82d8-1ac7b5f5e909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:51.354751 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5a626-cb0d-4952-82d8-1ac7b5f5e909 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:51.355044 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5a626-cb0d-4952-82d8-1ac7b5f5e909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:51.355315 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5a626-cb0d-4952-82d8-1ac7b5f5e909 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:51.356041 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd5a626-cb0d-4952-82d8-1ac7b5f5e909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:51.357726 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd5a626-cb0d-4952-82d8-1ac7b5f5e909 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:51.368349 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1037/2100] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:37:51.372538 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d669639-6431-4adb-b061-67184ba87026 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:51.382529 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d669639-6431-4adb-b061-67184ba87026 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:51.387101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e8342-4b82-44a1-8b9b-bcbc0f932bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:51.387747 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e8342-4b82-44a1-8b9b-bcbc0f932bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:51.388031 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e8342-4b82-44a1-8b9b-bcbc0f932bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:51.388362 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e8342-4b82-44a1-8b9b-bcbc0f932bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:51.389062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e8342-4b82-44a1-8b9b-bcbc0f932bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:51.390637 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e8342-4b82-44a1-8b9b-bcbc0f932bc0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:51.401508 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1064/2101] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:37:51.405510 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5a626-cb0d-4952-82d8-1ac7b5f5e909 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:51.415765 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5a626-cb0d-4952-82d8-1ac7b5f5e909 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:51.420559 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fd571-802a-402d-83a6-f38db64ad6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:51.421429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fd571-802a-402d-83a6-f38db64ad6af admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:51.421718 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fd571-802a-402d-83a6-f38db64ad6af admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:51.421998 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fd571-802a-402d-83a6-f38db64ad6af admin admin] PATH_INFO: `/v3/projects/3c033eefe4a1459e989cc8676f0b9731/users/4fe46a4e4d9b471a979cf21fbc01969e/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:51.436292 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553fd571-802a-402d-83a6-f38db64ad6af admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c033eefe4a1459e989cc8676f0b9731, user_id=4fe46a4e4d9b471a979cf21fbc01969e, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:51.438973 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553fd571-802a-402d-83a6-f38db64ad6af admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:51.452267 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1038/2102] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:37:51 2022] PUT /identity/v3/projects/3c033eefe4a1459e989cc8676f0b9731/users/4fe46a4e4d9b471a979cf21fbc01969e/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:51.463127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2c05a-45f6-430e-81d2-5602ff3d5504 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:51.463420 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2c05a-45f6-430e-81d2-5602ff3d5504 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:51.463732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2c05a-45f6-430e-81d2-5602ff3d5504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:51.491138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-79b2c05a-45f6-430e-81d2-5602ff3d5504 None None] MFA Rules not processed for user `4fe46a4e4d9b471a979cf21fbc01969e`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:51.492387 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-79b2c05a-45f6-430e-81d2-5602ff3d5504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:51.559056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1065/2103] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:51.563640 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fd571-802a-402d-83a6-f38db64ad6af admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:51.616357 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:51.628674 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fd571-802a-402d-83a6-f38db64ad6af admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:51.633513 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0520288-0a1f-4f57-a08a-07916c5422b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:51.634168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0520288-0a1f-4f57-a08a-07916c5422b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:51.634445 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0520288-0a1f-4f57-a08a-07916c5422b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:51.634720 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0520288-0a1f-4f57-a08a-07916c5422b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:51.635405 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0520288-0a1f-4f57-a08a-07916c5422b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:51.637377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0520288-0a1f-4f57-a08a-07916c5422b4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:51.665780 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1039/2104] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:37:51 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:51.670000 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2c05a-45f6-430e-81d2-5602ff3d5504 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:51.680811 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2c05a-45f6-430e-81d2-5602ff3d5504 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:51.736812 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8ace5-60e7-4f4d-ba37-f59f87a117c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:51.737478 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8ace5-60e7-4f4d-ba37-f59f87a117c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:51.737761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8ace5-60e7-4f4d-ba37-f59f87a117c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:51.738038 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8ace5-60e7-4f4d-ba37-f59f87a117c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:51.738776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8ace5-60e7-4f4d-ba37-f59f87a117c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:51.740929 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8ace5-60e7-4f4d-ba37-f59f87a117c2 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:51.761763 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1066/2105] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:37:51 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:37:51.766054 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0520288-0a1f-4f57-a08a-07916c5422b4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:51.776921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0520288-0a1f-4f57-a08a-07916c5422b4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:51.781750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b45f6b-fdd7-43ca-a899-aef7343926cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:51.782408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b45f6b-fdd7-43ca-a899-aef7343926cd admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:51.782699 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b45f6b-fdd7-43ca-a899-aef7343926cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:51.782977 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b45f6b-fdd7-43ca-a899-aef7343926cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:51.783708 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b45f6b-fdd7-43ca-a899-aef7343926cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:51.785467 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b45f6b-fdd7-43ca-a899-aef7343926cd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:51.797689 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1040/2106] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:37:51.802015 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8ace5-60e7-4f4d-ba37-f59f87a117c2 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:51.813286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8ace5-60e7-4f4d-ba37-f59f87a117c2 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:51.818592 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dce188-144b-4d20-ad27-6ffd7ce4bdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:51.819478 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dce188-144b-4d20-ad27-6ffd7ce4bdd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:51.819764 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dce188-144b-4d20-ad27-6ffd7ce4bdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:51.820044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dce188-144b-4d20-ad27-6ffd7ce4bdd9 admin admin] PATH_INFO: `/v3/projects/b60506a5421f4f04bafef0626ee3a4a9/users/8d1fe244e96b4f39b5427fa2d7848bc1/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:51.836980 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dce188-144b-4d20-ad27-6ffd7ce4bdd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b60506a5421f4f04bafef0626ee3a4a9, user_id=8d1fe244e96b4f39b5427fa2d7848bc1, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:51.839768 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dce188-144b-4d20-ad27-6ffd7ce4bdd9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:51.855392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1067/2107] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:37:51 2022] PUT /identity/v3/projects/b60506a5421f4f04bafef0626ee3a4a9/users/8d1fe244e96b4f39b5427fa2d7848bc1/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:51.859427 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b45f6b-fdd7-43ca-a899-aef7343926cd admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:51.870847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b45f6b-fdd7-43ca-a899-aef7343926cd admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:51.938964 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2539cba-c491-441e-9c74-6db9ab57b6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:51.939638 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2539cba-c491-441e-9c74-6db9ab57b6eb admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:51.939930 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2539cba-c491-441e-9c74-6db9ab57b6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:51.940212 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2539cba-c491-441e-9c74-6db9ab57b6eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:51.941006 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2539cba-c491-441e-9c74-6db9ab57b6eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:51.943174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2539cba-c491-441e-9c74-6db9ab57b6eb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:51.959225 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1041/2108] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:37:51.960769 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dce188-144b-4d20-ad27-6ffd7ce4bdd9 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:51.971032 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dce188-144b-4d20-ad27-6ffd7ce4bdd9 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:51.976537 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0647d24-83a6-467c-9ba8-f283bf533ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:51.977470 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0647d24-83a6-467c-9ba8-f283bf533ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:51.977743 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0647d24-83a6-467c-9ba8-f283bf533ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:51.978081 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0647d24-83a6-467c-9ba8-f283bf533ff9 admin admin] PATH_INFO: `/v3/projects/b60506a5421f4f04bafef0626ee3a4a9/users/8d1fe244e96b4f39b5427fa2d7848bc1/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:51.980186 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0647d24-83a6-467c-9ba8-f283bf533ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b60506a5421f4f04bafef0626ee3a4a9, user_id=8d1fe244e96b4f39b5427fa2d7848bc1, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:51.982942 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0647d24-83a6-467c-9ba8-f283bf533ff9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:51.986867 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:51.998966 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1068/2109] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:37:51 2022] PUT /identity/v3/projects/b60506a5421f4f04bafef0626ee3a4a9/users/8d1fe244e96b4f39b5427fa2d7848bc1/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:52.009962 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b3fa3-1e93-4672-b980-0eb71ad055b9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:52.010257 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b3fa3-1e93-4672-b980-0eb71ad055b9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:52.010546 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b3fa3-1e93-4672-b980-0eb71ad055b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:52.039643 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e76b3fa3-1e93-4672-b980-0eb71ad055b9 None None] MFA Rules not processed for user `8d1fe244e96b4f39b5427fa2d7848bc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:52.041122 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e76b3fa3-1e93-4672-b980-0eb71ad055b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:52.110703 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1042/2110] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:37:52.124174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0647d24-83a6-467c-9ba8-f283bf533ff9 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:52.125871 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a0647d24-83a6-467c-9ba8-f283bf533ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:52.183955 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0647d24-83a6-467c-9ba8-f283bf533ff9 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:52.187602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a340b24-2eaf-4af8-a4e4-0fbe1d01d524 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:52.188241 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a340b24-2eaf-4af8-a4e4-0fbe1d01d524 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:52.188559 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a340b24-2eaf-4af8-a4e4-0fbe1d01d524 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:52.188840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a340b24-2eaf-4af8-a4e4-0fbe1d01d524 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:52.198136 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a340b24-2eaf-4af8-a4e4-0fbe1d01d524 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:52.199569 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a340b24-2eaf-4af8-a4e4-0fbe1d01d524 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:52.209242 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1069/2111] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:37:52.292451 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b3fa3-1e93-4672-b980-0eb71ad055b9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:52.293847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e76b3fa3-1e93-4672-b980-0eb71ad055b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:52.306029 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b3fa3-1e93-4672-b980-0eb71ad055b9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:52.309623 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25704c85-0df6-4732-bde3-442e4f1bb412 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:52.310264 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25704c85-0df6-4732-bde3-442e4f1bb412 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:52.310552 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25704c85-0df6-4732-bde3-442e4f1bb412 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:52.310836 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25704c85-0df6-4732-bde3-442e4f1bb412 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:52.355054 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:52.368902 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25704c85-0df6-4732-bde3-442e4f1bb412 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:52.370364 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25704c85-0df6-4732-bde3-442e4f1bb412 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:52.380372 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1043/2112] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:37:52.631233 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a340b24-2eaf-4af8-a4e4-0fbe1d01d524 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:52.692967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a340b24-2eaf-4af8-a4e4-0fbe1d01d524 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:52.697510 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a4f41-b4eb-4f6a-ad83-9c19f1a30070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:52.698361 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a4f41-b4eb-4f6a-ad83-9c19f1a30070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:52.698647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a4f41-b4eb-4f6a-ad83-9c19f1a30070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:52.698920 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a4f41-b4eb-4f6a-ad83-9c19f1a30070 admin admin] PATH_INFO: `/v3/users/4fe46a4e4d9b471a979cf21fbc01969e` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:52.700100 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a4f41-b4eb-4f6a-ad83-9c19f1a30070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fe46a4e4d9b471a979cf21fbc01969e)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:52.702050 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a4f41-b4eb-4f6a-ad83-9c19f1a30070 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:52.747845 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-025a4f41-b4eb-4f6a-ad83-9c19f1a30070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fe46a4e4d9b471a979cf21fbc01969e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:52.754726 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-025a4f41-b4eb-4f6a-ad83-9c19f1a30070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fe46a4e4d9b471a979cf21fbc01969e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:52.755443 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-025a4f41-b4eb-4f6a-ad83-9c19f1a30070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fe46a4e4d9b471a979cf21fbc01969e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:52.766929 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-025a4f41-b4eb-4f6a-ad83-9c19f1a30070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fe46a4e4d9b471a979cf21fbc01969e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:52.773471 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-025a4f41-b4eb-4f6a-ad83-9c19f1a30070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fe46a4e4d9b471a979cf21fbc01969e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:52.779504 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1070/2113] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:37:52 2022] DELETE /identity/v3/users/4fe46a4e4d9b471a979cf21fbc01969e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:52.783992 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599b8cc-abd1-4f51-80d6-8f7079f685e9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:52.784505 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599b8cc-abd1-4f51-80d6-8f7079f685e9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:52.784619 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599b8cc-abd1-4f51-80d6-8f7079f685e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:52.802790 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f599b8cc-abd1-4f51-80d6-8f7079f685e9 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:52.804732 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f599b8cc-abd1-4f51-80d6-8f7079f685e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:52.869285 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1044/2114] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:52.879210 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a4f41-b4eb-4f6a-ad83-9c19f1a30070 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:52.880646 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-025a4f41-b4eb-4f6a-ad83-9c19f1a30070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:52.901225 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:52.939447 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a4f41-b4eb-4f6a-ad83-9c19f1a30070 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:52.943130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c8063-6460-430c-a012-1dcc39c0628b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:52.943767 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c8063-6460-430c-a012-1dcc39c0628b service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:52.944058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c8063-6460-430c-a012-1dcc39c0628b service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:52.944360 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c8063-6460-430c-a012-1dcc39c0628b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:52.953157 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c8063-6460-430c-a012-1dcc39c0628b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:52.954589 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c8063-6460-430c-a012-1dcc39c0628b service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:52.965001 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1071/2115] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:37:53.238737 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599b8cc-abd1-4f51-80d6-8f7079f685e9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:53.240282 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f599b8cc-abd1-4f51-80d6-8f7079f685e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:53.253169 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599b8cc-abd1-4f51-80d6-8f7079f685e9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:53.259652 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535202d-643d-406c-a068-4e20e0207686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:53.260610 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535202d-643d-406c-a068-4e20e0207686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:53.260899 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535202d-643d-406c-a068-4e20e0207686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:53.261176 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535202d-643d-406c-a068-4e20e0207686 admin admin] PATH_INFO: `/v3/projects/3c033eefe4a1459e989cc8676f0b9731` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:53.262393 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535202d-643d-406c-a068-4e20e0207686 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c033eefe4a1459e989cc8676f0b9731)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:53.264586 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535202d-643d-406c-a068-4e20e0207686 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:53.324914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a535202d-643d-406c-a068-4e20e0207686 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c033eefe4a1459e989cc8676f0b9731', 'request_id': 'req-a535202d-643d-406c-a068-4e20e0207686'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:53.330884 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a535202d-643d-406c-a068-4e20e0207686 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c033eefe4a1459e989cc8676f0b9731', 'request_id': 'req-a535202d-643d-406c-a068-4e20e0207686'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:53.339333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a535202d-643d-406c-a068-4e20e0207686 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c033eefe4a1459e989cc8676f0b9731', 'request_id': 'req-a535202d-643d-406c-a068-4e20e0207686'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:53.354402 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a535202d-643d-406c-a068-4e20e0207686 admin admin] The token cache is being invalidate because project 3c033eefe4a1459e989cc8676f0b9731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:37:53.354695 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a535202d-643d-406c-a068-4e20e0207686 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:53.355334 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a535202d-643d-406c-a068-4e20e0207686 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:53.356899 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1045/2116] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:37:53 2022] DELETE /identity/v3/projects/3c033eefe4a1459e989cc8676f0b9731 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:53.360754 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c8063-6460-430c-a012-1dcc39c0628b service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:53.370210 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c8063-6460-430c-a012-1dcc39c0628b service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:53.425282 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07987f41-7160-421d-adee-face5a8dbc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:53.426092 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07987f41-7160-421d-adee-face5a8dbc31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:53.426378 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07987f41-7160-421d-adee-face5a8dbc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:53.426659 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07987f41-7160-421d-adee-face5a8dbc31 admin admin] PATH_INFO: `/v3/users/8d1fe244e96b4f39b5427fa2d7848bc1` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:53.427853 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07987f41-7160-421d-adee-face5a8dbc31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d1fe244e96b4f39b5427fa2d7848bc1)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:53.429803 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07987f41-7160-421d-adee-face5a8dbc31 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:53.475013 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-07987f41-7160-421d-adee-face5a8dbc31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d1fe244e96b4f39b5427fa2d7848bc1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:53.481870 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-07987f41-7160-421d-adee-face5a8dbc31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d1fe244e96b4f39b5427fa2d7848bc1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:53.482524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-07987f41-7160-421d-adee-face5a8dbc31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d1fe244e96b4f39b5427fa2d7848bc1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:53.494130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-07987f41-7160-421d-adee-face5a8dbc31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d1fe244e96b4f39b5427fa2d7848bc1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:53.501112 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-07987f41-7160-421d-adee-face5a8dbc31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d1fe244e96b4f39b5427fa2d7848bc1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:53.507447 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1072/2117] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:37:53 2022] DELETE /identity/v3/users/8d1fe244e96b4f39b5427fa2d7848bc1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:53.770998 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535202d-643d-406c-a068-4e20e0207686 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:53.772465 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a535202d-643d-406c-a068-4e20e0207686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:53.785609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535202d-643d-406c-a068-4e20e0207686 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:53.842623 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fe936-b387-4a4f-bdda-8f5c00352996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:53.843484 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fe936-b387-4a4f-bdda-8f5c00352996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:53.843772 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fe936-b387-4a4f-bdda-8f5c00352996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:53.844052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fe936-b387-4a4f-bdda-8f5c00352996 admin admin] PATH_INFO: `/v3/projects/b60506a5421f4f04bafef0626ee3a4a9` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:53.845277 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fe936-b387-4a4f-bdda-8f5c00352996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b60506a5421f4f04bafef0626ee3a4a9)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:53.847186 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fe936-b387-4a4f-bdda-8f5c00352996 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:53.858767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:53.899558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ba8fe936-b387-4a4f-bdda-8f5c00352996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b60506a5421f4f04bafef0626ee3a4a9', 'request_id': 'req-ba8fe936-b387-4a4f-bdda-8f5c00352996'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:53.905026 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ba8fe936-b387-4a4f-bdda-8f5c00352996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b60506a5421f4f04bafef0626ee3a4a9', 'request_id': 'req-ba8fe936-b387-4a4f-bdda-8f5c00352996'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:53.912290 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ba8fe936-b387-4a4f-bdda-8f5c00352996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b60506a5421f4f04bafef0626ee3a4a9', 'request_id': 'req-ba8fe936-b387-4a4f-bdda-8f5c00352996'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:53.923197 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ba8fe936-b387-4a4f-bdda-8f5c00352996 admin admin] The token cache is being invalidate because project b60506a5421f4f04bafef0626ee3a4a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:37:53.923491 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ba8fe936-b387-4a4f-bdda-8f5c00352996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:53.924117 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ba8fe936-b387-4a4f-bdda-8f5c00352996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:53.925675 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1046/2118] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:37:53 2022] DELETE /identity/v3/projects/b60506a5421f4f04bafef0626ee3a4a9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:53.931152 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5db1f1-7ae8-4dc1-99a6-a07fc3efbe35 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:53.931637 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5db1f1-7ae8-4dc1-99a6-a07fc3efbe35 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:53.931757 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5db1f1-7ae8-4dc1-99a6-a07fc3efbe35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:53.949645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-0e5db1f1-7ae8-4dc1-99a6-a07fc3efbe35 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:53.950779 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0e5db1f1-7ae8-4dc1-99a6-a07fc3efbe35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:53.984547 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:54.013840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1073/2119] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:54.022709 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e9223-b685-4101-92f3-6f712e8ea638 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:54.023108 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e9223-b685-4101-92f3-6f712e8ea638 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:54.023417 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e9223-b685-4101-92f3-6f712e8ea638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:54.041951 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-668e9223-b685-4101-92f3-6f712e8ea638 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:54.043155 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-668e9223-b685-4101-92f3-6f712e8ea638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:54.051121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1047/2120] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:54.055161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5db1f1-7ae8-4dc1-99a6-a07fc3efbe35 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:54.064754 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5db1f1-7ae8-4dc1-99a6-a07fc3efbe35 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:54.069793 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbbbe9-a4b0-48c7-826b-1f9b83367ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:54.070434 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbbbe9-a4b0-48c7-826b-1f9b83367ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:54.070720 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbbbe9-a4b0-48c7-826b-1f9b83367ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:54.070997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbbbe9-a4b0-48c7-826b-1f9b83367ea8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:54.071730 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acbbbe9-a4b0-48c7-826b-1f9b83367ea8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:54.072039 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acbbbe9-a4b0-48c7-826b-1f9b83367ea8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:54.073691 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acbbbe9-a4b0-48c7-826b-1f9b83367ea8 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:54.086038 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1074/2121] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:54.090032 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e9223-b685-4101-92f3-6f712e8ea638 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:54.099294 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e9223-b685-4101-92f3-6f712e8ea638 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:54.103938 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe7499-942c-40d3-b360-3b3b94e4e8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:54.104617 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe7499-942c-40d3-b360-3b3b94e4e8fd admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:54.104905 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe7499-942c-40d3-b360-3b3b94e4e8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:54.105184 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe7499-942c-40d3-b360-3b3b94e4e8fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:54.105882 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe7499-942c-40d3-b360-3b3b94e4e8fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:54.107777 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe7499-942c-40d3-b360-3b3b94e4e8fd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:54.133080 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1048/2122] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:37:54 2022] POST /identity/v3/projects => generated 359 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:54.137161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbbbe9-a4b0-48c7-826b-1f9b83367ea8 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:54.147773 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbbbe9-a4b0-48c7-826b-1f9b83367ea8 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:54.206011 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132d6a9-27fb-469a-8df1-f187453b1e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:54.207875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132d6a9-27fb-469a-8df1-f187453b1e90 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:54.207875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132d6a9-27fb-469a-8df1-f187453b1e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:54.207875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132d6a9-27fb-469a-8df1-f187453b1e90 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:54.208733 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132d6a9-27fb-469a-8df1-f187453b1e90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:54.211123 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132d6a9-27fb-469a-8df1-f187453b1e90 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:54.233293 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1075/2123] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:37:54 2022] POST /identity/v3/users => generated 280 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:54.238013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe7499-942c-40d3-b360-3b3b94e4e8fd admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:54.248701 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe7499-942c-40d3-b360-3b3b94e4e8fd admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:54.253797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3dbc9-26d0-43b0-b798-34675e74a7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:54.258810 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3dbc9-26d0-43b0-b798-34675e74a7ea admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:54.258810 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3dbc9-26d0-43b0-b798-34675e74a7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:54.258810 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3dbc9-26d0-43b0-b798-34675e74a7ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:54.258810 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3dbc9-26d0-43b0-b798-34675e74a7ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:54.258810 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3dbc9-26d0-43b0-b798-34675e74a7ea admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:54.276772 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1049/2124] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:37:54.282201 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132d6a9-27fb-469a-8df1-f187453b1e90 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:54.296150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132d6a9-27fb-469a-8df1-f187453b1e90 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:54.300873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85dc897-2e50-42a5-966d-ed756768ae74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:54.301530 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dc897-2e50-42a5-966d-ed756768ae74 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:54.301809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dc897-2e50-42a5-966d-ed756768ae74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:54.302086 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dc897-2e50-42a5-966d-ed756768ae74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:54.302814 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85dc897-2e50-42a5-966d-ed756768ae74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:54.304427 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85dc897-2e50-42a5-966d-ed756768ae74 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:54.315787 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1076/2125] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:37:54.320073 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3dbc9-26d0-43b0-b798-34675e74a7ea admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:54.330226 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3dbc9-26d0-43b0-b798-34675e74a7ea admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:54.335491 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703f1f1-2ad6-4a0f-8b78-e32ade4e46d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:54.336404 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703f1f1-2ad6-4a0f-8b78-e32ade4e46d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:54.336694 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703f1f1-2ad6-4a0f-8b78-e32ade4e46d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:54.336973 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703f1f1-2ad6-4a0f-8b78-e32ade4e46d5 admin admin] PATH_INFO: `/v3/projects/bc261a2bca5e4e89bff2cf022a8517f5/users/b8118db3348348539c82d084e838c7b6/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:54.352419 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703f1f1-2ad6-4a0f-8b78-e32ade4e46d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc261a2bca5e4e89bff2cf022a8517f5, user_id=b8118db3348348539c82d084e838c7b6, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:54.355094 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703f1f1-2ad6-4a0f-8b78-e32ade4e46d5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:54.369977 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1050/2126] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:37:54 2022] PUT /identity/v3/projects/bc261a2bca5e4e89bff2cf022a8517f5/users/b8118db3348348539c82d084e838c7b6/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:54.380796 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191e6a0-007d-49ad-b737-c10bfb515f48 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:54.381147 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191e6a0-007d-49ad-b737-c10bfb515f48 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:54.381489 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191e6a0-007d-49ad-b737-c10bfb515f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:54.415010 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3191e6a0-007d-49ad-b737-c10bfb515f48 None None] MFA Rules not processed for user `b8118db3348348539c82d084e838c7b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:54.416330 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3191e6a0-007d-49ad-b737-c10bfb515f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:54.496211 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1077/2127] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:54 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:37:54.521121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703f1f1-2ad6-4a0f-8b78-e32ade4e46d5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:54.522862 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7703f1f1-2ad6-4a0f-8b78-e32ade4e46d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:54.547540 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191e6a0-007d-49ad-b737-c10bfb515f48 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:54.549005 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3191e6a0-007d-49ad-b737-c10bfb515f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:54.581311 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703f1f1-2ad6-4a0f-8b78-e32ade4e46d5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:54.584930 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0623731-e141-451c-883f-107da5fd2054 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:54.585569 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0623731-e141-451c-883f-107da5fd2054 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:54.585852 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0623731-e141-451c-883f-107da5fd2054 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:54.586125 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0623731-e141-451c-883f-107da5fd2054 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:54.589154 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:54.594936 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0623731-e141-451c-883f-107da5fd2054 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:54.596406 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0623731-e141-451c-883f-107da5fd2054 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:54.605473 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1051/2128] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:54 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:37:54.607053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191e6a0-007d-49ad-b737-c10bfb515f48 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:54.611134 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922c5f5-e7b8-4731-b30c-36decc114267 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:54.611840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922c5f5-e7b8-4731-b30c-36decc114267 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:54.612132 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922c5f5-e7b8-4731-b30c-36decc114267 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:54.612514 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922c5f5-e7b8-4731-b30c-36decc114267 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:54.614907 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0922c5f5-e7b8-4731-b30c-36decc114267 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:54.626603 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0623731-e141-451c-883f-107da5fd2054 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:54.673056 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:54.683073 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922c5f5-e7b8-4731-b30c-36decc114267 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:54.684542 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922c5f5-e7b8-4731-b30c-36decc114267 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:54.693985 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1078/2129] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:37:54.699453 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0623731-e141-451c-883f-107da5fd2054 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:54.704145 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a128028-f52b-4eed-a047-04cc107f9515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:54.705311 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a128028-f52b-4eed-a047-04cc107f9515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:54.705617 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a128028-f52b-4eed-a047-04cc107f9515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:54.706167 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a128028-f52b-4eed-a047-04cc107f9515 admin admin] PATH_INFO: `/v3/users/b8118db3348348539c82d084e838c7b6` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:54.707468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a128028-f52b-4eed-a047-04cc107f9515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8118db3348348539c82d084e838c7b6)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:54.709413 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a128028-f52b-4eed-a047-04cc107f9515 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:54.760638 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7a128028-f52b-4eed-a047-04cc107f9515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8118db3348348539c82d084e838c7b6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:54.768568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7a128028-f52b-4eed-a047-04cc107f9515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8118db3348348539c82d084e838c7b6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:54.769566 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7a128028-f52b-4eed-a047-04cc107f9515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8118db3348348539c82d084e838c7b6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:54.783980 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7a128028-f52b-4eed-a047-04cc107f9515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8118db3348348539c82d084e838c7b6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:54.793060 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7a128028-f52b-4eed-a047-04cc107f9515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8118db3348348539c82d084e838c7b6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:54.800682 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1052/2130] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:37:54 2022] DELETE /identity/v3/users/b8118db3348348539c82d084e838c7b6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:37:54.806102 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae091e-d7a7-46d6-9d48-4734e92d021d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:54.806398 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae091e-d7a7-46d6-9d48-4734e92d021d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:54.806676 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae091e-d7a7-46d6-9d48-4734e92d021d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:54.825412 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-07ae091e-d7a7-46d6-9d48-4734e92d021d None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:54.826610 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-07ae091e-d7a7-46d6-9d48-4734e92d021d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:54.892595 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1079/2131] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:37:54.902466 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a128028-f52b-4eed-a047-04cc107f9515 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:54.903731 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7a128028-f52b-4eed-a047-04cc107f9515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:54.978333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a128028-f52b-4eed-a047-04cc107f9515 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:54.982802 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115abf8-3f62-4263-89dd-ba04ab429b9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:54.983502 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115abf8-3f62-4263-89dd-ba04ab429b9e service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:54.983787 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115abf8-3f62-4263-89dd-ba04ab429b9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:54.984067 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115abf8-3f62-4263-89dd-ba04ab429b9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:54.994933 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115abf8-3f62-4263-89dd-ba04ab429b9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:54.996383 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115abf8-3f62-4263-89dd-ba04ab429b9e service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:55.006455 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1053/2132] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:37:55.315098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae091e-d7a7-46d6-9d48-4734e92d021d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:55.317330 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-07ae091e-d7a7-46d6-9d48-4734e92d021d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:55.351186 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae091e-d7a7-46d6-9d48-4734e92d021d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:55.362777 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c02638-87c7-41c1-9e95-3b73e35c4f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:55.364176 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c02638-87c7-41c1-9e95-3b73e35c4f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:55.364664 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c02638-87c7-41c1-9e95-3b73e35c4f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:55.364954 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c02638-87c7-41c1-9e95-3b73e35c4f3d admin admin] PATH_INFO: `/v3/projects/bc261a2bca5e4e89bff2cf022a8517f5` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:55.366209 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c02638-87c7-41c1-9e95-3b73e35c4f3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc261a2bca5e4e89bff2cf022a8517f5)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:55.368109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c02638-87c7-41c1-9e95-3b73e35c4f3d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:55.447328 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a5c02638-87c7-41c1-9e95-3b73e35c4f3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc261a2bca5e4e89bff2cf022a8517f5', 'request_id': 'req-a5c02638-87c7-41c1-9e95-3b73e35c4f3d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:55.472001 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a5c02638-87c7-41c1-9e95-3b73e35c4f3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc261a2bca5e4e89bff2cf022a8517f5', 'request_id': 'req-a5c02638-87c7-41c1-9e95-3b73e35c4f3d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:55.480087 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a5c02638-87c7-41c1-9e95-3b73e35c4f3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc261a2bca5e4e89bff2cf022a8517f5', 'request_id': 'req-a5c02638-87c7-41c1-9e95-3b73e35c4f3d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:55.495856 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a5c02638-87c7-41c1-9e95-3b73e35c4f3d admin admin] The token cache is being invalidate because project bc261a2bca5e4e89bff2cf022a8517f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:37:55.496150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a5c02638-87c7-41c1-9e95-3b73e35c4f3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:55.496975 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a5c02638-87c7-41c1-9e95-3b73e35c4f3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:37:55.499872 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1080/2133] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:37:55 2022] DELETE /identity/v3/projects/bc261a2bca5e4e89bff2cf022a8517f5 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:37:55.505417 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8901cf8-9540-4d32-8d6a-b69130ae58ff None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:55.505703 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8901cf8-9540-4d32-8d6a-b69130ae58ff None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:55.505985 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8901cf8-9540-4d32-8d6a-b69130ae58ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:55.525161 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e8901cf8-9540-4d32-8d6a-b69130ae58ff None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:55.527026 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e8901cf8-9540-4d32-8d6a-b69130ae58ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:55.607073 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c02638-87c7-41c1-9e95-3b73e35c4f3d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:55.608887 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a5c02638-87c7-41c1-9e95-3b73e35c4f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:55.619823 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:55.625722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:55.630694 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1054/2134] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:55.638648 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a88d47-b20f-4a44-9447-de91955dd35f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:55.639142 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a88d47-b20f-4a44-9447-de91955dd35f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:55.639575 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a88d47-b20f-4a44-9447-de91955dd35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:55.661381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a2a88d47-b20f-4a44-9447-de91955dd35f None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:55.662701 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a2a88d47-b20f-4a44-9447-de91955dd35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:55.671120 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1055/2135] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:37:55.675276 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a88d47-b20f-4a44-9447-de91955dd35f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:55.678425 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c02638-87c7-41c1-9e95-3b73e35c4f3d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:55.682173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6b00a-a07f-490e-94e3-3bcc4594ce07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:55.682817 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6b00a-a07f-490e-94e3-3bcc4594ce07 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:55.683103 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6b00a-a07f-490e-94e3-3bcc4594ce07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:55.683381 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6b00a-a07f-490e-94e3-3bcc4594ce07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:55.684891 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a88d47-b20f-4a44-9447-de91955dd35f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:55.685293 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c3e6b00a-a07f-490e-94e3-3bcc4594ce07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:55.689411 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbe511-6c26-4e92-b0ad-a15608157644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:55.690041 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbe511-6c26-4e92-b0ad-a15608157644 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:55.690332 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbe511-6c26-4e92-b0ad-a15608157644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:55.690609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbe511-6c26-4e92-b0ad-a15608157644 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:55.691322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbe511-6c26-4e92-b0ad-a15608157644 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:37:55.691659 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbe511-6c26-4e92-b0ad-a15608157644 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:55.693495 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbe511-6c26-4e92-b0ad-a15608157644 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:55.706318 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1056/2136] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:37:55.710690 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbe511-6c26-4e92-b0ad-a15608157644 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:55.719986 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbe511-6c26-4e92-b0ad-a15608157644 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:55.725076 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cc175-2184-4753-8a1f-0a97f8977715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:55.725701 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cc175-2184-4753-8a1f-0a97f8977715 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:55.725983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cc175-2184-4753-8a1f-0a97f8977715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:55.726256 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cc175-2184-4753-8a1f-0a97f8977715 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:55.726928 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0cc175-2184-4753-8a1f-0a97f8977715 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:55.728913 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0cc175-2184-4753-8a1f-0a97f8977715 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:55.750304 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6b00a-a07f-490e-94e3-3bcc4594ce07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:55.751764 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6b00a-a07f-490e-94e3-3bcc4594ce07 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:55.756089 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1057/2137] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:37:55 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:37:55.760226 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cc175-2184-4753-8a1f-0a97f8977715 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:55.761753 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1081/2138] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:55 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:37:55.825097 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cc175-2184-4753-8a1f-0a97f8977715 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:55.830602 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3a57c-bcc8-4ad5-919f-efce30dc3300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:55.832732 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3a57c-bcc8-4ad5-919f-efce30dc3300 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:55.833021 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3a57c-bcc8-4ad5-919f-efce30dc3300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:55.833469 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3a57c-bcc8-4ad5-919f-efce30dc3300 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:55.834255 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3a57c-bcc8-4ad5-919f-efce30dc3300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:55.836213 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3a57c-bcc8-4ad5-919f-efce30dc3300 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:55.861893 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1058/2139] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:37:55 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:37:55.864442 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6b00a-a07f-490e-94e3-3bcc4594ce07 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:55.875167 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6b00a-a07f-490e-94e3-3bcc4594ce07 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:55.879935 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b151d-4ef7-4164-b00f-7ca752690adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:55.880630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b151d-4ef7-4164-b00f-7ca752690adc admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:55.880916 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b151d-4ef7-4164-b00f-7ca752690adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:55.881196 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b151d-4ef7-4164-b00f-7ca752690adc admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:55.881918 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b151d-4ef7-4164-b00f-7ca752690adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:55.883503 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b151d-4ef7-4164-b00f-7ca752690adc admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:55.893407 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1082/2140] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:37:55.898278 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3a57c-bcc8-4ad5-919f-efce30dc3300 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:55.908102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3a57c-bcc8-4ad5-919f-efce30dc3300 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:55.913362 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09aecfb-d5ea-4c70-9645-6cd3090f2313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:55.914005 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09aecfb-d5ea-4c70-9645-6cd3090f2313 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:55.914284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09aecfb-d5ea-4c70-9645-6cd3090f2313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:55.914556 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09aecfb-d5ea-4c70-9645-6cd3090f2313 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:55.915270 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09aecfb-d5ea-4c70-9645-6cd3090f2313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:55.916888 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09aecfb-d5ea-4c70-9645-6cd3090f2313 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:55.926705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1059/2141] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:37:55.930755 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b151d-4ef7-4164-b00f-7ca752690adc admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:55.940495 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b151d-4ef7-4164-b00f-7ca752690adc admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:55.945119 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc41a6-7c35-47f8-a466-2b4c2d3a80a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:55.945973 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc41a6-7c35-47f8-a466-2b4c2d3a80a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:55.946255 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc41a6-7c35-47f8-a466-2b4c2d3a80a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:55.946531 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc41a6-7c35-47f8-a466-2b4c2d3a80a4 admin admin] PATH_INFO: `/v3/projects/46301efc51224c3db7660777fac426b2/users/2351177553054eeebc4c60abcfecfa70/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:55.961631 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc41a6-7c35-47f8-a466-2b4c2d3a80a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46301efc51224c3db7660777fac426b2, user_id=2351177553054eeebc4c60abcfecfa70, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:55.964265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc41a6-7c35-47f8-a466-2b4c2d3a80a4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:55.978051 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1083/2142] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:37:55 2022] PUT /identity/v3/projects/46301efc51224c3db7660777fac426b2/users/2351177553054eeebc4c60abcfecfa70/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:37:55.982929 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae300918-7061-4177-8c58-2aa205ac787b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:55.983219 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae300918-7061-4177-8c58-2aa205ac787b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:55.983498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae300918-7061-4177-8c58-2aa205ac787b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:56.002344 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ae300918-7061-4177-8c58-2aa205ac787b None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:56.003662 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ae300918-7061-4177-8c58-2aa205ac787b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:56.069045 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1060/2143] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:56.080059 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc41a6-7c35-47f8-a466-2b4c2d3a80a4 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:56.081783 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8afc41a6-7c35-47f8-a466-2b4c2d3a80a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:56.137580 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc41a6-7c35-47f8-a466-2b4c2d3a80a4 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:56.141170 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094e52f-ac91-47bd-aec7-f3cc3d6767ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:56.141800 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094e52f-ac91-47bd-aec7-f3cc3d6767ac service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:56.142082 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094e52f-ac91-47bd-aec7-f3cc3d6767ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:56.142358 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094e52f-ac91-47bd-aec7-f3cc3d6767ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:56.151603 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094e52f-ac91-47bd-aec7-f3cc3d6767ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:56.153050 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094e52f-ac91-47bd-aec7-f3cc3d6767ac service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:56.162888 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1084/2144] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:37:56.880673 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecd6d3-0a9f-41d4-93f1-bc83007943d2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:56.881817 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecd6d3-0a9f-41d4-93f1-bc83007943d2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:56.882316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecd6d3-0a9f-41d4-93f1-bc83007943d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:56.916739 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-95ecd6d3-0a9f-41d4-93f1-bc83007943d2 None None] MFA Rules not processed for user `2351177553054eeebc4c60abcfecfa70`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:56.918630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-95ecd6d3-0a9f-41d4-93f1-bc83007943d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:56.959040 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:57.027506 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1061/2145] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:37:57.084823 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094e52f-ac91-47bd-aec7-f3cc3d6767ac service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:37:57.085939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5094e52f-ac91-47bd-aec7-f3cc3d6767ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:57.130128 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:57.158272 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094e52f-ac91-47bd-aec7-f3cc3d6767ac service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:37:57.162581 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427fee0-a1d8-4850-9fa9-d3506c9dc805 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:37:57.163228 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427fee0-a1d8-4850-9fa9-d3506c9dc805 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:57.163526 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427fee0-a1d8-4850-9fa9-d3506c9dc805 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:57.163804 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427fee0-a1d8-4850-9fa9-d3506c9dc805 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:57.173228 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427fee0-a1d8-4850-9fa9-d3506c9dc805 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:37:57.174799 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427fee0-a1d8-4850-9fa9-d3506c9dc805 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:37:57.184660 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1085/2146] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:37:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:37:58.556725 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a695822-966a-4f6f-ab00-751089eb3e7a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:37:58.557237 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a695822-966a-4f6f-ab00-751089eb3e7a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:37:58.557646 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a695822-966a-4f6f-ab00-751089eb3e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:37:58.578244 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4a695822-966a-4f6f-ab00-751089eb3e7a None None] MFA Rules not processed for user `2351177553054eeebc4c60abcfecfa70`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:37:58.579454 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4a695822-966a-4f6f-ab00-751089eb3e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:37:58.587601 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1062/2147] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:37:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:38:02.875630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427fee0-a1d8-4850-9fa9-d3506c9dc805 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:02.877506 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5427fee0-a1d8-4850-9fa9-d3506c9dc805 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:02.893550 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427fee0-a1d8-4850-9fa9-d3506c9dc805 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:02.898613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714c663-0c93-40df-bd84-08b1dd7aa425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:02.899478 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714c663-0c93-40df-bd84-08b1dd7aa425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:02.899755 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714c663-0c93-40df-bd84-08b1dd7aa425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:02.900024 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714c663-0c93-40df-bd84-08b1dd7aa425 admin admin] PATH_INFO: `/v3/users/5a57e55f8a0b4ae2b63a8c8d9e98bc71` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:02.901316 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714c663-0c93-40df-bd84-08b1dd7aa425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a57e55f8a0b4ae2b63a8c8d9e98bc71)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:02.903206 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714c663-0c93-40df-bd84-08b1dd7aa425 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:02.966089 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6714c663-0c93-40df-bd84-08b1dd7aa425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a57e55f8a0b4ae2b63a8c8d9e98bc71'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:02.976392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6714c663-0c93-40df-bd84-08b1dd7aa425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a57e55f8a0b4ae2b63a8c8d9e98bc71'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:02.977134 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6714c663-0c93-40df-bd84-08b1dd7aa425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a57e55f8a0b4ae2b63a8c8d9e98bc71'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:02.995134 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6714c663-0c93-40df-bd84-08b1dd7aa425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a57e55f8a0b4ae2b63a8c8d9e98bc71'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:03.002947 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6714c663-0c93-40df-bd84-08b1dd7aa425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a57e55f8a0b4ae2b63a8c8d9e98bc71'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:03.018074 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1086/2148] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:38:02 2022] DELETE /identity/v3/users/5a57e55f8a0b4ae2b63a8c8d9e98bc71 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:38:03.023163 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487ba34-636a-4de0-af17-3f518b336b82 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:03.023801 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487ba34-636a-4de0-af17-3f518b336b82 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:03.024072 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487ba34-636a-4de0-af17-3f518b336b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:03.042978 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7487ba34-636a-4de0-af17-3f518b336b82 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:03.044178 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7487ba34-636a-4de0-af17-3f518b336b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:03.104169 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1063/2149] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:38:03.113896 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714c663-0c93-40df-bd84-08b1dd7aa425 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:03.115293 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6714c663-0c93-40df-bd84-08b1dd7aa425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:03.176387 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714c663-0c93-40df-bd84-08b1dd7aa425 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:03.179919 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32bb74-c265-4f74-a730-64cff5b6e0b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:03.180622 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32bb74-c265-4f74-a730-64cff5b6e0b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:03.180892 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32bb74-c265-4f74-a730-64cff5b6e0b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:03.181171 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32bb74-c265-4f74-a730-64cff5b6e0b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:03.190165 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32bb74-c265-4f74-a730-64cff5b6e0b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:03.192143 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32bb74-c265-4f74-a730-64cff5b6e0b1 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:03.201537 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1087/2150] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:38:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:38:03.467393 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487ba34-636a-4de0-af17-3f518b336b82 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:03.469185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7487ba34-636a-4de0-af17-3f518b336b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:03.481923 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487ba34-636a-4de0-af17-3f518b336b82 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:03.486650 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7460d2a-5eac-4900-b1cf-02286459acbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:03.487588 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7460d2a-5eac-4900-b1cf-02286459acbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:03.487975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7460d2a-5eac-4900-b1cf-02286459acbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:03.488346 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7460d2a-5eac-4900-b1cf-02286459acbc admin admin] PATH_INFO: `/v3/projects/ab5827c9a24b46c2bc87931928d3adda` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:03.490160 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7460d2a-5eac-4900-b1cf-02286459acbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab5827c9a24b46c2bc87931928d3adda)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:03.492107 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7460d2a-5eac-4900-b1cf-02286459acbc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:03.543337 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d7460d2a-5eac-4900-b1cf-02286459acbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab5827c9a24b46c2bc87931928d3adda', 'request_id': 'req-d7460d2a-5eac-4900-b1cf-02286459acbc'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:03.549005 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d7460d2a-5eac-4900-b1cf-02286459acbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab5827c9a24b46c2bc87931928d3adda', 'request_id': 'req-d7460d2a-5eac-4900-b1cf-02286459acbc'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:03.557951 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d7460d2a-5eac-4900-b1cf-02286459acbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab5827c9a24b46c2bc87931928d3adda', 'request_id': 'req-d7460d2a-5eac-4900-b1cf-02286459acbc'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:03.573182 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d7460d2a-5eac-4900-b1cf-02286459acbc admin admin] The token cache is being invalidate because project ab5827c9a24b46c2bc87931928d3adda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:38:03.573444 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d7460d2a-5eac-4900-b1cf-02286459acbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:03.574135 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d7460d2a-5eac-4900-b1cf-02286459acbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:03.576012 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1064/2151] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:38:03 2022] DELETE /identity/v3/projects/ab5827c9a24b46c2bc87931928d3adda => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:38:03.580492 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32bb74-c265-4f74-a730-64cff5b6e0b1 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:03.592874 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32bb74-c265-4f74-a730-64cff5b6e0b1 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:03.645092 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:03.659652 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b761a-8f30-47cb-8f21-2b04b59f8e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:03.660567 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b761a-8f30-47cb-8f21-2b04b59f8e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:03.660858 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b761a-8f30-47cb-8f21-2b04b59f8e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:03.661196 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b761a-8f30-47cb-8f21-2b04b59f8e1d admin admin] PATH_INFO: `/v3/users/a3b1ac65a82d4e789d345a3367f87b13` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:03.663121 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b761a-8f30-47cb-8f21-2b04b59f8e1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3b1ac65a82d4e789d345a3367f87b13)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:03.665082 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b761a-8f30-47cb-8f21-2b04b59f8e1d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:03.714365 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-954b761a-8f30-47cb-8f21-2b04b59f8e1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3b1ac65a82d4e789d345a3367f87b13'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:03.721281 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-954b761a-8f30-47cb-8f21-2b04b59f8e1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3b1ac65a82d4e789d345a3367f87b13'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:03.721945 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-954b761a-8f30-47cb-8f21-2b04b59f8e1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3b1ac65a82d4e789d345a3367f87b13'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:03.734633 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-954b761a-8f30-47cb-8f21-2b04b59f8e1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3b1ac65a82d4e789d345a3367f87b13'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:03.751526 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-954b761a-8f30-47cb-8f21-2b04b59f8e1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3b1ac65a82d4e789d345a3367f87b13'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:03.759929 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1088/2152] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:38:03 2022] DELETE /identity/v3/users/a3b1ac65a82d4e789d345a3367f87b13 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:38:04.044554 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7460d2a-5eac-4900-b1cf-02286459acbc admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:04.048500 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d7460d2a-5eac-4900-b1cf-02286459acbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:04.064791 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7460d2a-5eac-4900-b1cf-02286459acbc admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:04.112972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:04.130655 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424a998-38a4-4223-8436-d4a91ed52e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:04.131647 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424a998-38a4-4223-8436-d4a91ed52e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:04.131938 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424a998-38a4-4223-8436-d4a91ed52e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:04.132215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424a998-38a4-4223-8436-d4a91ed52e1c admin admin] PATH_INFO: `/v3/projects/83e197209db54e5d8d6413c03b6287b8` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:04.133457 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424a998-38a4-4223-8436-d4a91ed52e1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=83e197209db54e5d8d6413c03b6287b8)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:04.135407 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424a998-38a4-4223-8436-d4a91ed52e1c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:04.184481 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e424a998-38a4-4223-8436-d4a91ed52e1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83e197209db54e5d8d6413c03b6287b8', 'request_id': 'req-e424a998-38a4-4223-8436-d4a91ed52e1c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:04.189980 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e424a998-38a4-4223-8436-d4a91ed52e1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83e197209db54e5d8d6413c03b6287b8', 'request_id': 'req-e424a998-38a4-4223-8436-d4a91ed52e1c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:04.197923 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e424a998-38a4-4223-8436-d4a91ed52e1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83e197209db54e5d8d6413c03b6287b8', 'request_id': 'req-e424a998-38a4-4223-8436-d4a91ed52e1c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:04.209464 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e424a998-38a4-4223-8436-d4a91ed52e1c admin admin] The token cache is being invalidate because project 83e197209db54e5d8d6413c03b6287b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:38:04.209752 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e424a998-38a4-4223-8436-d4a91ed52e1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:04.210373 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e424a998-38a4-4223-8436-d4a91ed52e1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:04.211949 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1065/2153] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:38:04 2022] DELETE /identity/v3/projects/83e197209db54e5d8d6413c03b6287b8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:38:04.216062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b761a-8f30-47cb-8f21-2b04b59f8e1d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:04.217601 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-954b761a-8f30-47cb-8f21-2b04b59f8e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:04.230348 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b761a-8f30-47cb-8f21-2b04b59f8e1d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:04.286386 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733035fb-74fc-49e7-b51e-1bb5414e94d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:04.287255 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733035fb-74fc-49e7-b51e-1bb5414e94d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:04.287544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733035fb-74fc-49e7-b51e-1bb5414e94d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:04.287826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733035fb-74fc-49e7-b51e-1bb5414e94d5 admin admin] PATH_INFO: `/v3/users/0ebc9364ed4646bd901f1740ac12095e` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:04.289218 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733035fb-74fc-49e7-b51e-1bb5414e94d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ebc9364ed4646bd901f1740ac12095e)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:04.291139 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733035fb-74fc-49e7-b51e-1bb5414e94d5 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:04.341617 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-733035fb-74fc-49e7-b51e-1bb5414e94d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ebc9364ed4646bd901f1740ac12095e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:04.348220 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-733035fb-74fc-49e7-b51e-1bb5414e94d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ebc9364ed4646bd901f1740ac12095e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:04.348898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-733035fb-74fc-49e7-b51e-1bb5414e94d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ebc9364ed4646bd901f1740ac12095e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:04.359003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:04.361594 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-733035fb-74fc-49e7-b51e-1bb5414e94d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ebc9364ed4646bd901f1740ac12095e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:04.372604 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-733035fb-74fc-49e7-b51e-1bb5414e94d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ebc9364ed4646bd901f1740ac12095e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:04.379279 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1089/2154] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:38:04 2022] DELETE /identity/v3/users/0ebc9364ed4646bd901f1740ac12095e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:38:04.676558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424a998-38a4-4223-8436-d4a91ed52e1c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:04.678960 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e424a998-38a4-4223-8436-d4a91ed52e1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:04.715269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424a998-38a4-4223-8436-d4a91ed52e1c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:04.784721 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0308103-34a9-4b69-bd0d-8c0402c0e23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:04.785605 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0308103-34a9-4b69-bd0d-8c0402c0e23f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:04.785909 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0308103-34a9-4b69-bd0d-8c0402c0e23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:04.786776 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0308103-34a9-4b69-bd0d-8c0402c0e23f admin admin] PATH_INFO: `/v3/projects/1fe22a60b5364f15b92211e4e80d2d28` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:04.788065 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0308103-34a9-4b69-bd0d-8c0402c0e23f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fe22a60b5364f15b92211e4e80d2d28)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:04.790064 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0308103-34a9-4b69-bd0d-8c0402c0e23f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:04.854224 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f0308103-34a9-4b69-bd0d-8c0402c0e23f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fe22a60b5364f15b92211e4e80d2d28', 'request_id': 'req-f0308103-34a9-4b69-bd0d-8c0402c0e23f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:04.860956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f0308103-34a9-4b69-bd0d-8c0402c0e23f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fe22a60b5364f15b92211e4e80d2d28', 'request_id': 'req-f0308103-34a9-4b69-bd0d-8c0402c0e23f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:04.874826 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f0308103-34a9-4b69-bd0d-8c0402c0e23f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fe22a60b5364f15b92211e4e80d2d28', 'request_id': 'req-f0308103-34a9-4b69-bd0d-8c0402c0e23f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:04.888710 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f0308103-34a9-4b69-bd0d-8c0402c0e23f admin admin] The token cache is being invalidate because project 1fe22a60b5364f15b92211e4e80d2d28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:38:04.889020 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f0308103-34a9-4b69-bd0d-8c0402c0e23f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:04.889665 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f0308103-34a9-4b69-bd0d-8c0402c0e23f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:04.891493 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1066/2155] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:38:04 2022] DELETE /identity/v3/projects/1fe22a60b5364f15b92211e4e80d2d28 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:38:04.898384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4a98c-e78d-4604-a5b5-0f338a7faa8c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:04.898762 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4a98c-e78d-4604-a5b5-0f338a7faa8c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:04.899112 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4a98c-e78d-4604-a5b5-0f338a7faa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:04.922801 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-74d4a98c-e78d-4604-a5b5-0f338a7faa8c None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:04.924078 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-74d4a98c-e78d-4604-a5b5-0f338a7faa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:04.987419 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1090/2156] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:38:04.995378 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b4854-d693-4f36-af81-df95c52be0f7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:04.995654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b4854-d693-4f36-af81-df95c52be0f7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:04.995934 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b4854-d693-4f36-af81-df95c52be0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:05.003124 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:05.016918 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-056b4854-d693-4f36-af81-df95c52be0f7 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:05.019359 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-056b4854-d693-4f36-af81-df95c52be0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:05.029843 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1067/2157] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:38:05.033805 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4a98c-e78d-4604-a5b5-0f338a7faa8c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:05.044123 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4a98c-e78d-4604-a5b5-0f338a7faa8c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:05.048909 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f83b21-ac84-4140-8ae1-86d8cb75ab38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:05.049566 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f83b21-ac84-4140-8ae1-86d8cb75ab38 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:05.049855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f83b21-ac84-4140-8ae1-86d8cb75ab38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:05.050134 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f83b21-ac84-4140-8ae1-86d8cb75ab38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:05.050872 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f83b21-ac84-4140-8ae1-86d8cb75ab38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:38:05.051181 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f83b21-ac84-4140-8ae1-86d8cb75ab38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:05.053377 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f83b21-ac84-4140-8ae1-86d8cb75ab38 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:05.066164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1091/2158] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:38:05.071317 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b4854-d693-4f36-af81-df95c52be0f7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:05.080848 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b4854-d693-4f36-af81-df95c52be0f7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:05.086247 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff0dce-1e74-4d19-98cd-e93d8cf6ca49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:05.086966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff0dce-1e74-4d19-98cd-e93d8cf6ca49 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:05.087258 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff0dce-1e74-4d19-98cd-e93d8cf6ca49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:05.087537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff0dce-1e74-4d19-98cd-e93d8cf6ca49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:05.088230 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff0dce-1e74-4d19-98cd-e93d8cf6ca49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:05.090197 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff0dce-1e74-4d19-98cd-e93d8cf6ca49 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:05.118822 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1068/2159] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:38:05 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:38:05.123086 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f83b21-ac84-4140-8ae1-86d8cb75ab38 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:05.134027 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f83b21-ac84-4140-8ae1-86d8cb75ab38 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:05.207651 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb5ae5-2630-4826-90be-e5bd3c973451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:05.208529 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb5ae5-2630-4826-90be-e5bd3c973451 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:05.208879 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb5ae5-2630-4826-90be-e5bd3c973451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:05.209167 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb5ae5-2630-4826-90be-e5bd3c973451 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:05.210140 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb5ae5-2630-4826-90be-e5bd3c973451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:05.212239 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb5ae5-2630-4826-90be-e5bd3c973451 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:05.234514 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1092/2160] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:38:05 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:38:05.238373 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff0dce-1e74-4d19-98cd-e93d8cf6ca49 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:05.252151 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff0dce-1e74-4d19-98cd-e93d8cf6ca49 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:05.257949 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5e237-5f89-4e00-a556-7b56a8cb3014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:05.258585 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5e237-5f89-4e00-a556-7b56a8cb3014 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:05.258877 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5e237-5f89-4e00-a556-7b56a8cb3014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:05.259177 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5e237-5f89-4e00-a556-7b56a8cb3014 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:05.259995 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5e237-5f89-4e00-a556-7b56a8cb3014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:05.261779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5e237-5f89-4e00-a556-7b56a8cb3014 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:05.273561 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1069/2161] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:38:05.277558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb5ae5-2630-4826-90be-e5bd3c973451 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:05.287816 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb5ae5-2630-4826-90be-e5bd3c973451 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:05.293446 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc17fb4-6c8b-46eb-b8fc-1847bb63bca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:05.294136 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc17fb4-6c8b-46eb-b8fc-1847bb63bca8 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:05.294416 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc17fb4-6c8b-46eb-b8fc-1847bb63bca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:05.294694 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc17fb4-6c8b-46eb-b8fc-1847bb63bca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:05.295423 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc17fb4-6c8b-46eb-b8fc-1847bb63bca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:05.297111 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc17fb4-6c8b-46eb-b8fc-1847bb63bca8 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:05.308042 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1093/2162] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:38:05.312317 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5e237-5f89-4e00-a556-7b56a8cb3014 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:05.322939 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5e237-5f89-4e00-a556-7b56a8cb3014 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:05.327668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63187c5-18de-4e8b-9c97-00070163eab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:05.328653 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63187c5-18de-4e8b-9c97-00070163eab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:05.328945 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63187c5-18de-4e8b-9c97-00070163eab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:05.329927 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63187c5-18de-4e8b-9c97-00070163eab0 admin admin] PATH_INFO: `/v3/projects/9f83cf655b9d41ebbaf0961d1d2581fc/users/a41010feed14482d869807c09f365a18/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:05.345899 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63187c5-18de-4e8b-9c97-00070163eab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f83cf655b9d41ebbaf0961d1d2581fc, user_id=a41010feed14482d869807c09f365a18, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:05.348683 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63187c5-18de-4e8b-9c97-00070163eab0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:05.362663 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1070/2163] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:38:05 2022] PUT /identity/v3/projects/9f83cf655b9d41ebbaf0961d1d2581fc/users/a41010feed14482d869807c09f365a18/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:38:05.368095 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef7523-e0fa-4a10-a81c-23b8d63b89c8 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:05.368547 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef7523-e0fa-4a10-a81c-23b8d63b89c8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:05.368842 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef7523-e0fa-4a10-a81c-23b8d63b89c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:05.389278 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3cef7523-e0fa-4a10-a81c-23b8d63b89c8 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:05.390659 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3cef7523-e0fa-4a10-a81c-23b8d63b89c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:05.441311 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:05.459377 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1094/2164] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:38:05.469747 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63187c5-18de-4e8b-9c97-00070163eab0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:05.471555 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e63187c5-18de-4e8b-9c97-00070163eab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:05.532245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63187c5-18de-4e8b-9c97-00070163eab0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:05.536609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d113e-8f33-4a0e-bb24-1a3418868d47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:05.537270 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d113e-8f33-4a0e-bb24-1a3418868d47 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:05.537563 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d113e-8f33-4a0e-bb24-1a3418868d47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:05.537866 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d113e-8f33-4a0e-bb24-1a3418868d47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:05.547572 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d113e-8f33-4a0e-bb24-1a3418868d47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:05.549050 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d113e-8f33-4a0e-bb24-1a3418868d47 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:05.559232 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1071/2165] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:38:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:38:07.155281 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef7523-e0fa-4a10-a81c-23b8d63b89c8 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:07.157165 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3cef7523-e0fa-4a10-a81c-23b8d63b89c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:07.198178 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef7523-e0fa-4a10-a81c-23b8d63b89c8 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:07.205574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a1611-8621-40b6-bd8d-4e987b326d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:07.206479 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a1611-8621-40b6-bd8d-4e987b326d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:07.206768 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a1611-8621-40b6-bd8d-4e987b326d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:07.207188 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a1611-8621-40b6-bd8d-4e987b326d94 admin admin] PATH_INFO: `/v3/users/a6d1c4d2c1b349d499b1e114a343a063` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:07.208748 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a1611-8621-40b6-bd8d-4e987b326d94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6d1c4d2c1b349d499b1e114a343a063)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:07.211388 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a1611-8621-40b6-bd8d-4e987b326d94 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:07.297352 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-842a1611-8621-40b6-bd8d-4e987b326d94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6d1c4d2c1b349d499b1e114a343a063'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:07.307815 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-842a1611-8621-40b6-bd8d-4e987b326d94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6d1c4d2c1b349d499b1e114a343a063'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:07.309095 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-842a1611-8621-40b6-bd8d-4e987b326d94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6d1c4d2c1b349d499b1e114a343a063'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:07.326727 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-842a1611-8621-40b6-bd8d-4e987b326d94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6d1c4d2c1b349d499b1e114a343a063'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:07.337737 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-842a1611-8621-40b6-bd8d-4e987b326d94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6d1c4d2c1b349d499b1e114a343a063'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:07.348287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1095/2166] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:38:07 2022] DELETE /identity/v3/users/a6d1c4d2c1b349d499b1e114a343a063 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:38:07.353031 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0caf51d-5620-4e69-a048-cb20f33c1e78 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:07.353031 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0caf51d-5620-4e69-a048-cb20f33c1e78 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:07.353572 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0caf51d-5620-4e69-a048-cb20f33c1e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:07.399508 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e0caf51d-5620-4e69-a048-cb20f33c1e78 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:07.402982 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e0caf51d-5620-4e69-a048-cb20f33c1e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:07.511777 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1072/2167] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:38:07.536593 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a1611-8621-40b6-bd8d-4e987b326d94 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:07.538322 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-842a1611-8621-40b6-bd8d-4e987b326d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:07.626318 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a1611-8621-40b6-bd8d-4e987b326d94 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:07.630787 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f6f46-0d97-44e9-a5a3-49b37ebfdc88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:07.631435 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f6f46-0d97-44e9-a5a3-49b37ebfdc88 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:07.631722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f6f46-0d97-44e9-a5a3-49b37ebfdc88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:07.631995 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f6f46-0d97-44e9-a5a3-49b37ebfdc88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:07.641841 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f6f46-0d97-44e9-a5a3-49b37ebfdc88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:07.643477 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f6f46-0d97-44e9-a5a3-49b37ebfdc88 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:07.655838 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1096/2168] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:38:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:38:07.954019 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0caf51d-5620-4e69-a048-cb20f33c1e78 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:07.956033 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e0caf51d-5620-4e69-a048-cb20f33c1e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:07.975678 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0caf51d-5620-4e69-a048-cb20f33c1e78 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:07.985714 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d925fdd-9610-4553-b1b4-59aa5f6379ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:07.987456 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d925fdd-9610-4553-b1b4-59aa5f6379ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:07.987989 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d925fdd-9610-4553-b1b4-59aa5f6379ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:07.988459 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d925fdd-9610-4553-b1b4-59aa5f6379ef admin admin] PATH_INFO: `/v3/projects/c7f032eaa15049dc9ec191f3342d2393` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:07.990941 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d925fdd-9610-4553-b1b4-59aa5f6379ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7f032eaa15049dc9ec191f3342d2393)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:07.993740 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d925fdd-9610-4553-b1b4-59aa5f6379ef admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:08.055056 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:08.064889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9d925fdd-9610-4553-b1b4-59aa5f6379ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7f032eaa15049dc9ec191f3342d2393', 'request_id': 'req-9d925fdd-9610-4553-b1b4-59aa5f6379ef'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:08.074269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9d925fdd-9610-4553-b1b4-59aa5f6379ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7f032eaa15049dc9ec191f3342d2393', 'request_id': 'req-9d925fdd-9610-4553-b1b4-59aa5f6379ef'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:08.085778 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9d925fdd-9610-4553-b1b4-59aa5f6379ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7f032eaa15049dc9ec191f3342d2393', 'request_id': 'req-9d925fdd-9610-4553-b1b4-59aa5f6379ef'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:08.098275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9d925fdd-9610-4553-b1b4-59aa5f6379ef admin admin] The token cache is being invalidate because project c7f032eaa15049dc9ec191f3342d2393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:38:08.098573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9d925fdd-9610-4553-b1b4-59aa5f6379ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:08.099375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9d925fdd-9610-4553-b1b4-59aa5f6379ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:08.100978 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1073/2169] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:38:07 2022] DELETE /identity/v3/projects/c7f032eaa15049dc9ec191f3342d2393 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:38:08.105798 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f8f81-aeb7-4c75-835a-404d9a5f2207 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:08.106083 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f8f81-aeb7-4c75-835a-404d9a5f2207 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:08.106362 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f8f81-aeb7-4c75-835a-404d9a5f2207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:08.132531 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-bb9f8f81-aeb7-4c75-835a-404d9a5f2207 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:08.133779 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bb9f8f81-aeb7-4c75-835a-404d9a5f2207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:08.205749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1097/2170] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:38:08.207143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f84f08-b722-4a43-8a3d-97d2076e6bc1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:08.207438 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f84f08-b722-4a43-8a3d-97d2076e6bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:08.207775 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f84f08-b722-4a43-8a3d-97d2076e6bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:08.228028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f5f84f08-b722-4a43-8a3d-97d2076e6bc1 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:08.229450 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f5f84f08-b722-4a43-8a3d-97d2076e6bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:08.238976 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1074/2171] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:38:08.242937 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f8f81-aeb7-4c75-835a-404d9a5f2207 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:08.254359 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f8f81-aeb7-4c75-835a-404d9a5f2207 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:08.259820 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e134b-1aeb-4b40-87a9-7b721c0c0468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:08.260528 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e134b-1aeb-4b40-87a9-7b721c0c0468 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:08.260816 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e134b-1aeb-4b40-87a9-7b721c0c0468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:08.261092 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e134b-1aeb-4b40-87a9-7b721c0c0468 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:08.261869 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e134b-1aeb-4b40-87a9-7b721c0c0468 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:38:08.262179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e134b-1aeb-4b40-87a9-7b721c0c0468 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:08.263866 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e134b-1aeb-4b40-87a9-7b721c0c0468 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:08.266795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:08.283630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1098/2172] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:38:08.284838 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f84f08-b722-4a43-8a3d-97d2076e6bc1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:08.297204 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f84f08-b722-4a43-8a3d-97d2076e6bc1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:08.302949 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea9f65-79cf-4638-8b1d-de0b196394b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:08.303747 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea9f65-79cf-4638-8b1d-de0b196394b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:08.304177 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea9f65-79cf-4638-8b1d-de0b196394b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:08.304582 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea9f65-79cf-4638-8b1d-de0b196394b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:08.305357 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea9f65-79cf-4638-8b1d-de0b196394b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:08.307494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea9f65-79cf-4638-8b1d-de0b196394b3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:08.349381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1075/2173] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:38:08 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:38:08.350643 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e134b-1aeb-4b40-87a9-7b721c0c0468 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:08.365225 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e134b-1aeb-4b40-87a9-7b721c0c0468 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:08.443324 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a4396-62e7-47cd-be1f-c30dcb318e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:08.444086 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a4396-62e7-47cd-be1f-c30dcb318e84 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:08.444470 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a4396-62e7-47cd-be1f-c30dcb318e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:08.444883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a4396-62e7-47cd-be1f-c30dcb318e84 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:08.445768 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a4396-62e7-47cd-be1f-c30dcb318e84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:08.448767 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a4396-62e7-47cd-be1f-c30dcb318e84 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:08.494718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1099/2174] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:38:08 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:38:08.498375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea9f65-79cf-4638-8b1d-de0b196394b3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:08.517953 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea9f65-79cf-4638-8b1d-de0b196394b3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:08.526521 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2abb2-963f-4d08-a7a7-1c8e2e096a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:08.527221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2abb2-963f-4d08-a7a7-1c8e2e096a81 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:08.527511 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2abb2-963f-4d08-a7a7-1c8e2e096a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:08.527792 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2abb2-963f-4d08-a7a7-1c8e2e096a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:08.528559 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2abb2-963f-4d08-a7a7-1c8e2e096a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:08.532165 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2abb2-963f-4d08-a7a7-1c8e2e096a81 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:08.556502 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1076/2175] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:38:08.560364 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a4396-62e7-47cd-be1f-c30dcb318e84 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:08.575061 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a4396-62e7-47cd-be1f-c30dcb318e84 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:08.588721 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0725346-f4b3-4797-8e70-25ec875c46ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:08.589415 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0725346-f4b3-4797-8e70-25ec875c46ee admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:08.589709 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0725346-f4b3-4797-8e70-25ec875c46ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:08.589991 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0725346-f4b3-4797-8e70-25ec875c46ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:08.590740 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0725346-f4b3-4797-8e70-25ec875c46ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:08.592397 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0725346-f4b3-4797-8e70-25ec875c46ee admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:08.629567 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1100/2176] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:38:08.633629 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2abb2-963f-4d08-a7a7-1c8e2e096a81 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:08.648495 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2abb2-963f-4d08-a7a7-1c8e2e096a81 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:08.675079 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5d5b0-a827-4906-a63d-3f4082fa4f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:08.675963 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5d5b0-a827-4906-a63d-3f4082fa4f52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:08.676324 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5d5b0-a827-4906-a63d-3f4082fa4f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:08.677277 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5d5b0-a827-4906-a63d-3f4082fa4f52 admin admin] PATH_INFO: `/v3/projects/2199830e8daa48f0858c77b8125bde5f/users/3bc3650c72e5471abc4d84b4402e4111/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:08.704199 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5d5b0-a827-4906-a63d-3f4082fa4f52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2199830e8daa48f0858c77b8125bde5f, user_id=3bc3650c72e5471abc4d84b4402e4111, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:08.709506 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5d5b0-a827-4906-a63d-3f4082fa4f52 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:08.734261 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1077/2177] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:38:08 2022] PUT /identity/v3/projects/2199830e8daa48f0858c77b8125bde5f/users/3bc3650c72e5471abc4d84b4402e4111/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:38:08.745521 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee116b33-c2ed-4d4d-bb3a-4acd1ae8723b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:08.745966 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee116b33-c2ed-4d4d-bb3a-4acd1ae8723b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:08.746423 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee116b33-c2ed-4d4d-bb3a-4acd1ae8723b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:08.805527 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ee116b33-c2ed-4d4d-bb3a-4acd1ae8723b None None] MFA Rules not processed for user `3bc3650c72e5471abc4d84b4402e4111`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:08.807362 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ee116b33-c2ed-4d4d-bb3a-4acd1ae8723b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:08.943698 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1101/2178] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:38:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:38:08.959563 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5d5b0-a827-4906-a63d-3f4082fa4f52 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:08.961895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6bd5d5b0-a827-4906-a63d-3f4082fa4f52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:09.063159 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5d5b0-a827-4906-a63d-3f4082fa4f52 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:09.081798 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cfbc69-0bad-4108-90cf-4e88f4ee8700 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:09.082468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfbc69-0bad-4108-90cf-4e88f4ee8700 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:09.083312 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfbc69-0bad-4108-90cf-4e88f4ee8700 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:09.083606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfbc69-0bad-4108-90cf-4e88f4ee8700 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:09.106131 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cfbc69-0bad-4108-90cf-4e88f4ee8700 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:09.108582 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cfbc69-0bad-4108-90cf-4e88f4ee8700 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:09.138977 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1078/2179] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:38:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:38:12.135647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccd3b0-edde-4f30-a76b-ee71bdfefb56 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:12.136159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccd3b0-edde-4f30-a76b-ee71bdfefb56 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:12.136240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccd3b0-edde-4f30-a76b-ee71bdfefb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:12.167810 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-02ccd3b0-edde-4f30-a76b-ee71bdfefb56 None None] MFA Rules not processed for user `a41010feed14482d869807c09f365a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:12.169003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-02ccd3b0-edde-4f30-a76b-ee71bdfefb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:12.236344 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:12.250537 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1102/2180] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:38:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:38:12.255968 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cfbc69-0bad-4108-90cf-4e88f4ee8700 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:12.258062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-15cfbc69-0bad-4108-90cf-4e88f4ee8700 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:12.353036 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cfbc69-0bad-4108-90cf-4e88f4ee8700 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:12.357776 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea8261-daa4-4956-ba0a-a481480627c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:12.358514 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea8261-daa4-4956-ba0a-a481480627c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:12.358863 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea8261-daa4-4956-ba0a-a481480627c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:12.359217 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea8261-daa4-4956-ba0a-a481480627c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:12.360723 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea8261-daa4-4956-ba0a-a481480627c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:12.366347 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea8261-daa4-4956-ba0a-a481480627c8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:12.388007 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:12.412355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1079/2181] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:38:12 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:38:12.413963 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccd3b0-edde-4f30-a76b-ee71bdfefb56 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:12.425851 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccd3b0-edde-4f30-a76b-ee71bdfefb56 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:12.509464 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2d9b5-2266-45ea-a295-6c1d52eb80e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:12.510223 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2d9b5-2266-45ea-a295-6c1d52eb80e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:12.510571 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2d9b5-2266-45ea-a295-6c1d52eb80e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:12.510858 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2d9b5-2266-45ea-a295-6c1d52eb80e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:12.512077 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2d9b5-2266-45ea-a295-6c1d52eb80e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:12.514796 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2d9b5-2266-45ea-a295-6c1d52eb80e8 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:12.544376 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1103/2182] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:38:12 2022] POST /identity/v3/users => generated 299 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:38:12.548249 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea8261-daa4-4956-ba0a-a481480627c8 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:12.559156 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea8261-daa4-4956-ba0a-a481480627c8 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:12.565086 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8affd00c-1221-4c4e-94c2-8ab1e159e94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:12.565895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affd00c-1221-4c4e-94c2-8ab1e159e94d admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:12.566744 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affd00c-1221-4c4e-94c2-8ab1e159e94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:12.566744 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affd00c-1221-4c4e-94c2-8ab1e159e94d admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:12.567562 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8affd00c-1221-4c4e-94c2-8ab1e159e94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:12.569454 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8affd00c-1221-4c4e-94c2-8ab1e159e94d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:12.583534 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1080/2183] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:38:12.586712 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2d9b5-2266-45ea-a295-6c1d52eb80e8 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:12.605107 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2d9b5-2266-45ea-a295-6c1d52eb80e8 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:12.612124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874182b-d4df-4271-a6b1-dfb55c0e475a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:12.613232 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874182b-d4df-4271-a6b1-dfb55c0e475a admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:12.614355 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874182b-d4df-4271-a6b1-dfb55c0e475a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:12.614755 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874182b-d4df-4271-a6b1-dfb55c0e475a admin admin] PATH_INFO: `/v3/projects/dca57aa8d19d4ca4b87125352f806e08/users/bdb70771a1844f278404b1c527bc45c1/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:12.637771 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874182b-d4df-4271-a6b1-dfb55c0e475a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dca57aa8d19d4ca4b87125352f806e08, user_id=bdb70771a1844f278404b1c527bc45c1, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:12.641444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874182b-d4df-4271-a6b1-dfb55c0e475a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:12.680519 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1104/2184] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:38:12 2022] PUT /identity/v3/projects/dca57aa8d19d4ca4b87125352f806e08/users/bdb70771a1844f278404b1c527bc45c1/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:38:12.681711 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8affd00c-1221-4c4e-94c2-8ab1e159e94d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:12.694018 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8affd00c-1221-4c4e-94c2-8ab1e159e94d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:12.756073 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c3646-ed44-42c2-a07d-5b1633d8da48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:12.756800 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c3646-ed44-42c2-a07d-5b1633d8da48 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:12.757089 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c3646-ed44-42c2-a07d-5b1633d8da48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:12.757417 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c3646-ed44-42c2-a07d-5b1633d8da48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:12.758110 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c3646-ed44-42c2-a07d-5b1633d8da48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:12.759805 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c3646-ed44-42c2-a07d-5b1633d8da48 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:12.774019 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1081/2185] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:38:12.775392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874182b-d4df-4271-a6b1-dfb55c0e475a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:12.786966 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874182b-d4df-4271-a6b1-dfb55c0e475a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:12.792178 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc8024-8aa8-450b-9c29-f54734370530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:12.793284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc8024-8aa8-450b-9c29-f54734370530 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:12.793572 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc8024-8aa8-450b-9c29-f54734370530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:12.793880 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc8024-8aa8-450b-9c29-f54734370530 admin admin] PATH_INFO: `/v3/projects/dca57aa8d19d4ca4b87125352f806e08/users/bdb70771a1844f278404b1c527bc45c1/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:12.796244 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc8024-8aa8-450b-9c29-f54734370530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dca57aa8d19d4ca4b87125352f806e08, user_id=bdb70771a1844f278404b1c527bc45c1, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:12.799041 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc8024-8aa8-450b-9c29-f54734370530 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:12.812111 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1105/2186] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:38:12 2022] PUT /identity/v3/projects/dca57aa8d19d4ca4b87125352f806e08/users/bdb70771a1844f278404b1c527bc45c1/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:38:18.351179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfde479-1850-4dea-ba7a-1242027d7d3d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:18.351768 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfde479-1850-4dea-ba7a-1242027d7d3d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:18.351768 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfde479-1850-4dea-ba7a-1242027d7d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:18.381574 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4bfde479-1850-4dea-ba7a-1242027d7d3d None None] MFA Rules not processed for user `bdb70771a1844f278404b1c527bc45c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:18.382870 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4bfde479-1850-4dea-ba7a-1242027d7d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:18.474553 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1082/2187] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:38:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:38:18.487587 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc8024-8aa8-450b-9c29-f54734370530 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:18.492068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-88bc8024-8aa8-450b-9c29-f54734370530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:18.593243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc8024-8aa8-450b-9c29-f54734370530 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:18.599099 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25016021-f810-46c2-84b6-46e762e7bd50 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e239e4e9b99433ca9d1a8db45e24b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:18.599791 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25016021-f810-46c2-84b6-46e762e7bd50 service glance] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:18.600196 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25016021-f810-46c2-84b6-46e762e7bd50 service glance] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:18.600582 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25016021-f810-46c2-84b6-46e762e7bd50 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:18.725746 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25016021-f810-46c2-84b6-46e762e7bd50 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:18.727206 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25016021-f810-46c2-84b6-46e762e7bd50 service glance] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:18.736556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:18.759965 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1106/2188] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:38:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:38:18.967933 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ade995-15fb-4e26-a372-40c6793f529e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:18.968954 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ade995-15fb-4e26-a372-40c6793f529e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:18.968954 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ade995-15fb-4e26-a372-40c6793f529e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:18.989468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-43ade995-15fb-4e26-a372-40c6793f529e None None] MFA Rules not processed for user `bbcd5ba866b84d099d183fe19ba61a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:18.990636 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-43ade995-15fb-4e26-a372-40c6793f529e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:19.057860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1083/2189] 10.222.0.32 () {58 vars in 1009 bytes} [Thu Jun 2 13:38:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:38:19.103900 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25016021-f810-46c2-84b6-46e762e7bd50 service glance] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:19.105828 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-25016021-f810-46c2-84b6-46e762e7bd50 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:19.183007 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25016021-f810-46c2-84b6-46e762e7bd50 service glance] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:19.189382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63561f44-0493-472a-a4f3-11af21f2907e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aea97e7b39448a283032f662142b6e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:19.190165 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63561f44-0493-472a-a4f3-11af21f2907e service swift] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:19.190455 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63561f44-0493-472a-a4f3-11af21f2907e service swift] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:19.190818 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63561f44-0493-472a-a4f3-11af21f2907e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:19.200502 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63561f44-0493-472a-a4f3-11af21f2907e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:19.201990 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63561f44-0493-472a-a4f3-11af21f2907e service swift] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:19.210796 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1107/2190] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Jun 2 13:38:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:38:21.466147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ade995-15fb-4e26-a372-40c6793f529e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:21.478800 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:21.601523 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ade995-15fb-4e26-a372-40c6793f529e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:21.616989 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2c0f3-3776-4f56-af79-1f43754f6ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:21.618191 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2c0f3-3776-4f56-af79-1f43754f6ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:21.618709 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2c0f3-3776-4f56-af79-1f43754f6ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:21.619204 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2c0f3-3776-4f56-af79-1f43754f6ac7 admin admin] PATH_INFO: `/v3/users/3bc3650c72e5471abc4d84b4402e4111` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:21.622566 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2c0f3-3776-4f56-af79-1f43754f6ac7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bc3650c72e5471abc4d84b4402e4111)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:21.625683 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2c0f3-3776-4f56-af79-1f43754f6ac7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:21.747742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d2d2c0f3-3776-4f56-af79-1f43754f6ac7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bc3650c72e5471abc4d84b4402e4111'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:21.761751 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d2d2c0f3-3776-4f56-af79-1f43754f6ac7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bc3650c72e5471abc4d84b4402e4111'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:21.762536 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d2d2c0f3-3776-4f56-af79-1f43754f6ac7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bc3650c72e5471abc4d84b4402e4111'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:21.782948 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d2d2c0f3-3776-4f56-af79-1f43754f6ac7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bc3650c72e5471abc4d84b4402e4111'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:21.801610 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d2d2c0f3-3776-4f56-af79-1f43754f6ac7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bc3650c72e5471abc4d84b4402e4111'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:21.812551 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1084/2191] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:38:21 2022] DELETE /identity/v3/users/3bc3650c72e5471abc4d84b4402e4111 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:38:21.814600 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfea94-72f2-475e-9e35-abc2739b3f7c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:21.815125 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfea94-72f2-475e-9e35-abc2739b3f7c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:21.815214 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfea94-72f2-475e-9e35-abc2739b3f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:21.836711 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-98cfea94-72f2-475e-9e35-abc2739b3f7c None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:21.837943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-98cfea94-72f2-475e-9e35-abc2739b3f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:21.962626 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1108/2192] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:38:21.975088 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2c0f3-3776-4f56-af79-1f43754f6ac7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:21.975302 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d2d2c0f3-3776-4f56-af79-1f43754f6ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:22.169951 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2c0f3-3776-4f56-af79-1f43754f6ac7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:22.174095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03827f8e-431a-48c9-b8ca-e91e07257f0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:22.175014 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03827f8e-431a-48c9-b8ca-e91e07257f0a service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:22.175504 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03827f8e-431a-48c9-b8ca-e91e07257f0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:22.175899 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03827f8e-431a-48c9-b8ca-e91e07257f0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:22.187038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03827f8e-431a-48c9-b8ca-e91e07257f0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:22.188713 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03827f8e-431a-48c9-b8ca-e91e07257f0a service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:22.199956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1085/2193] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:38:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:38:22.684027 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfea94-72f2-475e-9e35-abc2739b3f7c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:22.685607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-98cfea94-72f2-475e-9e35-abc2739b3f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:22.705056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfea94-72f2-475e-9e35-abc2739b3f7c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:22.726709 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ce240-a7c5-4647-abde-446fe631c0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:22.737128 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ce240-a7c5-4647-abde-446fe631c0fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:22.737428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ce240-a7c5-4647-abde-446fe631c0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:22.737701 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ce240-a7c5-4647-abde-446fe631c0fb admin admin] PATH_INFO: `/v3/projects/2199830e8daa48f0858c77b8125bde5f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:22.755565 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ce240-a7c5-4647-abde-446fe631c0fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2199830e8daa48f0858c77b8125bde5f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:22.758486 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ce240-a7c5-4647-abde-446fe631c0fb admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:22.901352 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-102ce240-a7c5-4647-abde-446fe631c0fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2199830e8daa48f0858c77b8125bde5f', 'request_id': 'req-102ce240-a7c5-4647-abde-446fe631c0fb'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:22.916064 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-102ce240-a7c5-4647-abde-446fe631c0fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2199830e8daa48f0858c77b8125bde5f', 'request_id': 'req-102ce240-a7c5-4647-abde-446fe631c0fb'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:22.951426 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-102ce240-a7c5-4647-abde-446fe631c0fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2199830e8daa48f0858c77b8125bde5f', 'request_id': 'req-102ce240-a7c5-4647-abde-446fe631c0fb'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:22.970756 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-102ce240-a7c5-4647-abde-446fe631c0fb admin admin] The token cache is being invalidate because project 2199830e8daa48f0858c77b8125bde5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:38:22.975035 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-102ce240-a7c5-4647-abde-446fe631c0fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:22.975513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-102ce240-a7c5-4647-abde-446fe631c0fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:22.977921 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1109/2194] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:38:22 2022] DELETE /identity/v3/projects/2199830e8daa48f0858c77b8125bde5f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:38:22.988798 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cccbe-a5ee-4848-8343-eb8010195d7f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:22.990609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cccbe-a5ee-4848-8343-eb8010195d7f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:22.991287 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cccbe-a5ee-4848-8343-eb8010195d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:23.058002 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7a5cccbe-a5ee-4848-8343-eb8010195d7f None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:23.059435 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7a5cccbe-a5ee-4848-8343-eb8010195d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:23.101042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:23.209973 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1086/2195] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:38:23.221896 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff7119-20e9-4597-ab90-af4af9c0509e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:23.221896 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff7119-20e9-4597-ab90-af4af9c0509e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:23.221896 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff7119-20e9-4597-ab90-af4af9c0509e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:23.247812 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-49ff7119-20e9-4597-ab90-af4af9c0509e None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:23.249815 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-49ff7119-20e9-4597-ab90-af4af9c0509e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:23.271752 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1110/2196] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:38:23.275271 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5cccbe-a5ee-4848-8343-eb8010195d7f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:23.293546 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5cccbe-a5ee-4848-8343-eb8010195d7f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:23.321094 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37a4ed-af38-403b-b49c-ddc2fd7ad74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:23.323500 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37a4ed-af38-403b-b49c-ddc2fd7ad74a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:23.326155 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37a4ed-af38-403b-b49c-ddc2fd7ad74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:23.327401 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37a4ed-af38-403b-b49c-ddc2fd7ad74a admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:23.328895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37a4ed-af38-403b-b49c-ddc2fd7ad74a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:38:23.330185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37a4ed-af38-403b-b49c-ddc2fd7ad74a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:23.331884 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37a4ed-af38-403b-b49c-ddc2fd7ad74a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:23.356342 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1087/2197] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:38:23.360775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff7119-20e9-4597-ab90-af4af9c0509e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:23.375033 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff7119-20e9-4597-ab90-af4af9c0509e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:23.380557 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc3579-04c4-4e7a-82c7-6cb6d88f9405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:23.381224 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc3579-04c4-4e7a-82c7-6cb6d88f9405 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:23.381510 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc3579-04c4-4e7a-82c7-6cb6d88f9405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:23.381789 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc3579-04c4-4e7a-82c7-6cb6d88f9405 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:23.382782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc3579-04c4-4e7a-82c7-6cb6d88f9405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:23.384520 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc3579-04c4-4e7a-82c7-6cb6d88f9405 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:23.388260 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:23.434620 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1111/2198] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:38:23 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:38:23.438564 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37a4ed-af38-403b-b49c-ddc2fd7ad74a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:23.451126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37a4ed-af38-403b-b49c-ddc2fd7ad74a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:23.565908 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9931352-9cec-4d72-b0e9-814954b3617f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:23.567382 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9931352-9cec-4d72-b0e9-814954b3617f admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:23.567771 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9931352-9cec-4d72-b0e9-814954b3617f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:23.568216 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9931352-9cec-4d72-b0e9-814954b3617f admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:23.569210 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9931352-9cec-4d72-b0e9-814954b3617f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:23.571362 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9931352-9cec-4d72-b0e9-814954b3617f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:23.597804 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1088/2199] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:38:23 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:38:23.602538 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc3579-04c4-4e7a-82c7-6cb6d88f9405 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:23.628332 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc3579-04c4-4e7a-82c7-6cb6d88f9405 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:23.646029 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe15d0-25d1-43c8-b880-7d4e11fd032a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:23.648281 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe15d0-25d1-43c8-b880-7d4e11fd032a admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:23.649182 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe15d0-25d1-43c8-b880-7d4e11fd032a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:23.649182 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe15d0-25d1-43c8-b880-7d4e11fd032a admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:23.650525 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe15d0-25d1-43c8-b880-7d4e11fd032a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:23.653175 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe15d0-25d1-43c8-b880-7d4e11fd032a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:23.678694 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1112/2200] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:38:23.682366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9931352-9cec-4d72-b0e9-814954b3617f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:23.697330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9931352-9cec-4d72-b0e9-814954b3617f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:23.702200 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e971e-257c-4c87-8bd2-6c140f9b7f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:23.702886 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e971e-257c-4c87-8bd2-6c140f9b7f8a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:23.703167 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e971e-257c-4c87-8bd2-6c140f9b7f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:23.703443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e971e-257c-4c87-8bd2-6c140f9b7f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:23.704181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e971e-257c-4c87-8bd2-6c140f9b7f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:23.706371 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e971e-257c-4c87-8bd2-6c140f9b7f8a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:23.722465 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe15d0-25d1-43c8-b880-7d4e11fd032a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:23.723823 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1089/2201] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:38:23.746049 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe15d0-25d1-43c8-b880-7d4e11fd032a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:23.756882 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b69c6-2bde-4bc2-a292-46440b09a8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:23.758205 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b69c6-2bde-4bc2-a292-46440b09a8bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:23.758700 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b69c6-2bde-4bc2-a292-46440b09a8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:23.759174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b69c6-2bde-4bc2-a292-46440b09a8bd admin admin] PATH_INFO: `/v3/projects/ba31334d858a4e698ac0f8fc2e846895/users/02eb6e337f9a4bf5992b8668a6f0fa3a/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:23.776959 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b69c6-2bde-4bc2-a292-46440b09a8bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba31334d858a4e698ac0f8fc2e846895, user_id=02eb6e337f9a4bf5992b8668a6f0fa3a, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:23.779752 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b69c6-2bde-4bc2-a292-46440b09a8bd admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:23.803965 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1113/2202] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:38:23 2022] PUT /identity/v3/projects/ba31334d858a4e698ac0f8fc2e846895/users/02eb6e337f9a4bf5992b8668a6f0fa3a/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:38:23.805844 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ca4e3-9c59-47fa-9ece-b64a866648cf None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:23.806455 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ca4e3-9c59-47fa-9ece-b64a866648cf None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:23.806925 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ca4e3-9c59-47fa-9ece-b64a866648cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:23.828486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5b9ca4e3-9c59-47fa-9ece-b64a866648cf None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:23.830269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5b9ca4e3-9c59-47fa-9ece-b64a866648cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:23.909924 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1090/2203] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:38:23.920274 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b69c6-2bde-4bc2-a292-46440b09a8bd admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:23.922534 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-cc1b69c6-2bde-4bc2-a292-46440b09a8bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:23.996935 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b69c6-2bde-4bc2-a292-46440b09a8bd admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:24.001036 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b917e6-b917-47d0-9d79-5ab7d4e71698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:24.001839 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b917e6-b917-47d0-9d79-5ab7d4e71698 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:24.002154 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b917e6-b917-47d0-9d79-5ab7d4e71698 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:24.002436 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b917e6-b917-47d0-9d79-5ab7d4e71698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:24.037576 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b917e6-b917-47d0-9d79-5ab7d4e71698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:24.039731 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b917e6-b917-47d0-9d79-5ab7d4e71698 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:24.050761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1114/2204] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:38:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:38:25.783124 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19148dd8-077c-4e1f-b3e1-bcf747ba2c3e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:25.783606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19148dd8-077c-4e1f-b3e1-bcf747ba2c3e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:25.784320 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19148dd8-077c-4e1f-b3e1-bcf747ba2c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:25.823537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-19148dd8-077c-4e1f-b3e1-bcf747ba2c3e None None] MFA Rules not processed for user `2351177553054eeebc4c60abcfecfa70`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:25.825512 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-19148dd8-077c-4e1f-b3e1-bcf747ba2c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:25.906657 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:25.961196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1091/2205] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:38:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:38:33.659281 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93ea72-c242-49ec-b70c-2c2076737177 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:33.659834 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93ea72-c242-49ec-b70c-2c2076737177 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:33.664646 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93ea72-c242-49ec-b70c-2c2076737177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:33.714974 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3f93ea72-c242-49ec-b70c-2c2076737177 None None] MFA Rules not processed for user `02eb6e337f9a4bf5992b8668a6f0fa3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:33.716789 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3f93ea72-c242-49ec-b70c-2c2076737177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:33.833699 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1115/2206] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:38:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:38:33.838007 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19148dd8-077c-4e1f-b3e1-bcf747ba2c3e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:33.882770 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a02c8-e7fc-46ca-9d9d-a50deda3eed2 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:33.883339 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a02c8-e7fc-46ca-9d9d-a50deda3eed2 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:33.883860 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a02c8-e7fc-46ca-9d9d-a50deda3eed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:33.927664 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-243a02c8-e7fc-46ca-9d9d-a50deda3eed2 None None] MFA Rules not processed for user `a41010feed14482d869807c09f365a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:33.933367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-243a02c8-e7fc-46ca-9d9d-a50deda3eed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:33.947091 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:33.959641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19148dd8-077c-4e1f-b3e1-bcf747ba2c3e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:33.973011 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c820c-8eb2-44f6-bcc9-4fe6b6e80b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:33.974705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c820c-8eb2-44f6-bcc9-4fe6b6e80b81 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:33.975187 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c820c-8eb2-44f6-bcc9-4fe6b6e80b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:33.975674 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c820c-8eb2-44f6-bcc9-4fe6b6e80b81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:33.976905 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c820c-8eb2-44f6-bcc9-4fe6b6e80b81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:33.979258 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c820c-8eb2-44f6-bcc9-4fe6b6e80b81 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:34.062407 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1116/2207] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:38:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:38:34.117245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1092/2208] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:38:33 2022] POST /identity/v3/projects => generated 371 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:38:34.121944 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a02c8-e7fc-46ca-9d9d-a50deda3eed2 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:34.138445 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a02c8-e7fc-46ca-9d9d-a50deda3eed2 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:34.213596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb70be6-2896-4ec7-941f-9601f050d781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:34.215129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb70be6-2896-4ec7-941f-9601f050d781 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:34.215736 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb70be6-2896-4ec7-941f-9601f050d781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:34.216621 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb70be6-2896-4ec7-941f-9601f050d781 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:34.217440 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb70be6-2896-4ec7-941f-9601f050d781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:34.219959 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb70be6-2896-4ec7-941f-9601f050d781 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:34.248790 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1117/2209] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:38:34 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:38:34.259988 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c820c-8eb2-44f6-bcc9-4fe6b6e80b81 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:34.271958 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c820c-8eb2-44f6-bcc9-4fe6b6e80b81 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:34.278165 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4797e1-964b-4220-98a3-15c8b38fa9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:34.278965 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4797e1-964b-4220-98a3-15c8b38fa9c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:34.279525 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4797e1-964b-4220-98a3-15c8b38fa9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:34.279846 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4797e1-964b-4220-98a3-15c8b38fa9c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:34.280752 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4797e1-964b-4220-98a3-15c8b38fa9c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:34.282455 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4797e1-964b-4220-98a3-15c8b38fa9c7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:34.293805 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1093/2210] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:38:34.298147 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb70be6-2896-4ec7-941f-9601f050d781 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:34.316887 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb70be6-2896-4ec7-941f-9601f050d781 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:34.332139 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81afb08-a5c3-4d5d-8b11-7afc34df68dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:34.333547 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81afb08-a5c3-4d5d-8b11-7afc34df68dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:34.333685 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81afb08-a5c3-4d5d-8b11-7afc34df68dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:34.333964 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81afb08-a5c3-4d5d-8b11-7afc34df68dc admin admin] PATH_INFO: `/v3/projects/4327d1680b0546eebd912ded09fe4396/users/cdb81e45304e40ea88a703204b1a1868/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:34.352784 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81afb08-a5c3-4d5d-8b11-7afc34df68dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4327d1680b0546eebd912ded09fe4396, user_id=cdb81e45304e40ea88a703204b1a1868, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:34.356051 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81afb08-a5c3-4d5d-8b11-7afc34df68dc admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:34.372703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1118/2211] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:38:34 2022] PUT /identity/v3/projects/4327d1680b0546eebd912ded09fe4396/users/cdb81e45304e40ea88a703204b1a1868/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:38:34.376645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4797e1-964b-4220-98a3-15c8b38fa9c7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:34.388710 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4797e1-964b-4220-98a3-15c8b38fa9c7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:34.463921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178314c7-12e5-4d61-b669-62d8b85cd15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:34.464650 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178314c7-12e5-4d61-b669-62d8b85cd15a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:34.464935 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178314c7-12e5-4d61-b669-62d8b85cd15a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:34.465223 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178314c7-12e5-4d61-b669-62d8b85cd15a admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:34.465960 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178314c7-12e5-4d61-b669-62d8b85cd15a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:34.467724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178314c7-12e5-4d61-b669-62d8b85cd15a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:34.487263 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1094/2212] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:38:34.489167 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81afb08-a5c3-4d5d-8b11-7afc34df68dc admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:34.502197 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81afb08-a5c3-4d5d-8b11-7afc34df68dc admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:34.510546 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ca58d-2f15-4345-a829-ba4da5e9c6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:34.511587 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ca58d-2f15-4345-a829-ba4da5e9c6b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:34.511973 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ca58d-2f15-4345-a829-ba4da5e9c6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:34.512388 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ca58d-2f15-4345-a829-ba4da5e9c6b4 admin admin] PATH_INFO: `/v3/projects/4327d1680b0546eebd912ded09fe4396/users/cdb81e45304e40ea88a703204b1a1868/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:34.514729 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ca58d-2f15-4345-a829-ba4da5e9c6b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4327d1680b0546eebd912ded09fe4396, user_id=cdb81e45304e40ea88a703204b1a1868, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:34.517963 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ca58d-2f15-4345-a829-ba4da5e9c6b4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:34.532036 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1119/2213] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:38:34 2022] PUT /identity/v3/projects/4327d1680b0546eebd912ded09fe4396/users/cdb81e45304e40ea88a703204b1a1868/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:38:35.161927 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178314c7-12e5-4d61-b669-62d8b85cd15a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:35.163729 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-178314c7-12e5-4d61-b669-62d8b85cd15a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:35.191868 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178314c7-12e5-4d61-b669-62d8b85cd15a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:35.353203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:35.384932 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f81cf-60b1-4767-9fd6-7a7dd5dd9419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:35.393465 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f81cf-60b1-4767-9fd6-7a7dd5dd9419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:35.393465 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f81cf-60b1-4767-9fd6-7a7dd5dd9419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:35.393465 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f81cf-60b1-4767-9fd6-7a7dd5dd9419 admin admin] PATH_INFO: `/v3/users/5ea7df55350a46dc87b57fd7b5e9f48d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:35.395023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f81cf-60b1-4767-9fd6-7a7dd5dd9419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ea7df55350a46dc87b57fd7b5e9f48d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:35.397156 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f81cf-60b1-4767-9fd6-7a7dd5dd9419 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:35.510479 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5a1f81cf-60b1-4767-9fd6-7a7dd5dd9419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ea7df55350a46dc87b57fd7b5e9f48d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:35.526753 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5a1f81cf-60b1-4767-9fd6-7a7dd5dd9419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ea7df55350a46dc87b57fd7b5e9f48d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:35.527521 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5a1f81cf-60b1-4767-9fd6-7a7dd5dd9419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ea7df55350a46dc87b57fd7b5e9f48d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:35.558454 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5a1f81cf-60b1-4767-9fd6-7a7dd5dd9419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ea7df55350a46dc87b57fd7b5e9f48d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:35.574265 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5a1f81cf-60b1-4767-9fd6-7a7dd5dd9419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ea7df55350a46dc87b57fd7b5e9f48d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:35.586480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1095/2214] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:38:35 2022] DELETE /identity/v3/users/5ea7df55350a46dc87b57fd7b5e9f48d => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:38:35.590971 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd957f2-0910-4a83-ab64-aa204218113d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:35.591496 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd957f2-0910-4a83-ab64-aa204218113d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:35.591591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd957f2-0910-4a83-ab64-aa204218113d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:35.642980 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-5fd957f2-0910-4a83-ab64-aa204218113d None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:35.647150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5fd957f2-0910-4a83-ab64-aa204218113d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:35.746314 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1120/2215] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:38:35.763476 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f81cf-60b1-4767-9fd6-7a7dd5dd9419 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:35.765032 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5a1f81cf-60b1-4767-9fd6-7a7dd5dd9419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:35.997752 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f81cf-60b1-4767-9fd6-7a7dd5dd9419 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:36.006373 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b0307-c79c-4978-869e-6b30ea8a6156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:36.007458 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b0307-c79c-4978-869e-6b30ea8a6156 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:36.007793 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b0307-c79c-4978-869e-6b30ea8a6156 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:36.008223 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b0307-c79c-4978-869e-6b30ea8a6156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:36.022060 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b0307-c79c-4978-869e-6b30ea8a6156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:36.023655 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b0307-c79c-4978-869e-6b30ea8a6156 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:36.043282 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1096/2216] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:38:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:38:36.694128 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd957f2-0910-4a83-ab64-aa204218113d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:36.695393 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5fd957f2-0910-4a83-ab64-aa204218113d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:36.719202 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd957f2-0910-4a83-ab64-aa204218113d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:36.738969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574b090-feb2-4af2-8fc6-15ae152e4185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:36.741158 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574b090-feb2-4af2-8fc6-15ae152e4185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:36.741516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574b090-feb2-4af2-8fc6-15ae152e4185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:36.741991 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574b090-feb2-4af2-8fc6-15ae152e4185 admin admin] PATH_INFO: `/v3/projects/55572186440d411e8407c3f6f2ab80d6` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:36.745512 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574b090-feb2-4af2-8fc6-15ae152e4185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55572186440d411e8407c3f6f2ab80d6)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:36.751632 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574b090-feb2-4af2-8fc6-15ae152e4185 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:36.767847 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:36.885882 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d574b090-feb2-4af2-8fc6-15ae152e4185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55572186440d411e8407c3f6f2ab80d6', 'request_id': 'req-d574b090-feb2-4af2-8fc6-15ae152e4185'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:36.907738 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d574b090-feb2-4af2-8fc6-15ae152e4185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55572186440d411e8407c3f6f2ab80d6', 'request_id': 'req-d574b090-feb2-4af2-8fc6-15ae152e4185'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:36.926224 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d574b090-feb2-4af2-8fc6-15ae152e4185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55572186440d411e8407c3f6f2ab80d6', 'request_id': 'req-d574b090-feb2-4af2-8fc6-15ae152e4185'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:36.943877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d574b090-feb2-4af2-8fc6-15ae152e4185 admin admin] The token cache is being invalidate because project 55572186440d411e8407c3f6f2ab80d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:38:36.944119 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d574b090-feb2-4af2-8fc6-15ae152e4185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:36.944985 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d574b090-feb2-4af2-8fc6-15ae152e4185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:36.947377 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1121/2217] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:38:36 2022] DELETE /identity/v3/projects/55572186440d411e8407c3f6f2ab80d6 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:38:36.952877 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109e34e-965a-4c19-8c72-f348f4e8f663 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:36.954086 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109e34e-965a-4c19-8c72-f348f4e8f663 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:36.954867 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109e34e-965a-4c19-8c72-f348f4e8f663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:37.012329 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0109e34e-965a-4c19-8c72-f348f4e8f663 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:37.013664 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0109e34e-965a-4c19-8c72-f348f4e8f663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:37.040902 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:37.120699 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1097/2218] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:38:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:38:37.129501 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed900e05-eb3a-44b2-ae53-f5cbbb3c7d31 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:37.130002 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed900e05-eb3a-44b2-ae53-f5cbbb3c7d31 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:37.130086 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed900e05-eb3a-44b2-ae53-f5cbbb3c7d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:37.159369 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ed900e05-eb3a-44b2-ae53-f5cbbb3c7d31 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:37.161280 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ed900e05-eb3a-44b2-ae53-f5cbbb3c7d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:37.169876 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1122/2219] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:38:37.174568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109e34e-965a-4c19-8c72-f348f4e8f663 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:37.189534 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109e34e-965a-4c19-8c72-f348f4e8f663 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:37.196132 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1b5e8-21aa-4b67-ab91-3d8d778e0596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:37.196829 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1b5e8-21aa-4b67-ab91-3d8d778e0596 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:37.197117 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1b5e8-21aa-4b67-ab91-3d8d778e0596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:37.197450 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1b5e8-21aa-4b67-ab91-3d8d778e0596 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:37.198815 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1b5e8-21aa-4b67-ab91-3d8d778e0596 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:38:37.199247 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1b5e8-21aa-4b67-ab91-3d8d778e0596 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:37.202269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1b5e8-21aa-4b67-ab91-3d8d778e0596 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:37.217356 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1098/2220] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:38:37.222038 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed900e05-eb3a-44b2-ae53-f5cbbb3c7d31 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:37.252490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed900e05-eb3a-44b2-ae53-f5cbbb3c7d31 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:37.265271 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca4590-673c-4f9d-bdd8-a1b88c7882a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:37.266311 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca4590-673c-4f9d-bdd8-a1b88c7882a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:37.266695 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca4590-673c-4f9d-bdd8-a1b88c7882a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:37.267132 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca4590-673c-4f9d-bdd8-a1b88c7882a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:37.268906 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca4590-673c-4f9d-bdd8-a1b88c7882a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:37.271304 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca4590-673c-4f9d-bdd8-a1b88c7882a8 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:37.308075 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1123/2221] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:38:37 2022] POST /identity/v3/projects => generated 391 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:38:37.312117 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1b5e8-21aa-4b67-ab91-3d8d778e0596 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:37.347291 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1b5e8-21aa-4b67-ab91-3d8d778e0596 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:37.469218 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293652e-217e-457a-8c44-6ea184d9231e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:37.470730 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293652e-217e-457a-8c44-6ea184d9231e admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:37.471255 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293652e-217e-457a-8c44-6ea184d9231e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:37.473054 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293652e-217e-457a-8c44-6ea184d9231e admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:37.475250 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293652e-217e-457a-8c44-6ea184d9231e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:37.478273 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293652e-217e-457a-8c44-6ea184d9231e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:37.526090 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1099/2222] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:38:37 2022] POST /identity/v3/users => generated 296 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:38:37.529961 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca4590-673c-4f9d-bdd8-a1b88c7882a8 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:37.542403 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca4590-673c-4f9d-bdd8-a1b88c7882a8 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:37.568854 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e7745-38e2-4685-964b-91ee0d2d23ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:37.570866 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e7745-38e2-4685-964b-91ee0d2d23ec admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:37.571159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e7745-38e2-4685-964b-91ee0d2d23ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:37.571443 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e7745-38e2-4685-964b-91ee0d2d23ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:37.572204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e7745-38e2-4685-964b-91ee0d2d23ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:37.579639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e7745-38e2-4685-964b-91ee0d2d23ec admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:37.620692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1124/2223] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:38:37.622788 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293652e-217e-457a-8c44-6ea184d9231e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:37.640248 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293652e-217e-457a-8c44-6ea184d9231e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:37.677493 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27945931-8609-4b85-9446-6829ba87196b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:37.708403 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27945931-8609-4b85-9446-6829ba87196b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:37.708403 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27945931-8609-4b85-9446-6829ba87196b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:37.708403 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27945931-8609-4b85-9446-6829ba87196b admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:37.708403 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27945931-8609-4b85-9446-6829ba87196b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:37.709629 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27945931-8609-4b85-9446-6829ba87196b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:37.723025 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1100/2224] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:38:37.728466 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e7745-38e2-4685-964b-91ee0d2d23ec admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:37.743337 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e7745-38e2-4685-964b-91ee0d2d23ec admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:37.748812 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469e217-fb99-4fb3-817e-7a03273d4dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:37.750601 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469e217-fb99-4fb3-817e-7a03273d4dfa admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:37.751777 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469e217-fb99-4fb3-817e-7a03273d4dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:37.752278 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469e217-fb99-4fb3-817e-7a03273d4dfa admin admin] PATH_INFO: `/v3/projects/a47d73246fcf4884b78733a1e59fd5e4/users/c09f96efb559431c99323428cbf67e13/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:37.775739 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469e217-fb99-4fb3-817e-7a03273d4dfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a47d73246fcf4884b78733a1e59fd5e4, user_id=c09f96efb559431c99323428cbf67e13, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:37.779379 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469e217-fb99-4fb3-817e-7a03273d4dfa admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:37.798502 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1125/2225] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:38:37 2022] PUT /identity/v3/projects/a47d73246fcf4884b78733a1e59fd5e4/users/c09f96efb559431c99323428cbf67e13/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:38:37.810140 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71316557-3eba-4bbd-87d7-4e79560c82e2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:37.810354 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71316557-3eba-4bbd-87d7-4e79560c82e2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:37.810643 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71316557-3eba-4bbd-87d7-4e79560c82e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:37.905769 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-71316557-3eba-4bbd-87d7-4e79560c82e2 None None] MFA Rules not processed for user `c09f96efb559431c99323428cbf67e13`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:37.907130 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-71316557-3eba-4bbd-87d7-4e79560c82e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:38.007807 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1101/2226] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:38:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:38:38.032212 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469e217-fb99-4fb3-817e-7a03273d4dfa admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:38.033693 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3469e217-fb99-4fb3-817e-7a03273d4dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:38.146847 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469e217-fb99-4fb3-817e-7a03273d4dfa admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:38.153116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffdb1b-1407-4083-837a-27b6df7f074a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:38.153787 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffdb1b-1407-4083-837a-27b6df7f074a service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:38.154073 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffdb1b-1407-4083-837a-27b6df7f074a service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:38.154493 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffdb1b-1407-4083-837a-27b6df7f074a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:38.164687 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ffdb1b-1407-4083-837a-27b6df7f074a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:38.166322 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ffdb1b-1407-4083-837a-27b6df7f074a service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:38.177676 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1126/2227] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:38:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:38:38.958477 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d146c-c9ac-4880-a3e9-b23c97694b79 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:38.958888 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d146c-c9ac-4880-a3e9-b23c97694b79 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:38.959413 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d146c-c9ac-4880-a3e9-b23c97694b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:38.980313 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a25d146c-c9ac-4880-a3e9-b23c97694b79 None None] MFA Rules not processed for user `a1622acb057f419ca98e7d44584c276d`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:38.981754 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a25d146c-c9ac-4880-a3e9-b23c97694b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:39.012920 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:39.076129 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1102/2228] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:38:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:38:40.385838 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38e0e2-5c27-4aee-afbc-d59a739b457f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:40.386412 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38e0e2-5c27-4aee-afbc-d59a739b457f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:40.386511 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38e0e2-5c27-4aee-afbc-d59a739b457f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:40.410183 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-9a38e0e2-5c27-4aee-afbc-d59a739b457f None None] MFA Rules not processed for user `bbcd5ba866b84d099d183fe19ba61a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:40.411998 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9a38e0e2-5c27-4aee-afbc-d59a739b457f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:40.443470 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:40.503085 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1127/2229] 10.222.0.32 () {58 vars in 1009 bytes} [Thu Jun 2 13:38:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:38:40.519828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d146c-c9ac-4880-a3e9-b23c97694b79 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:40.522743 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a25d146c-c9ac-4880-a3e9-b23c97694b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:40.668437 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d146c-c9ac-4880-a3e9-b23c97694b79 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:40.674965 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6b295-145d-4ea7-bb09-a6476fba87c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aea97e7b39448a283032f662142b6e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:40.677378 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6b295-145d-4ea7-bb09-a6476fba87c1 service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:40.677947 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6b295-145d-4ea7-bb09-a6476fba87c1 service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:40.678382 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6b295-145d-4ea7-bb09-a6476fba87c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:40.691663 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6b295-145d-4ea7-bb09-a6476fba87c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:40.693575 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6b295-145d-4ea7-bb09-a6476fba87c1 service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:40.705349 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1103/2230] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Jun 2 13:38:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:38:43.479349 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881dba1-7168-4799-a6c5-515f6c1c33f3 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:43.479841 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881dba1-7168-4799-a6c5-515f6c1c33f3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:43.479954 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881dba1-7168-4799-a6c5-515f6c1c33f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:43.506381 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-6881dba1-7168-4799-a6c5-515f6c1c33f3 None None] MFA Rules not processed for user `cdb81e45304e40ea88a703204b1a1868`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:43.507506 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6881dba1-7168-4799-a6c5-515f6c1c33f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:43.573727 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1128/2231] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:38:43 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:38:43.588329 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6b295-145d-4ea7-bb09-a6476fba87c1 service swift] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:43.589742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b1d6b295-145d-4ea7-bb09-a6476fba87c1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:43.666281 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6b295-145d-4ea7-bb09-a6476fba87c1 service swift] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:43.671717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78d63b-aa6c-4eb5-8d52-e9af8a44e72d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:43.672467 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78d63b-aa6c-4eb5-8d52-e9af8a44e72d service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:43.672768 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78d63b-aa6c-4eb5-8d52-e9af8a44e72d service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:43.673049 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78d63b-aa6c-4eb5-8d52-e9af8a44e72d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:43.675032 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8a78d63b-aa6c-4eb5-8d52-e9af8a44e72d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:43.749705 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:43.761887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a78d63b-aa6c-4eb5-8d52-e9af8a44e72d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:43.763465 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a78d63b-aa6c-4eb5-8d52-e9af8a44e72d service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:43.776620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1104/2232] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:38:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:38:46.331746 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fe5f3-2cef-48ca-83e7-3014e2089e0b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:46.332390 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fe5f3-2cef-48ca-83e7-3014e2089e0b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:46.332390 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fe5f3-2cef-48ca-83e7-3014e2089e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:46.401329 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-067fe5f3-2cef-48ca-83e7-3014e2089e0b None None] MFA Rules not processed for user `02eb6e337f9a4bf5992b8668a6f0fa3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:46.402829 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-067fe5f3-2cef-48ca-83e7-3014e2089e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:46.428798 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1129/2233] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:38:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:38:53.769036 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:56.376679 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=49 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:58.764734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78d63b-aa6c-4eb5-8d52-e9af8a44e72d service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:58.830152 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78d63b-aa6c-4eb5-8d52-e9af8a44e72d service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:58.834971 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb32591-2b6c-4178-9a3c-e068c8172bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:58.835826 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb32591-2b6c-4178-9a3c-e068c8172bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:58.836108 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb32591-2b6c-4178-9a3c-e068c8172bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:58.836413 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb32591-2b6c-4178-9a3c-e068c8172bf2 admin admin] PATH_INFO: `/v3/users/c09f96efb559431c99323428cbf67e13` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:58.837737 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb32591-2b6c-4178-9a3c-e068c8172bf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c09f96efb559431c99323428cbf67e13)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:58.839743 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb32591-2b6c-4178-9a3c-e068c8172bf2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:58.894097 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7eb32591-2b6c-4178-9a3c-e068c8172bf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c09f96efb559431c99323428cbf67e13'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:58.906305 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7eb32591-2b6c-4178-9a3c-e068c8172bf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c09f96efb559431c99323428cbf67e13'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:58.907462 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7eb32591-2b6c-4178-9a3c-e068c8172bf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c09f96efb559431c99323428cbf67e13'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:58.932711 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7eb32591-2b6c-4178-9a3c-e068c8172bf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c09f96efb559431c99323428cbf67e13'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:58.942879 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7eb32591-2b6c-4178-9a3c-e068c8172bf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c09f96efb559431c99323428cbf67e13'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:58.948937 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1105/2234] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:38:58 2022] DELETE /identity/v3/users/c09f96efb559431c99323428cbf67e13 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:38:58.953277 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae23d7-3859-4670-83fa-5cbf80d52545 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:58.953771 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae23d7-3859-4670-83fa-5cbf80d52545 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:58.953875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae23d7-3859-4670-83fa-5cbf80d52545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:58.971301 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-19ae23d7-3859-4670-83fa-5cbf80d52545 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:38:58.972606 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-19ae23d7-3859-4670-83fa-5cbf80d52545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:59.033976 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1130/2235] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:38:59.043474 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb32591-2b6c-4178-9a3c-e068c8172bf2 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:59.044971 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7eb32591-2b6c-4178-9a3c-e068c8172bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:59.104614 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb32591-2b6c-4178-9a3c-e068c8172bf2 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:59.108248 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0951dcf-6a84-443b-b04a-6ed3614b905f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:59.108922 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0951dcf-6a84-443b-b04a-6ed3614b905f service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:59.109204 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0951dcf-6a84-443b-b04a-6ed3614b905f service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:59.109480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0951dcf-6a84-443b-b04a-6ed3614b905f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:59.118417 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0951dcf-6a84-443b-b04a-6ed3614b905f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:59.119793 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0951dcf-6a84-443b-b04a-6ed3614b905f service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:59.129642 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1106/2236] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:38:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:38:59.419617 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae23d7-3859-4670-83fa-5cbf80d52545 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:38:59.421130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-19ae23d7-3859-4670-83fa-5cbf80d52545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:38:59.435117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae23d7-3859-4670-83fa-5cbf80d52545 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:38:59.443646 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4fd4a-88e5-493e-bb8f-b400864f4020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:38:59.444638 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4fd4a-88e5-493e-bb8f-b400864f4020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:38:59.444996 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4fd4a-88e5-493e-bb8f-b400864f4020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:38:59.445566 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4fd4a-88e5-493e-bb8f-b400864f4020 admin admin] PATH_INFO: `/v3/projects/a47d73246fcf4884b78733a1e59fd5e4` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:38:59.447294 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4fd4a-88e5-493e-bb8f-b400864f4020 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a47d73246fcf4884b78733a1e59fd5e4)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:38:59.450174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4fd4a-88e5-493e-bb8f-b400864f4020 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:38:59.523681 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a2b4fd4a-88e5-493e-bb8f-b400864f4020 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a47d73246fcf4884b78733a1e59fd5e4', 'request_id': 'req-a2b4fd4a-88e5-493e-bb8f-b400864f4020'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:59.533015 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a2b4fd4a-88e5-493e-bb8f-b400864f4020 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a47d73246fcf4884b78733a1e59fd5e4', 'request_id': 'req-a2b4fd4a-88e5-493e-bb8f-b400864f4020'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:59.540960 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a2b4fd4a-88e5-493e-bb8f-b400864f4020 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a47d73246fcf4884b78733a1e59fd5e4', 'request_id': 'req-a2b4fd4a-88e5-493e-bb8f-b400864f4020'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:59.555631 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a2b4fd4a-88e5-493e-bb8f-b400864f4020 admin admin] The token cache is being invalidate because project a47d73246fcf4884b78733a1e59fd5e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:38:59.556023 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a2b4fd4a-88e5-493e-bb8f-b400864f4020 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:59.556809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a2b4fd4a-88e5-493e-bb8f-b400864f4020 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:38:59.558492 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1131/2237] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:38:59 2022] DELETE /identity/v3/projects/a47d73246fcf4884b78733a1e59fd5e4 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:39:02.812889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb651c-7a89-42b2-b8b4-63d18562a2ab None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:02.813435 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb651c-7a89-42b2-b8b4-63d18562a2ab None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:02.813435 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb651c-7a89-42b2-b8b4-63d18562a2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:02.830978 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1fbb651c-7a89-42b2-b8b4-63d18562a2ab None None] MFA Rules not processed for user `b92da35ea7c946ea876b13b13ed98258`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:02.832704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1fbb651c-7a89-42b2-b8b4-63d18562a2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:02.852530 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:02.900241 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1107/2238] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:39:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:03.633938 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4ba3b-66d0-4689-9882-e466a3e7609f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:03.634466 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4ba3b-66d0-4689-9882-e466a3e7609f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:03.634653 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4ba3b-66d0-4689-9882-e466a3e7609f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:03.672686 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-59d4ba3b-66d0-4689-9882-e466a3e7609f None None] MFA Rules not processed for user `bbcd5ba866b84d099d183fe19ba61a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:03.674933 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-59d4ba3b-66d0-4689-9882-e466a3e7609f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:03.788735 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1132/2239] 10.222.0.32 () {58 vars in 1009 bytes} [Thu Jun 2 13:39:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:03.798884 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb651c-7a89-42b2-b8b4-63d18562a2ab None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:03.801893 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1fbb651c-7a89-42b2-b8b4-63d18562a2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:03.888203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb651c-7a89-42b2-b8b4-63d18562a2ab None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:03.896472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73059c-ae08-4aac-acca-ce9e034c16bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aea97e7b39448a283032f662142b6e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:03.897481 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73059c-ae08-4aac-acca-ce9e034c16bb service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:03.897917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73059c-ae08-4aac-acca-ce9e034c16bb service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:03.898375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73059c-ae08-4aac-acca-ce9e034c16bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:03.908191 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73059c-ae08-4aac-acca-ce9e034c16bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:03.910203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73059c-ae08-4aac-acca-ce9e034c16bb service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:03.942952 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1108/2240] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Jun 2 13:39:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:39:13.760653 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:13.796079 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c7bd3-4bc4-4546-af08-8266bfe50782 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:13.796425 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c7bd3-4bc4-4546-af08-8266bfe50782 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:13.796954 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c7bd3-4bc4-4546-af08-8266bfe50782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:13.818831 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d57c7bd3-4bc4-4546-af08-8266bfe50782 None None] MFA Rules not processed for user `bbcd5ba866b84d099d183fe19ba61a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:13.820370 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d57c7bd3-4bc4-4546-af08-8266bfe50782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:13.830804 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1133/2241] 10.222.0.32 () {58 vars in 1009 bytes} [Thu Jun 2 13:39:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:13.857548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73059c-ae08-4aac-acca-ce9e034c16bb service swift] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:13.871878 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73059c-ae08-4aac-acca-ce9e034c16bb service swift] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:13.877086 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb8f3f-e171-458b-b235-dabdf2fe00bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aea97e7b39448a283032f662142b6e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:13.878030 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb8f3f-e171-458b-b235-dabdf2fe00bc service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:13.878534 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb8f3f-e171-458b-b235-dabdf2fe00bc service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:13.879022 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb8f3f-e171-458b-b235-dabdf2fe00bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:13.889819 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb8f3f-e171-458b-b235-dabdf2fe00bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:13.891631 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb8f3f-e171-458b-b235-dabdf2fe00bc service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:13.903656 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1109/2242] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Jun 2 13:39:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:39:21.189330 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c7bd3-4bc4-4546-af08-8266bfe50782 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:21.193283 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d57c7bd3-4bc4-4546-af08-8266bfe50782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:21.555777 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c7bd3-4bc4-4546-af08-8266bfe50782 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:21.561856 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df3c5b-0c5c-416b-a30c-97adbae71bf4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24410ef5e78042c79c5b4a0d78b56258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:21.564448 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df3c5b-0c5c-416b-a30c-97adbae71bf4 service placement] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:21.564955 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df3c5b-0c5c-416b-a30c-97adbae71bf4 service placement] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:21.565434 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df3c5b-0c5c-416b-a30c-97adbae71bf4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:21.574161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-89df3c5b-0c5c-416b-a30c-97adbae71bf4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:21.623284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df3c5b-0c5c-416b-a30c-97adbae71bf4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:21.629333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df3c5b-0c5c-416b-a30c-97adbae71bf4 service placement] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:21.656922 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1134/2243] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:39:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:39:23.899392 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=53 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:28.493845 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46dce2-d8d2-49b0-8916-01e184bb22e0 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:28.494472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46dce2-d8d2-49b0-8916-01e184bb22e0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:28.494472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46dce2-d8d2-49b0-8916-01e184bb22e0 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:28.496220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1110/2244] 10.222.0.32 () {54 vars in 921 bytes} [Thu Jun 2 13:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:39:28.506977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316f40c-01c0-473d-9479-13ecb6c1a090 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:28.507918 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316f40c-01c0-473d-9479-13ecb6c1a090 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:28.508396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316f40c-01c0-473d-9479-13ecb6c1a090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:28.632748 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c316f40c-01c0-473d-9479-13ecb6c1a090 None None] MFA Rules not processed for user `b2e5d9f3c4e04ca3bf52b28b67d2a4d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:28.634383 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c316f40c-01c0-473d-9479-13ecb6c1a090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:28.808024 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1135/2245] 10.222.0.32 () {58 vars in 1018 bytes} [Thu Jun 2 13:39:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:39:28.821584 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46dce2-d8d2-49b0-8916-01e184bb22e0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:28.824423 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-af46dce2-d8d2-49b0-8916-01e184bb22e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:29.042457 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46dce2-d8d2-49b0-8916-01e184bb22e0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:29.048926 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c440023-f547-4a7b-a99c-75af0ea286bb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e239e4e9b99433ca9d1a8db45e24b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:29.050720 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c440023-f547-4a7b-a99c-75af0ea286bb service glance] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:29.051348 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c440023-f547-4a7b-a99c-75af0ea286bb service glance] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:29.051794 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c440023-f547-4a7b-a99c-75af0ea286bb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:29.074517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c440023-f547-4a7b-a99c-75af0ea286bb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:29.076228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c440023-f547-4a7b-a99c-75af0ea286bb service glance] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:29.102494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1111/2246] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:39:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:39:29.226113 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881bbb1-b9e9-46fd-a27d-62201485218d None None] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:29.226842 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881bbb1-b9e9-46fd-a27d-62201485218d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:29.227427 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881bbb1-b9e9-46fd-a27d-62201485218d None None] PATH_INFO: `/` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:29.230614 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1136/2247] 10.222.0.32 () {54 vars in 921 bytes} [Thu Jun 2 13:39:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:39:29.247012 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e2003-96b8-41be-bdf0-7624ac6ed3fb None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:29.247306 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e2003-96b8-41be-bdf0-7624ac6ed3fb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:29.247595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e2003-96b8-41be-bdf0-7624ac6ed3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:29.355459 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c01e2003-96b8-41be-bdf0-7624ac6ed3fb None None] MFA Rules not processed for user `9eb2722c122f4aeba23ec16b5a3c485f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:29.357691 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c01e2003-96b8-41be-bdf0-7624ac6ed3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:29.572493 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1112/2248] 10.222.0.32 () {58 vars in 1018 bytes} [Thu Jun 2 13:39:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:29.644882 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881bbb1-b9e9-46fd-a27d-62201485218d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:29.647447 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0881bbb1-b9e9-46fd-a27d-62201485218d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:29.664201 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881bbb1-b9e9-46fd-a27d-62201485218d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:29.668492 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4f20b-46fa-4776-a1de-a275bcdbf1a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:29.669908 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4f20b-46fa-4776-a1de-a275bcdbf1a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:29.670610 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4f20b-46fa-4776-a1de-a275bcdbf1a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:29.671259 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4f20b-46fa-4776-a1de-a275bcdbf1a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:29.680679 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4f20b-46fa-4776-a1de-a275bcdbf1a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:29.682605 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4f20b-46fa-4776-a1de-a275bcdbf1a1 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:29.688594 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:29.694779 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1137/2249] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:39:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:39:30.206745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c6e21-7aec-42dc-87d3-abcc8eca8c45 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:30.206745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c6e21-7aec-42dc-87d3-abcc8eca8c45 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:30.206745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c6e21-7aec-42dc-87d3-abcc8eca8c45 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:30.207852 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1113/2250] 10.222.0.32 () {54 vars in 921 bytes} [Thu Jun 2 13:39:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:39:30.218877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f2bd0-50e6-4fe9-ba14-113edc237d8e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:30.219335 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f2bd0-50e6-4fe9-ba14-113edc237d8e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:30.219723 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f2bd0-50e6-4fe9-ba14-113edc237d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:30.257330 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-602f2bd0-50e6-4fe9-ba14-113edc237d8e None None] MFA Rules not processed for user `b2e5d9f3c4e04ca3bf52b28b67d2a4d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:30.258644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-602f2bd0-50e6-4fe9-ba14-113edc237d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:30.273612 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1138/2251] 10.222.0.32 () {58 vars in 1018 bytes} [Thu Jun 2 13:39:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:30.323370 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c6e21-7aec-42dc-87d3-abcc8eca8c45 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:30.342821 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c6e21-7aec-42dc-87d3-abcc8eca8c45 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:30.354661 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef834d4-faff-4c36-94be-91b0db0727f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:30.355432 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef834d4-faff-4c36-94be-91b0db0727f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:30.355822 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef834d4-faff-4c36-94be-91b0db0727f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:30.356213 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef834d4-faff-4c36-94be-91b0db0727f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:30.379754 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef834d4-faff-4c36-94be-91b0db0727f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:30.382175 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef834d4-faff-4c36-94be-91b0db0727f8 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:30.397849 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1114/2252] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:39:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:39:34.267446 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f2bd0-50e6-4fe9-ba14-113edc237d8e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:34.269737 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-602f2bd0-50e6-4fe9-ba14-113edc237d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:34.282332 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f2bd0-50e6-4fe9-ba14-113edc237d8e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:34.286164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd5853-8b9a-40d2-86e9-a960624e023d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:34.287106 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd5853-8b9a-40d2-86e9-a960624e023d service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:34.288893 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd5853-8b9a-40d2-86e9-a960624e023d service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:34.288995 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd5853-8b9a-40d2-86e9-a960624e023d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:34.291216 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-96fd5853-8b9a-40d2-86e9-a960624e023d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:34.371103 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd5853-8b9a-40d2-86e9-a960624e023d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:34.374983 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd5853-8b9a-40d2-86e9-a960624e023d service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:34.391620 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1139/2253] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:39:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:39:36.578296 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116a11d-7fcf-4d2b-a87e-fbf96d848891 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:36.579253 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116a11d-7fcf-4d2b-a87e-fbf96d848891 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:36.579253 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116a11d-7fcf-4d2b-a87e-fbf96d848891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:36.646368 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1116a11d-7fcf-4d2b-a87e-fbf96d848891 None None] MFA Rules not processed for user `bbcd5ba866b84d099d183fe19ba61a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:36.647810 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1116a11d-7fcf-4d2b-a87e-fbf96d848891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:36.668059 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1115/2254] 10.222.0.32 () {58 vars in 967 bytes} [Thu Jun 2 13:39:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:36.683291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd5853-8b9a-40d2-86e9-a960624e023d service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:36.709109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd5853-8b9a-40d2-86e9-a960624e023d service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:36.714074 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b4910-f3f6-4161-ad2e-c4632da599cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aea97e7b39448a283032f662142b6e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:36.715090 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b4910-f3f6-4161-ad2e-c4632da599cb service swift] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:36.715584 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b4910-f3f6-4161-ad2e-c4632da599cb service swift] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:36.715990 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b4910-f3f6-4161-ad2e-c4632da599cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:36.726199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b4910-f3f6-4161-ad2e-c4632da599cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:36.728038 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b4910-f3f6-4161-ad2e-c4632da599cb service swift] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:36.739038 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1140/2255] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Jun 2 13:39:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:39:38.465730 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed9d55-08bd-4172-9f53-fb5cd0aa8ee2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:38.466614 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed9d55-08bd-4172-9f53-fb5cd0aa8ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:38.467116 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed9d55-08bd-4172-9f53-fb5cd0aa8ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:38.495207 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1eed9d55-08bd-4172-9f53-fb5cd0aa8ee2 None None] MFA Rules not processed for user `bbcd5ba866b84d099d183fe19ba61a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:38.497013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1eed9d55-08bd-4172-9f53-fb5cd0aa8ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:38.506261 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1116/2256] 10.222.0.32 () {58 vars in 1009 bytes} [Thu Jun 2 13:39:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:38.528511 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b4910-f3f6-4161-ad2e-c4632da599cb service swift] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:38.544768 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b4910-f3f6-4161-ad2e-c4632da599cb service swift] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:38.552170 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de8eb6-e5c1-4aa1-b4f5-294de10e98ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aea97e7b39448a283032f662142b6e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:38.552961 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de8eb6-e5c1-4aa1-b4f5-294de10e98ad service swift] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:38.553323 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de8eb6-e5c1-4aa1-b4f5-294de10e98ad service swift] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:38.554005 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de8eb6-e5c1-4aa1-b4f5-294de10e98ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:38.563284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de8eb6-e5c1-4aa1-b4f5-294de10e98ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:38.565440 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de8eb6-e5c1-4aa1-b4f5-294de10e98ad service swift] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:38.575370 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1141/2257] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Jun 2 13:39:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:39:39.416832 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed9d55-08bd-4172-9f53-fb5cd0aa8ee2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:39.418542 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1eed9d55-08bd-4172-9f53-fb5cd0aa8ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:39.465084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:39.498833 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed9d55-08bd-4172-9f53-fb5cd0aa8ee2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:39.504163 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361036e3-80fa-4c94-8613-b4f5cd56ffc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:39.505327 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361036e3-80fa-4c94-8613-b4f5cd56ffc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:39.505726 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361036e3-80fa-4c94-8613-b4f5cd56ffc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:39.506094 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361036e3-80fa-4c94-8613-b4f5cd56ffc1 admin admin] PATH_INFO: `/v3/users/2351177553054eeebc4c60abcfecfa70` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:39.507448 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361036e3-80fa-4c94-8613-b4f5cd56ffc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2351177553054eeebc4c60abcfecfa70)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:39.509772 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361036e3-80fa-4c94-8613-b4f5cd56ffc1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:39.572616 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-361036e3-80fa-4c94-8613-b4f5cd56ffc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2351177553054eeebc4c60abcfecfa70'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:39:39.582189 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-361036e3-80fa-4c94-8613-b4f5cd56ffc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2351177553054eeebc4c60abcfecfa70'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:39:39.583214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-361036e3-80fa-4c94-8613-b4f5cd56ffc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2351177553054eeebc4c60abcfecfa70'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:39:39.597437 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-361036e3-80fa-4c94-8613-b4f5cd56ffc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2351177553054eeebc4c60abcfecfa70'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:39:39.604931 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-361036e3-80fa-4c94-8613-b4f5cd56ffc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2351177553054eeebc4c60abcfecfa70'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:39:39.611767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1117/2258] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:39:39 2022] DELETE /identity/v3/users/2351177553054eeebc4c60abcfecfa70 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:39:39.819820 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de8eb6-e5c1-4aa1-b4f5-294de10e98ad service swift] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:39.848089 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de8eb6-e5c1-4aa1-b4f5-294de10e98ad service swift] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:39.913325 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92615c09-0a25-4732-a129-ebaf96379b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:39.914219 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92615c09-0a25-4732-a129-ebaf96379b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:39.914484 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92615c09-0a25-4732-a129-ebaf96379b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:39.914847 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92615c09-0a25-4732-a129-ebaf96379b3e admin admin] PATH_INFO: `/v3/projects/46301efc51224c3db7660777fac426b2` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:39.916082 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92615c09-0a25-4732-a129-ebaf96379b3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=46301efc51224c3db7660777fac426b2)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:39.918231 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92615c09-0a25-4732-a129-ebaf96379b3e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:39.977902 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-92615c09-0a25-4732-a129-ebaf96379b3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46301efc51224c3db7660777fac426b2', 'request_id': 'req-92615c09-0a25-4732-a129-ebaf96379b3e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:39:39.981555 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:39.985773 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-92615c09-0a25-4732-a129-ebaf96379b3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46301efc51224c3db7660777fac426b2', 'request_id': 'req-92615c09-0a25-4732-a129-ebaf96379b3e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:39:39.993314 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-92615c09-0a25-4732-a129-ebaf96379b3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46301efc51224c3db7660777fac426b2', 'request_id': 'req-92615c09-0a25-4732-a129-ebaf96379b3e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:39:40.004860 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-92615c09-0a25-4732-a129-ebaf96379b3e admin admin] The token cache is being invalidate because project 46301efc51224c3db7660777fac426b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:39:40.005155 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-92615c09-0a25-4732-a129-ebaf96379b3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:39:40.005814 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-92615c09-0a25-4732-a129-ebaf96379b3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:39:40.007386 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1142/2259] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:39:39 2022] DELETE /identity/v3/projects/46301efc51224c3db7660777fac426b2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:39:40.013381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680b7de-fe93-4043-9433-491de55616bd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:40.014136 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680b7de-fe93-4043-9433-491de55616bd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:40.014690 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680b7de-fe93-4043-9433-491de55616bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:40.040180 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5680b7de-fe93-4043-9433-491de55616bd None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:40.041886 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5680b7de-fe93-4043-9433-491de55616bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:40.119893 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1118/2260] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:40.121694 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487c5f6-c0a6-4e53-ad1a-e1e315109c02 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:40.122087 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487c5f6-c0a6-4e53-ad1a-e1e315109c02 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:40.122377 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487c5f6-c0a6-4e53-ad1a-e1e315109c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:40.143602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-4487c5f6-c0a6-4e53-ad1a-e1e315109c02 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:40.144895 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4487c5f6-c0a6-4e53-ad1a-e1e315109c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:40.155422 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1143/2261] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:40.160193 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680b7de-fe93-4043-9433-491de55616bd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:40.170013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680b7de-fe93-4043-9433-491de55616bd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:40.174745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911e164-d526-4f97-b057-77d21b2e2ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:40.175401 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911e164-d526-4f97-b057-77d21b2e2ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:40.175683 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911e164-d526-4f97-b057-77d21b2e2ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:40.175958 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911e164-d526-4f97-b057-77d21b2e2ee1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:40.176737 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911e164-d526-4f97-b057-77d21b2e2ee1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:39:40.177044 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911e164-d526-4f97-b057-77d21b2e2ee1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:40.178655 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911e164-d526-4f97-b057-77d21b2e2ee1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:40.192656 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1119/2262] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:39:40.197096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487c5f6-c0a6-4e53-ad1a-e1e315109c02 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:40.208325 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487c5f6-c0a6-4e53-ad1a-e1e315109c02 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:40.214525 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51476b80-c173-4c02-9800-e09ca0f2146a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:40.215656 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51476b80-c173-4c02-9800-e09ca0f2146a admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:40.216162 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51476b80-c173-4c02-9800-e09ca0f2146a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:40.216628 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51476b80-c173-4c02-9800-e09ca0f2146a admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:40.217842 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51476b80-c173-4c02-9800-e09ca0f2146a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:40.220099 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51476b80-c173-4c02-9800-e09ca0f2146a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:40.247127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1144/2263] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:39:40 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:39:40.251287 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911e164-d526-4f97-b057-77d21b2e2ee1 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:40.263780 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911e164-d526-4f97-b057-77d21b2e2ee1 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:40.331318 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:40.356785 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a39c32-1657-4331-824c-ad0f229069b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:40.357659 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a39c32-1657-4331-824c-ad0f229069b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:40.358173 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a39c32-1657-4331-824c-ad0f229069b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:40.358541 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a39c32-1657-4331-824c-ad0f229069b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:40.359595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a39c32-1657-4331-824c-ad0f229069b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:40.362752 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a39c32-1657-4331-824c-ad0f229069b1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:40.400772 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1120/2264] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:39:40 2022] POST /identity/v3/users => generated 285 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:39:40.405512 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51476b80-c173-4c02-9800-e09ca0f2146a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:40.418956 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51476b80-c173-4c02-9800-e09ca0f2146a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:40.424291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9210561-4985-4e10-adf0-781c9080a17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:40.424994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9210561-4985-4e10-adf0-781c9080a17d admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:40.425457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9210561-4985-4e10-adf0-781c9080a17d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:40.425859 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9210561-4985-4e10-adf0-781c9080a17d admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:40.427148 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9210561-4985-4e10-adf0-781c9080a17d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:40.429290 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9210561-4985-4e10-adf0-781c9080a17d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:40.443430 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1145/2265] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:39:40.447810 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a39c32-1657-4331-824c-ad0f229069b1 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:40.459481 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a39c32-1657-4331-824c-ad0f229069b1 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:40.464126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a15d859-03e4-43c0-af09-3feb5640b261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:40.464879 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15d859-03e4-43c0-af09-3feb5640b261 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:40.465255 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15d859-03e4-43c0-af09-3feb5640b261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:40.465551 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15d859-03e4-43c0-af09-3feb5640b261 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:40.466310 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a15d859-03e4-43c0-af09-3feb5640b261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:40.468010 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a15d859-03e4-43c0-af09-3feb5640b261 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:40.492346 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1121/2266] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:39:40.495127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9210561-4985-4e10-adf0-781c9080a17d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:40.516487 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9210561-4985-4e10-adf0-781c9080a17d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:40.522366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31266bc7-0336-4e19-86c5-a6964c2b73f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:40.523268 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31266bc7-0336-4e19-86c5-a6964c2b73f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:40.523554 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31266bc7-0336-4e19-86c5-a6964c2b73f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:40.523840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31266bc7-0336-4e19-86c5-a6964c2b73f6 admin admin] PATH_INFO: `/v3/projects/7498b225c3ce424da8d507c59729d4f6/users/ae6cd4581d954b19aac9a78af34edcc3/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:40.541101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31266bc7-0336-4e19-86c5-a6964c2b73f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7498b225c3ce424da8d507c59729d4f6, user_id=ae6cd4581d954b19aac9a78af34edcc3, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:40.543768 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31266bc7-0336-4e19-86c5-a6964c2b73f6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:40.556746 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1146/2267] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:39:40 2022] PUT /identity/v3/projects/7498b225c3ce424da8d507c59729d4f6/users/ae6cd4581d954b19aac9a78af34edcc3/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:39:40.626180 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b10a7-7d24-40c3-b3ca-f534b30ab1eb None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:40.627339 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b10a7-7d24-40c3-b3ca-f534b30ab1eb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:40.627339 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b10a7-7d24-40c3-b3ca-f534b30ab1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:40.653551 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-306b10a7-7d24-40c3-b3ca-f534b30ab1eb None None] MFA Rules not processed for user `ae6cd4581d954b19aac9a78af34edcc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:39:40.654684 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-306b10a7-7d24-40c3-b3ca-f534b30ab1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:40.722120 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1122/2268] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:39:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:39:40.734729 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31266bc7-0336-4e19-86c5-a6964c2b73f6 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:40.736914 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-31266bc7-0336-4e19-86c5-a6964c2b73f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:40.804705 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31266bc7-0336-4e19-86c5-a6964c2b73f6 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:40.808383 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e0ccd-bf78-45ce-a9bb-65d4b54177c4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e239e4e9b99433ca9d1a8db45e24b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:40.809034 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e0ccd-bf78-45ce-a9bb-65d4b54177c4 service glance] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:40.809350 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e0ccd-bf78-45ce-a9bb-65d4b54177c4 service glance] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:40.809627 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e0ccd-bf78-45ce-a9bb-65d4b54177c4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:40.819035 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e0ccd-bf78-45ce-a9bb-65d4b54177c4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:40.820518 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e0ccd-bf78-45ce-a9bb-65d4b54177c4 service glance] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:40.829922 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1147/2269] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:39:40 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:39:50.719232 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=48,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:50.825351 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=59,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:59.802173 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b10a7-7d24-40c3-b3ca-f534b30ab1eb None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:39:59.803674 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-306b10a7-7d24-40c3-b3ca-f534b30ab1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:59.862514 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b10a7-7d24-40c3-b3ca-f534b30ab1eb None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:39:59.866255 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c06e78-1649-4f51-b913-c32248de1857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:39:59.866903 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c06e78-1649-4f51-b913-c32248de1857 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:39:59.867185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c06e78-1649-4f51-b913-c32248de1857 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:39:59.867459 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c06e78-1649-4f51-b913-c32248de1857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:39:59.869251 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-62c06e78-1649-4f51-b913-c32248de1857 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:39:59.933814 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c06e78-1649-4f51-b913-c32248de1857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:39:59.935281 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c06e78-1649-4f51-b913-c32248de1857 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:39:59.945316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1123/2270] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:39:59 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:09.941031 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=50 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:11.464018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4594e46-7b72-4097-a21b-bf4616192e5d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:11.464943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4594e46-7b72-4097-a21b-bf4616192e5d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:11.465301 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4594e46-7b72-4097-a21b-bf4616192e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:11.483090 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e4594e46-7b72-4097-a21b-bf4616192e5d None None] MFA Rules not processed for user `bbcd5ba866b84d099d183fe19ba61a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:11.484396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e4594e46-7b72-4097-a21b-bf4616192e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:11.551860 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1148/2271] 10.222.0.32 () {58 vars in 967 bytes} [Thu Jun 2 13:40:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:40:11.559173 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c06e78-1649-4f51-b913-c32248de1857 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:11.562545 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-62c06e78-1649-4f51-b913-c32248de1857 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:11.678288 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c06e78-1649-4f51-b913-c32248de1857 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:11.685015 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c2f56-f5e3-4b35-b508-e87eb20277f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aea97e7b39448a283032f662142b6e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:11.685998 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c2f56-f5e3-4b35-b508-e87eb20277f1 service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:11.686437 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c2f56-f5e3-4b35-b508-e87eb20277f1 service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:11.686873 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c2f56-f5e3-4b35-b508-e87eb20277f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:11.697793 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c2f56-f5e3-4b35-b508-e87eb20277f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:11.699668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c2f56-f5e3-4b35-b508-e87eb20277f1 service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:11.708599 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1124/2272] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Jun 2 13:40:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 13:40:20.411160 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4594e46-7b72-4097-a21b-bf4616192e5d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:20.473182 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4594e46-7b72-4097-a21b-bf4616192e5d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:20.477675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3920af-0640-4a06-a3e7-db75528633e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:20.478538 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3920af-0640-4a06-a3e7-db75528633e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:20.478822 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3920af-0640-4a06-a3e7-db75528633e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:20.479096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3920af-0640-4a06-a3e7-db75528633e7 admin admin] PATH_INFO: `/v3/users/ae6cd4581d954b19aac9a78af34edcc3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:20.480280 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3920af-0640-4a06-a3e7-db75528633e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae6cd4581d954b19aac9a78af34edcc3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:20.482259 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3920af-0640-4a06-a3e7-db75528633e7 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:20.527085 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-db3920af-0640-4a06-a3e7-db75528633e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae6cd4581d954b19aac9a78af34edcc3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:20.533815 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-db3920af-0640-4a06-a3e7-db75528633e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae6cd4581d954b19aac9a78af34edcc3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:20.534471 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-db3920af-0640-4a06-a3e7-db75528633e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae6cd4581d954b19aac9a78af34edcc3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:20.545901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-db3920af-0640-4a06-a3e7-db75528633e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae6cd4581d954b19aac9a78af34edcc3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:20.553934 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-db3920af-0640-4a06-a3e7-db75528633e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae6cd4581d954b19aac9a78af34edcc3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:20.560038 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1149/2273] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:40:20 2022] DELETE /identity/v3/users/ae6cd4581d954b19aac9a78af34edcc3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:20.565424 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee06ef-7a62-4cdb-bd40-82c8a1ae9f98 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:20.565886 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee06ef-7a62-4cdb-bd40-82c8a1ae9f98 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:20.565985 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee06ef-7a62-4cdb-bd40-82c8a1ae9f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:20.589926 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2dee06ef-7a62-4cdb-bd40-82c8a1ae9f98 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:20.591131 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2dee06ef-7a62-4cdb-bd40-82c8a1ae9f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:20.648629 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1125/2274] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:40:20.658361 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3920af-0640-4a06-a3e7-db75528633e7 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:20.659774 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-db3920af-0640-4a06-a3e7-db75528633e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:20.688002 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:20.719854 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3920af-0640-4a06-a3e7-db75528633e7 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:20.723547 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196a59e-b14d-4237-a8bb-dbc91584ea5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:20.724189 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196a59e-b14d-4237-a8bb-dbc91584ea5c service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:20.724530 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196a59e-b14d-4237-a8bb-dbc91584ea5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:20.724805 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196a59e-b14d-4237-a8bb-dbc91584ea5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:20.733762 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3196a59e-b14d-4237-a8bb-dbc91584ea5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:20.735198 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3196a59e-b14d-4237-a8bb-dbc91584ea5c service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:20.745105 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1150/2275] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:40:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:40:21.008187 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee06ef-7a62-4cdb-bd40-82c8a1ae9f98 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:40:21.010311 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2dee06ef-7a62-4cdb-bd40-82c8a1ae9f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:21.026486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee06ef-7a62-4cdb-bd40-82c8a1ae9f98 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:40:21.032925 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4618348-49b7-412a-a8e8-dcf31c120041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:40:21.033807 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4618348-49b7-412a-a8e8-dcf31c120041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:21.034088 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4618348-49b7-412a-a8e8-dcf31c120041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:21.034362 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4618348-49b7-412a-a8e8-dcf31c120041 admin admin] PATH_INFO: `/v3/projects/7498b225c3ce424da8d507c59729d4f6` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:21.035572 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4618348-49b7-412a-a8e8-dcf31c120041 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7498b225c3ce424da8d507c59729d4f6)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:40:21.038790 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4618348-49b7-412a-a8e8-dcf31c120041 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:40:21.086731 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c4618348-49b7-412a-a8e8-dcf31c120041 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7498b225c3ce424da8d507c59729d4f6', 'request_id': 'req-c4618348-49b7-412a-a8e8-dcf31c120041'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:21.092257 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c4618348-49b7-412a-a8e8-dcf31c120041 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7498b225c3ce424da8d507c59729d4f6', 'request_id': 'req-c4618348-49b7-412a-a8e8-dcf31c120041'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:21.099637 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c4618348-49b7-412a-a8e8-dcf31c120041 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7498b225c3ce424da8d507c59729d4f6', 'request_id': 'req-c4618348-49b7-412a-a8e8-dcf31c120041'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:21.110607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c4618348-49b7-412a-a8e8-dcf31c120041 admin admin] The token cache is being invalidate because project 7498b225c3ce424da8d507c59729d4f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:40:21.110897 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c4618348-49b7-412a-a8e8-dcf31c120041 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:21.111526 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c4618348-49b7-412a-a8e8-dcf31c120041 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:40:21.113098 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1126/2276] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:40:21 2022] DELETE /identity/v3/projects/7498b225c3ce424da8d507c59729d4f6 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:40:30.740975 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=15 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:31.107567 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:57.082827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ed291-00fa-48ad-af5e-e0e22fa9ceec None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:40:57.083364 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ed291-00fa-48ad-af5e-e0e22fa9ceec None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:40:57.083469 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ed291-00fa-48ad-af5e-e0e22fa9ceec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:40:57.100570 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-be0ed291-00fa-48ad-af5e-e0e22fa9ceec None None] MFA Rules not processed for user `a1622acb057f419ca98e7d44584c276d`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:40:57.101749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-be0ed291-00fa-48ad-af5e-e0e22fa9ceec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:40:57.154284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1151/2277] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:40:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:07.147599 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=25 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:09.176899 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db6cb0-7b67-4623-ae23-518eb6313a42 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:09.177426 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db6cb0-7b67-4623-ae23-518eb6313a42 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:09.177540 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db6cb0-7b67-4623-ae23-518eb6313a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:09.195447 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-38db6cb0-7b67-4623-ae23-518eb6313a42 None None] MFA Rules not processed for user `b92da35ea7c946ea876b13b13ed98258`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:09.196689 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-38db6cb0-7b67-4623-ae23-518eb6313a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:09.253905 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1127/2278] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:41:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:09.263305 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ed291-00fa-48ad-af5e-e0e22fa9ceec None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:09.264746 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-be0ed291-00fa-48ad-af5e-e0e22fa9ceec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:09.323227 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ed291-00fa-48ad-af5e-e0e22fa9ceec None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:09.327031 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634361b8-2d15-448d-bcab-1359d6174746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:09.327675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634361b8-2d15-448d-bcab-1359d6174746 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:09.327962 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634361b8-2d15-448d-bcab-1359d6174746 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:09.328542 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634361b8-2d15-448d-bcab-1359d6174746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:09.330503 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-634361b8-2d15-448d-bcab-1359d6174746 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:09.403573 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634361b8-2d15-448d-bcab-1359d6174746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:09.405172 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634361b8-2d15-448d-bcab-1359d6174746 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:09.416967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1152/2279] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:41:10.948951 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db6cb0-7b67-4623-ae23-518eb6313a42 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:10.959673 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db6cb0-7b67-4623-ae23-518eb6313a42 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:10.963264 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412c374-0d48-4e05-b04a-e15b7a34842e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:10.963908 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412c374-0d48-4e05-b04a-e15b7a34842e service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:10.964372 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412c374-0d48-4e05-b04a-e15b7a34842e service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:10.964654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412c374-0d48-4e05-b04a-e15b7a34842e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:10.966452 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8412c374-0d48-4e05-b04a-e15b7a34842e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:10.980234 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412c374-0d48-4e05-b04a-e15b7a34842e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:10.981529 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412c374-0d48-4e05-b04a-e15b7a34842e service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:10.998421 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1128/2280] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:41:19.412388 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=54 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:20.988195 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=31 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:21.940437 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2e81d-511c-4576-8f68-af1753e5490b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:21.940935 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2e81d-511c-4576-8f68-af1753e5490b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:21.941040 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2e81d-511c-4576-8f68-af1753e5490b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:21.958480 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-56d2e81d-511c-4576-8f68-af1753e5490b None None] MFA Rules not processed for user `88bc03c141d64772b606e087d86e973e`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:41:21.959686 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-56d2e81d-511c-4576-8f68-af1753e5490b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:22.015497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1153/2281] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:41:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:41:22.614908 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412c374-0d48-4e05-b04a-e15b7a34842e service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:22.616360 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8412c374-0d48-4e05-b04a-e15b7a34842e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:22.689527 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412c374-0d48-4e05-b04a-e15b7a34842e service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:22.695137 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9aa76-93e6-4433-ab7a-76f0d3570f02 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24410ef5e78042c79c5b4a0d78b56258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:22.695782 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9aa76-93e6-4433-ab7a-76f0d3570f02 service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:22.696066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9aa76-93e6-4433-ab7a-76f0d3570f02 service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:22.696372 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9aa76-93e6-4433-ab7a-76f0d3570f02 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:22.698127 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-40a9aa76-93e6-4433-ab7a-76f0d3570f02 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:22.710252 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9aa76-93e6-4433-ab7a-76f0d3570f02 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:22.711966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9aa76-93e6-4433-ab7a-76f0d3570f02 service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:22.724558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1129/2282] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:41:27.230027 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2e81d-511c-4576-8f68-af1753e5490b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:27.240111 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2e81d-511c-4576-8f68-af1753e5490b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:27.243691 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06592ce-8465-440d-a61e-48d59ec9fd12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:27.244383 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06592ce-8465-440d-a61e-48d59ec9fd12 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:27.244668 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06592ce-8465-440d-a61e-48d59ec9fd12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:27.244944 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06592ce-8465-440d-a61e-48d59ec9fd12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:27.246855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b06592ce-8465-440d-a61e-48d59ec9fd12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:27.258392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06592ce-8465-440d-a61e-48d59ec9fd12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:27.259790 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06592ce-8465-440d-a61e-48d59ec9fd12 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:27.268940 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1154/2283] 10.222.0.32 () {60 vars in 1396 bytes} [Thu Jun 2 13:41:27 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3254 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:41:30.779959 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9aa76-93e6-4433-ab7a-76f0d3570f02 service placement] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:30.781524 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-40a9aa76-93e6-4433-ab7a-76f0d3570f02 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:30.793319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9aa76-93e6-4433-ab7a-76f0d3570f02 service placement] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:30.797239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0629f-ba56-44e3-8a23-392fdf026bf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:30.797871 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0629f-ba56-44e3-8a23-392fdf026bf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:30.798157 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0629f-ba56-44e3-8a23-392fdf026bf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:30.798613 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0629f-ba56-44e3-8a23-392fdf026bf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:30.801047 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-77a0629f-ba56-44e3-8a23-392fdf026bf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:30.813428 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0629f-ba56-44e3-8a23-392fdf026bf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:30.814885 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0629f-ba56-44e3-8a23-392fdf026bf2 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:30.823234 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1130/2284] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:41:37.264579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=31 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:40.819616 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=38 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:57.065717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06592ce-8465-440d-a61e-48d59ec9fd12 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:57.071161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b06592ce-8465-440d-a61e-48d59ec9fd12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:57.092037 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06592ce-8465-440d-a61e-48d59ec9fd12 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:57.099161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2a8fb-c0b1-4248-9a93-285c6a844a5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:57.099921 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2a8fb-c0b1-4248-9a93-285c6a844a5d service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:57.100272 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2a8fb-c0b1-4248-9a93-285c6a844a5d service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:57.100755 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2a8fb-c0b1-4248-9a93-285c6a844a5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:57.103548 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d8e2a8fb-c0b1-4248-9a93-285c6a844a5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:57.120574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e2a8fb-c0b1-4248-9a93-285c6a844a5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:57.122429 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e2a8fb-c0b1-4248-9a93-285c6a844a5d service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:57.136852 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1155/2285] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:41:59.675322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0629f-ba56-44e3-8a23-392fdf026bf2 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:41:59.676801 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-77a0629f-ba56-44e3-8a23-392fdf026bf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:59.763688 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0629f-ba56-44e3-8a23-392fdf026bf2 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:41:59.767531 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f2ebe-7006-4271-8b7b-4f0decb3ab60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:41:59.768171 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f2ebe-7006-4271-8b7b-4f0decb3ab60 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:41:59.768986 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f2ebe-7006-4271-8b7b-4f0decb3ab60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:41:59.768986 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f2ebe-7006-4271-8b7b-4f0decb3ab60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:41:59.770650 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9b5f2ebe-7006-4271-8b7b-4f0decb3ab60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:41:59.782303 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f2ebe-7006-4271-8b7b-4f0decb3ab60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:41:59.783740 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f2ebe-7006-4271-8b7b-4f0decb3ab60 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:41:59.793118 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1131/2286] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:41:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:00.168631 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2a8fb-c0b1-4248-9a93-285c6a844a5d service nova] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:00.170108 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d8e2a8fb-c0b1-4248-9a93-285c6a844a5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:00.182101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2a8fb-c0b1-4248-9a93-285c6a844a5d service nova] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:00.185685 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b1ede-73b3-4faf-bead-5c7d3ec5c5f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:00.186315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b1ede-73b3-4faf-bead-5c7d3ec5c5f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:00.186600 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b1ede-73b3-4faf-bead-5c7d3ec5c5f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:00.186881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b1ede-73b3-4faf-bead-5c7d3ec5c5f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:00.188659 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fb3b1ede-73b3-4faf-bead-5c7d3ec5c5f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:00.246761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b1ede-73b3-4faf-bead-5c7d3ec5c5f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:00.248197 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b1ede-73b3-4faf-bead-5c7d3ec5c5f0 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:00.257070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1156/2287] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:01.581288 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f2ebe-7006-4271-8b7b-4f0decb3ab60 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:01.593760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f2ebe-7006-4271-8b7b-4f0decb3ab60 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:01.599611 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac4418-9499-4dfc-af96-a9ea263a93ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:01.600242 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac4418-9499-4dfc-af96-a9ea263a93ca service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:01.600556 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac4418-9499-4dfc-af96-a9ea263a93ca service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:01.600835 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac4418-9499-4dfc-af96-a9ea263a93ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:01.602579 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-73ac4418-9499-4dfc-af96-a9ea263a93ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:01.612797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac4418-9499-4dfc-af96-a9ea263a93ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:01.614996 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac4418-9499-4dfc-af96-a9ea263a93ca service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:01.623917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1132/2288] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:05.666026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b1ede-73b3-4faf-bead-5c7d3ec5c5f0 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:05.667665 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fb3b1ede-73b3-4faf-bead-5c7d3ec5c5f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:05.685802 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b1ede-73b3-4faf-bead-5c7d3ec5c5f0 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:05.702081 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093106d-3251-4ba8-b2f0-1b5b7df5d83a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:05.703301 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093106d-3251-4ba8-b2f0-1b5b7df5d83a service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:05.703814 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093106d-3251-4ba8-b2f0-1b5b7df5d83a service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:05.704316 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093106d-3251-4ba8-b2f0-1b5b7df5d83a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:05.707913 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e093106d-3251-4ba8-b2f0-1b5b7df5d83a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:05.725881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093106d-3251-4ba8-b2f0-1b5b7df5d83a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:05.727760 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093106d-3251-4ba8-b2f0-1b5b7df5d83a service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:05.740257 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1157/2289] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:11.027543 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06947f40-a9cc-4b93-a29a-a6cc5fa60a0b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:11.028052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06947f40-a9cc-4b93-a29a-a6cc5fa60a0b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:11.028218 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06947f40-a9cc-4b93-a29a-a6cc5fa60a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:11.046929 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-06947f40-a9cc-4b93-a29a-a6cc5fa60a0b None None] MFA Rules not processed for user `bbcd5ba866b84d099d183fe19ba61a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:11.048208 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-06947f40-a9cc-4b93-a29a-a6cc5fa60a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:11.111090 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1133/2290] 10.222.0.32 () {58 vars in 967 bytes} [Thu Jun 2 13:42:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:11.158334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093106d-3251-4ba8-b2f0-1b5b7df5d83a service nova] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:11.160393 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e093106d-3251-4ba8-b2f0-1b5b7df5d83a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:11.249651 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093106d-3251-4ba8-b2f0-1b5b7df5d83a service nova] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:11.255729 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4de866-66e1-48ae-aeb7-0246ee9d2b59 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aea97e7b39448a283032f662142b6e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:11.256633 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4de866-66e1-48ae-aeb7-0246ee9d2b59 service swift] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:11.257001 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4de866-66e1-48ae-aeb7-0246ee9d2b59 service swift] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:11.257393 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4de866-66e1-48ae-aeb7-0246ee9d2b59 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:11.274431 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4de866-66e1-48ae-aeb7-0246ee9d2b59 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:11.277298 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4de866-66e1-48ae-aeb7-0246ee9d2b59 service swift] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:11.294956 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1158/2291] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Jun 2 13:42:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:42:15.190336 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783a689-cda1-4e33-83e5-e929e6f533d4 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:15.190864 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783a689-cda1-4e33-83e5-e929e6f533d4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:15.190864 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783a689-cda1-4e33-83e5-e929e6f533d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:15.213295 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f783a689-cda1-4e33-83e5-e929e6f533d4 None None] MFA Rules not processed for user `4e88422338024035b5c64d2788965086`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:15.214880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f783a689-cda1-4e33-83e5-e929e6f533d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:15.226438 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1134/2292] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:42:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:15.536706 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4de866-66e1-48ae-aeb7-0246ee9d2b59 service swift] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:15.547040 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4de866-66e1-48ae-aeb7-0246ee9d2b59 service swift] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:15.551861 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4777f8b-8757-4fc2-b142-ba54a70bfdc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:15.552622 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4777f8b-8757-4fc2-b142-ba54a70bfdc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:15.552917 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4777f8b-8757-4fc2-b142-ba54a70bfdc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:15.553208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4777f8b-8757-4fc2-b142-ba54a70bfdc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:15.555433 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b4777f8b-8757-4fc2-b142-ba54a70bfdc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:15.566050 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4777f8b-8757-4fc2-b142-ba54a70bfdc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:15.568372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4777f8b-8757-4fc2-b142-ba54a70bfdc0 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:15.580479 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1159/2293] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:16.205169 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783a689-cda1-4e33-83e5-e929e6f533d4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:16.235496 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783a689-cda1-4e33-83e5-e929e6f533d4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:16.253016 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e677c-9be4-4fa6-ae5c-3d90c404feb0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24410ef5e78042c79c5b4a0d78b56258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:16.254970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e677c-9be4-4fa6-ae5c-3d90c404feb0 service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:16.256613 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e677c-9be4-4fa6-ae5c-3d90c404feb0 service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:16.257022 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e677c-9be4-4fa6-ae5c-3d90c404feb0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:16.260578 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5a5e677c-9be4-4fa6-ae5c-3d90c404feb0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:16.283094 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e677c-9be4-4fa6-ae5c-3d90c404feb0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:16.306967 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e677c-9be4-4fa6-ae5c-3d90c404feb0 service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:16.337635 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1135/2294] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:22.449941 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4777f8b-8757-4fc2-b142-ba54a70bfdc0 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:22.452886 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b4777f8b-8757-4fc2-b142-ba54a70bfdc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:22.463167 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=79 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:22.612447 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4777f8b-8757-4fc2-b142-ba54a70bfdc0 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:22.621230 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91414728-7576-4b37-a751-17bcbfb68f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:22.626378 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91414728-7576-4b37-a751-17bcbfb68f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:22.626689 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91414728-7576-4b37-a751-17bcbfb68f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:22.626966 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91414728-7576-4b37-a751-17bcbfb68f00 admin admin] PATH_INFO: `/v3/users/a41010feed14482d869807c09f365a18` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:22.632425 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91414728-7576-4b37-a751-17bcbfb68f00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a41010feed14482d869807c09f365a18)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:22.639012 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91414728-7576-4b37-a751-17bcbfb68f00 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:22.732246 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-91414728-7576-4b37-a751-17bcbfb68f00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a41010feed14482d869807c09f365a18'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:22.751335 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-91414728-7576-4b37-a751-17bcbfb68f00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a41010feed14482d869807c09f365a18'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:22.752646 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-91414728-7576-4b37-a751-17bcbfb68f00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a41010feed14482d869807c09f365a18'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:22.777553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-91414728-7576-4b37-a751-17bcbfb68f00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a41010feed14482d869807c09f365a18'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:22.797671 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-91414728-7576-4b37-a751-17bcbfb68f00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a41010feed14482d869807c09f365a18'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:22.811314 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1160/2295] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:42:22 2022] DELETE /identity/v3/users/a41010feed14482d869807c09f365a18 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:23.212119 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e677c-9be4-4fa6-ae5c-3d90c404feb0 service placement] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:23.218787 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=76 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:23.227677 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e677c-9be4-4fa6-ae5c-3d90c404feb0 service placement] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:23.297953 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ecd5c-e237-4786-938c-28d0ae75fefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:23.299649 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ecd5c-e237-4786-938c-28d0ae75fefb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:23.299944 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ecd5c-e237-4786-938c-28d0ae75fefb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:23.300781 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ecd5c-e237-4786-938c-28d0ae75fefb admin admin] PATH_INFO: `/v3/projects/9f83cf655b9d41ebbaf0961d1d2581fc` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:23.302187 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ecd5c-e237-4786-938c-28d0ae75fefb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f83cf655b9d41ebbaf0961d1d2581fc)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:23.304098 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ecd5c-e237-4786-938c-28d0ae75fefb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:23.363095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c66ecd5c-e237-4786-938c-28d0ae75fefb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f83cf655b9d41ebbaf0961d1d2581fc', 'request_id': 'req-c66ecd5c-e237-4786-938c-28d0ae75fefb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:23.371285 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c66ecd5c-e237-4786-938c-28d0ae75fefb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f83cf655b9d41ebbaf0961d1d2581fc', 'request_id': 'req-c66ecd5c-e237-4786-938c-28d0ae75fefb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:23.382505 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c66ecd5c-e237-4786-938c-28d0ae75fefb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f83cf655b9d41ebbaf0961d1d2581fc', 'request_id': 'req-c66ecd5c-e237-4786-938c-28d0ae75fefb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:23.413690 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c66ecd5c-e237-4786-938c-28d0ae75fefb admin admin] The token cache is being invalidate because project 9f83cf655b9d41ebbaf0961d1d2581fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:42:23.414898 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c66ecd5c-e237-4786-938c-28d0ae75fefb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:23.419078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c66ecd5c-e237-4786-938c-28d0ae75fefb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:23.420992 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1136/2296] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:42:23 2022] DELETE /identity/v3/projects/9f83cf655b9d41ebbaf0961d1d2581fc => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:23.425501 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91414728-7576-4b37-a751-17bcbfb68f00 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:23.427535 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-91414728-7576-4b37-a751-17bcbfb68f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:23.447511 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91414728-7576-4b37-a751-17bcbfb68f00 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:23.521308 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb9fe0-8af0-49a6-ad36-4e62662a31fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:23.522953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb9fe0-8af0-49a6-ad36-4e62662a31fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:23.523248 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb9fe0-8af0-49a6-ad36-4e62662a31fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:23.523534 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb9fe0-8af0-49a6-ad36-4e62662a31fd admin admin] PATH_INFO: `/v3/users/bdb70771a1844f278404b1c527bc45c1` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:23.525139 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb9fe0-8af0-49a6-ad36-4e62662a31fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdb70771a1844f278404b1c527bc45c1)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:23.527093 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb9fe0-8af0-49a6-ad36-4e62662a31fd admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:23.559232 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:23.598419 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-97cb9fe0-8af0-49a6-ad36-4e62662a31fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdb70771a1844f278404b1c527bc45c1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:23.605221 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-97cb9fe0-8af0-49a6-ad36-4e62662a31fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdb70771a1844f278404b1c527bc45c1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:23.605909 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-97cb9fe0-8af0-49a6-ad36-4e62662a31fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdb70771a1844f278404b1c527bc45c1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:23.619273 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-97cb9fe0-8af0-49a6-ad36-4e62662a31fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdb70771a1844f278404b1c527bc45c1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:23.626821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-97cb9fe0-8af0-49a6-ad36-4e62662a31fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdb70771a1844f278404b1c527bc45c1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:23.637306 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1161/2297] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:42:23 2022] DELETE /identity/v3/users/bdb70771a1844f278404b1c527bc45c1 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:23.901832 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ecd5c-e237-4786-938c-28d0ae75fefb admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:23.903415 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c66ecd5c-e237-4786-938c-28d0ae75fefb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:23.917610 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ecd5c-e237-4786-938c-28d0ae75fefb admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:23.998273 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131e612-d3e5-4e07-8b51-fedd78d7d488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:23.999394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131e612-d3e5-4e07-8b51-fedd78d7d488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:23.999751 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131e612-d3e5-4e07-8b51-fedd78d7d488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:24.000103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131e612-d3e5-4e07-8b51-fedd78d7d488 admin admin] PATH_INFO: `/v3/projects/dca57aa8d19d4ca4b87125352f806e08` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:24.001449 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131e612-d3e5-4e07-8b51-fedd78d7d488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dca57aa8d19d4ca4b87125352f806e08)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:24.003405 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131e612-d3e5-4e07-8b51-fedd78d7d488 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:24.056547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:24.074921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f131e612-d3e5-4e07-8b51-fedd78d7d488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dca57aa8d19d4ca4b87125352f806e08', 'request_id': 'req-f131e612-d3e5-4e07-8b51-fedd78d7d488'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:24.081513 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f131e612-d3e5-4e07-8b51-fedd78d7d488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dca57aa8d19d4ca4b87125352f806e08', 'request_id': 'req-f131e612-d3e5-4e07-8b51-fedd78d7d488'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:24.091024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f131e612-d3e5-4e07-8b51-fedd78d7d488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dca57aa8d19d4ca4b87125352f806e08', 'request_id': 'req-f131e612-d3e5-4e07-8b51-fedd78d7d488'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:24.103590 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f131e612-d3e5-4e07-8b51-fedd78d7d488 admin admin] The token cache is being invalidate because project dca57aa8d19d4ca4b87125352f806e08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:42:24.103893 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f131e612-d3e5-4e07-8b51-fedd78d7d488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:24.104613 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f131e612-d3e5-4e07-8b51-fedd78d7d488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:24.111931 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1137/2298] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:42:23 2022] DELETE /identity/v3/projects/dca57aa8d19d4ca4b87125352f806e08 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:42:25.221085 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75955c72-0afd-4b19-bcf2-b15179826da2 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:25.221578 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75955c72-0afd-4b19-bcf2-b15179826da2 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:25.221735 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75955c72-0afd-4b19-bcf2-b15179826da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:25.241526 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-75955c72-0afd-4b19-bcf2-b15179826da2 None None] MFA Rules not processed for user `a1622acb057f419ca98e7d44584c276d`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:25.242736 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-75955c72-0afd-4b19-bcf2-b15179826da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:25.301969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1162/2299] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:42:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:25.723702 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131e612-d3e5-4e07-8b51-fedd78d7d488 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:25.725249 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f131e612-d3e5-4e07-8b51-fedd78d7d488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:25.785779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131e612-d3e5-4e07-8b51-fedd78d7d488 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:25.789329 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad81d20-f0b9-4fc2-aeb6-fac1297e0b7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:25.789968 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad81d20-f0b9-4fc2-aeb6-fac1297e0b7d service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:25.790249 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad81d20-f0b9-4fc2-aeb6-fac1297e0b7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:25.790522 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad81d20-f0b9-4fc2-aeb6-fac1297e0b7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:25.792292 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fad81d20-f0b9-4fc2-aeb6-fac1297e0b7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:25.801723 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad81d20-f0b9-4fc2-aeb6-fac1297e0b7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:25.803215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad81d20-f0b9-4fc2-aeb6-fac1297e0b7d service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:25.811436 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1138/2300] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:28.087698 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75955c72-0afd-4b19-bcf2-b15179826da2 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:28.089675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-75955c72-0afd-4b19-bcf2-b15179826da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:28.102131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75955c72-0afd-4b19-bcf2-b15179826da2 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:28.105806 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2219d06-721d-4adf-b889-a2d4b7b2e302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:28.106446 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2219d06-721d-4adf-b889-a2d4b7b2e302 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:28.106735 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2219d06-721d-4adf-b889-a2d4b7b2e302 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:28.107197 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2219d06-721d-4adf-b889-a2d4b7b2e302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:28.109036 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c2219d06-721d-4adf-b889-a2d4b7b2e302 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:28.179411 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2219d06-721d-4adf-b889-a2d4b7b2e302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:28.180802 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2219d06-721d-4adf-b889-a2d4b7b2e302 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:28.190557 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1163/2301] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:29.311260 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad81d20-f0b9-4fc2-aeb6-fac1297e0b7d service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:29.312879 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fad81d20-f0b9-4fc2-aeb6-fac1297e0b7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:29.402730 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad81d20-f0b9-4fc2-aeb6-fac1297e0b7d service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:29.410222 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b9461-edfb-4c3f-b7ec-330913500cf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:29.411275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b9461-edfb-4c3f-b7ec-330913500cf0 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:29.411776 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b9461-edfb-4c3f-b7ec-330913500cf0 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:29.412330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b9461-edfb-4c3f-b7ec-330913500cf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:29.414789 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-036b9461-edfb-4c3f-b7ec-330913500cf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:29.429684 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b9461-edfb-4c3f-b7ec-330913500cf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:29.431365 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b9461-edfb-4c3f-b7ec-330913500cf0 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:29.444807 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1139/2302] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:31.623558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2219d06-721d-4adf-b889-a2d4b7b2e302 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:31.625219 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c2219d06-721d-4adf-b889-a2d4b7b2e302 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:31.657508 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2219d06-721d-4adf-b889-a2d4b7b2e302 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:31.664231 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9c403-2826-4345-9340-d11b3ec47efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:31.665216 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9c403-2826-4345-9340-d11b3ec47efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:31.665505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9c403-2826-4345-9340-d11b3ec47efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:31.666013 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9c403-2826-4345-9340-d11b3ec47efa admin admin] PATH_INFO: `/v3/users/b92da35ea7c946ea876b13b13ed98258` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:31.667392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c9c403-2826-4345-9340-d11b3ec47efa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b92da35ea7c946ea876b13b13ed98258)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:31.669452 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c9c403-2826-4345-9340-d11b3ec47efa admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:31.723985 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:31.735142 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c2c9c403-2826-4345-9340-d11b3ec47efa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b92da35ea7c946ea876b13b13ed98258'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:31.743660 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c2c9c403-2826-4345-9340-d11b3ec47efa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b92da35ea7c946ea876b13b13ed98258'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:31.744399 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c2c9c403-2826-4345-9340-d11b3ec47efa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b92da35ea7c946ea876b13b13ed98258'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:31.760703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c2c9c403-2826-4345-9340-d11b3ec47efa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b92da35ea7c946ea876b13b13ed98258'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:31.767955 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c2c9c403-2826-4345-9340-d11b3ec47efa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b92da35ea7c946ea876b13b13ed98258'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:31.774498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1164/2303] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:42:31 2022] DELETE /identity/v3/users/b92da35ea7c946ea876b13b13ed98258 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:31.965088 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b9461-edfb-4c3f-b7ec-330913500cf0 service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:31.988882 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b9461-edfb-4c3f-b7ec-330913500cf0 service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:32.052891 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:32.067236 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5682ea5-857a-44f4-818e-77b509f22710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:32.068111 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5682ea5-857a-44f4-818e-77b509f22710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:32.068461 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5682ea5-857a-44f4-818e-77b509f22710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:32.068744 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5682ea5-857a-44f4-818e-77b509f22710 admin admin] PATH_INFO: `/v3/projects/ff89a4ee01d444d2aee3bdc9199d556f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:32.070150 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5682ea5-857a-44f4-818e-77b509f22710 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff89a4ee01d444d2aee3bdc9199d556f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:32.073013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5682ea5-857a-44f4-818e-77b509f22710 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:32.124455 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b5682ea5-857a-44f4-818e-77b509f22710 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff89a4ee01d444d2aee3bdc9199d556f', 'request_id': 'req-b5682ea5-857a-44f4-818e-77b509f22710'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:32.130113 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b5682ea5-857a-44f4-818e-77b509f22710 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff89a4ee01d444d2aee3bdc9199d556f', 'request_id': 'req-b5682ea5-857a-44f4-818e-77b509f22710'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:32.138043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b5682ea5-857a-44f4-818e-77b509f22710 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff89a4ee01d444d2aee3bdc9199d556f', 'request_id': 'req-b5682ea5-857a-44f4-818e-77b509f22710'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:32.150319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b5682ea5-857a-44f4-818e-77b509f22710 admin admin] The token cache is being invalidate because project ff89a4ee01d444d2aee3bdc9199d556f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:42:32.150636 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b5682ea5-857a-44f4-818e-77b509f22710 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:32.151310 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b5682ea5-857a-44f4-818e-77b509f22710 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:32.153240 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1140/2304] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:42:31 2022] DELETE /identity/v3/projects/ff89a4ee01d444d2aee3bdc9199d556f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:32.158126 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e2931-54ef-4b76-8d5b-9150a92cc48b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:32.158424 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e2931-54ef-4b76-8d5b-9150a92cc48b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:32.158711 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e2931-54ef-4b76-8d5b-9150a92cc48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:32.177113 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-118e2931-54ef-4b76-8d5b-9150a92cc48b None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:32.178348 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-118e2931-54ef-4b76-8d5b-9150a92cc48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:32.241694 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1165/2305] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:32.249189 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fee939-201f-424d-aacf-5e288195a39e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:32.249556 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fee939-201f-424d-aacf-5e288195a39e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:32.249903 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fee939-201f-424d-aacf-5e288195a39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:32.269749 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-51fee939-201f-424d-aacf-5e288195a39e None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:32.271076 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-51fee939-201f-424d-aacf-5e288195a39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:32.279808 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1141/2306] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:32.285222 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e2931-54ef-4b76-8d5b-9150a92cc48b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:32.295101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e2931-54ef-4b76-8d5b-9150a92cc48b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:32.299741 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff5dd0-00c1-4e3d-ad59-e8b1a2719b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:32.300470 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff5dd0-00c1-4e3d-ad59-e8b1a2719b86 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:32.300760 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff5dd0-00c1-4e3d-ad59-e8b1a2719b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:32.301042 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff5dd0-00c1-4e3d-ad59-e8b1a2719b86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:32.301776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff5dd0-00c1-4e3d-ad59-e8b1a2719b86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:42:32.302208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff5dd0-00c1-4e3d-ad59-e8b1a2719b86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:32.303814 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff5dd0-00c1-4e3d-ad59-e8b1a2719b86 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:32.315422 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1166/2307] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:42:32.320241 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fee939-201f-424d-aacf-5e288195a39e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:32.329694 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fee939-201f-424d-aacf-5e288195a39e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:32.335372 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a69d41-f1e6-475f-ace7-2d52d4b700c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:32.336570 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a69d41-f1e6-475f-ace7-2d52d4b700c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:32.336860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a69d41-f1e6-475f-ace7-2d52d4b700c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:32.337143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a69d41-f1e6-475f-ace7-2d52d4b700c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:32.337857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a69d41-f1e6-475f-ace7-2d52d4b700c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:32.340210 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a69d41-f1e6-475f-ace7-2d52d4b700c1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:32.382268 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1142/2308] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:42:32 2022] POST /identity/v3/projects => generated 397 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:42:32.386432 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff5dd0-00c1-4e3d-ad59-e8b1a2719b86 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:32.399461 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff5dd0-00c1-4e3d-ad59-e8b1a2719b86 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:32.460658 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff8c28-0771-4e31-b4d6-ae4a54a2ab53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:32.461321 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff8c28-0771-4e31-b4d6-ae4a54a2ab53 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:32.461602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff8c28-0771-4e31-b4d6-ae4a54a2ab53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:32.461907 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff8c28-0771-4e31-b4d6-ae4a54a2ab53 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:32.462715 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff8c28-0771-4e31-b4d6-ae4a54a2ab53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:32.464745 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff8c28-0771-4e31-b4d6-ae4a54a2ab53 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:32.488357 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1167/2309] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:42:32 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:42:32.490445 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a69d41-f1e6-475f-ace7-2d52d4b700c1 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:32.501703 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a69d41-f1e6-475f-ace7-2d52d4b700c1 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:32.506554 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136bbf2-b31f-45ce-9317-0b21b68f0150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:32.507214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136bbf2-b31f-45ce-9317-0b21b68f0150 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:32.507497 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136bbf2-b31f-45ce-9317-0b21b68f0150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:32.507768 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136bbf2-b31f-45ce-9317-0b21b68f0150 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:32.508689 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a136bbf2-b31f-45ce-9317-0b21b68f0150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:32.510334 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a136bbf2-b31f-45ce-9317-0b21b68f0150 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:32.521372 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1143/2310] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:42:32.525468 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff8c28-0771-4e31-b4d6-ae4a54a2ab53 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:32.535711 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff8c28-0771-4e31-b4d6-ae4a54a2ab53 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:32.540661 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42071d-1184-4965-94ce-77885fee439c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:32.541333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42071d-1184-4965-94ce-77885fee439c admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:32.541622 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42071d-1184-4965-94ce-77885fee439c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:32.541905 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42071d-1184-4965-94ce-77885fee439c admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:32.542646 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42071d-1184-4965-94ce-77885fee439c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:32.544244 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42071d-1184-4965-94ce-77885fee439c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:32.554490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1168/2311] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:42:32.559206 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136bbf2-b31f-45ce-9317-0b21b68f0150 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:32.569814 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136bbf2-b31f-45ce-9317-0b21b68f0150 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:32.574675 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20d3ef-e8aa-4742-9b2b-4ab8c163f695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:32.575517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20d3ef-e8aa-4742-9b2b-4ab8c163f695 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:32.575805 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20d3ef-e8aa-4742-9b2b-4ab8c163f695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:32.576085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20d3ef-e8aa-4742-9b2b-4ab8c163f695 admin admin] PATH_INFO: `/v3/projects/2668831b90b34152bc91d3db5535063d/users/daec46bb093d41ea9ac1bb09cddd89ec/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:32.591591 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20d3ef-e8aa-4742-9b2b-4ab8c163f695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2668831b90b34152bc91d3db5535063d, user_id=daec46bb093d41ea9ac1bb09cddd89ec, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:32.594285 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20d3ef-e8aa-4742-9b2b-4ab8c163f695 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:32.607879 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1144/2312] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:42:32 2022] PUT /identity/v3/projects/2668831b90b34152bc91d3db5535063d/users/daec46bb093d41ea9ac1bb09cddd89ec/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:32.618866 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149fcd3-fb2b-47cc-8c6b-bc2e1c722d2e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:32.619163 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149fcd3-fb2b-47cc-8c6b-bc2e1c722d2e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:32.619444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149fcd3-fb2b-47cc-8c6b-bc2e1c722d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:32.647483 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c149fcd3-fb2b-47cc-8c6b-bc2e1c722d2e None None] MFA Rules not processed for user `daec46bb093d41ea9ac1bb09cddd89ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:32.648745 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c149fcd3-fb2b-47cc-8c6b-bc2e1c722d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:32.654076 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:32.728736 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1169/2313] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:42:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:42:32.733071 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20d3ef-e8aa-4742-9b2b-4ab8c163f695 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:32.805712 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20d3ef-e8aa-4742-9b2b-4ab8c163f695 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:32.810544 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03809397-46b0-4c7c-b794-7c8de3c22389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:32.811203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03809397-46b0-4c7c-b794-7c8de3c22389 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:32.811506 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03809397-46b0-4c7c-b794-7c8de3c22389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:32.811772 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03809397-46b0-4c7c-b794-7c8de3c22389 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:32.812510 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03809397-46b0-4c7c-b794-7c8de3c22389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:32.814441 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03809397-46b0-4c7c-b794-7c8de3c22389 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:32.828590 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:32.842745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1145/2314] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:42:32 2022] POST /identity/v3/projects => generated 401 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:42:32.846922 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149fcd3-fb2b-47cc-8c6b-bc2e1c722d2e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:32.857775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149fcd3-fb2b-47cc-8c6b-bc2e1c722d2e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:32.919293 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ab391-830b-4eaf-8b18-f6fc9ac24256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:32.919960 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ab391-830b-4eaf-8b18-f6fc9ac24256 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:32.920243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ab391-830b-4eaf-8b18-f6fc9ac24256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:32.920556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ab391-830b-4eaf-8b18-f6fc9ac24256 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:32.921287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ab391-830b-4eaf-8b18-f6fc9ac24256 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:32.923320 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ab391-830b-4eaf-8b18-f6fc9ac24256 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:32.946957 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1170/2315] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:42:32 2022] POST /identity/v3/users => generated 307 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:42:32.948103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03809397-46b0-4c7c-b794-7c8de3c22389 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:32.960253 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03809397-46b0-4c7c-b794-7c8de3c22389 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:32.964831 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077aca3-1662-47af-adbc-aed1d5703fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:32.965484 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077aca3-1662-47af-adbc-aed1d5703fee admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:32.966066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077aca3-1662-47af-adbc-aed1d5703fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:32.966066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077aca3-1662-47af-adbc-aed1d5703fee admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:32.966765 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077aca3-1662-47af-adbc-aed1d5703fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:32.970163 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077aca3-1662-47af-adbc-aed1d5703fee admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:32.982004 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1146/2316] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:42:32.985896 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ab391-830b-4eaf-8b18-f6fc9ac24256 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:32.997275 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ab391-830b-4eaf-8b18-f6fc9ac24256 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:33.002494 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd7a63-bf54-4eda-94aa-ec72a0874cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:33.003626 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd7a63-bf54-4eda-94aa-ec72a0874cc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:33.004463 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd7a63-bf54-4eda-94aa-ec72a0874cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:33.004463 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd7a63-bf54-4eda-94aa-ec72a0874cc9 admin admin] PATH_INFO: `/v3/projects/be2e140af5ea40519dea792d8b930ff4/users/31abfc78bc8e49c9b484fd43bd2ffa1e/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:33.037202 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd7a63-bf54-4eda-94aa-ec72a0874cc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2e140af5ea40519dea792d8b930ff4, user_id=31abfc78bc8e49c9b484fd43bd2ffa1e, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:33.040345 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd7a63-bf54-4eda-94aa-ec72a0874cc9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:33.055953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1171/2317] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:42:32 2022] PUT /identity/v3/projects/be2e140af5ea40519dea792d8b930ff4/users/31abfc78bc8e49c9b484fd43bd2ffa1e/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:33.059948 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077aca3-1662-47af-adbc-aed1d5703fee admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:33.070763 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077aca3-1662-47af-adbc-aed1d5703fee admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:33.130447 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189021f-807b-4481-8cf3-2fe272812a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:33.131025 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189021f-807b-4481-8cf3-2fe272812a97 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:33.131307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189021f-807b-4481-8cf3-2fe272812a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:33.131859 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189021f-807b-4481-8cf3-2fe272812a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:33.132616 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189021f-807b-4481-8cf3-2fe272812a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:33.134216 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189021f-807b-4481-8cf3-2fe272812a97 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:33.144643 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1147/2318] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:42:33.148744 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd7a63-bf54-4eda-94aa-ec72a0874cc9 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:33.159781 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd7a63-bf54-4eda-94aa-ec72a0874cc9 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:33.164672 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03665d-4e5d-4baf-bc08-870d2dde8c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:33.165553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03665d-4e5d-4baf-bc08-870d2dde8c86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:33.165838 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03665d-4e5d-4baf-bc08-870d2dde8c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:33.166113 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03665d-4e5d-4baf-bc08-870d2dde8c86 admin admin] PATH_INFO: `/v3/projects/be2e140af5ea40519dea792d8b930ff4/users/31abfc78bc8e49c9b484fd43bd2ffa1e/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:33.169274 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03665d-4e5d-4baf-bc08-870d2dde8c86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2e140af5ea40519dea792d8b930ff4, user_id=31abfc78bc8e49c9b484fd43bd2ffa1e, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:33.171990 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03665d-4e5d-4baf-bc08-870d2dde8c86 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:33.183336 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1172/2319] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:42:33 2022] PUT /identity/v3/projects/be2e140af5ea40519dea792d8b930ff4/users/31abfc78bc8e49c9b484fd43bd2ffa1e/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:33.193683 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfa06c-1dbe-4d96-bae2-13458e9b04be None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:33.193978 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfa06c-1dbe-4d96-bae2-13458e9b04be None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:33.194262 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfa06c-1dbe-4d96-bae2-13458e9b04be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:33.222164 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-90cfa06c-1dbe-4d96-bae2-13458e9b04be None None] MFA Rules not processed for user `31abfc78bc8e49c9b484fd43bd2ffa1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:33.223375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-90cfa06c-1dbe-4d96-bae2-13458e9b04be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:33.304578 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1148/2320] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:42:33 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:33.316098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03665d-4e5d-4baf-bc08-870d2dde8c86 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:33.317975 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3e03665d-4e5d-4baf-bc08-870d2dde8c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:33.385556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03665d-4e5d-4baf-bc08-870d2dde8c86 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:33.390299 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a8953-4a48-4346-826f-e91b81318172 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:33.391158 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a8953-4a48-4346-826f-e91b81318172 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:33.391605 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a8953-4a48-4346-826f-e91b81318172 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:33.392057 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a8953-4a48-4346-826f-e91b81318172 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:33.402999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a8953-4a48-4346-826f-e91b81318172 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:33.404472 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a8953-4a48-4346-826f-e91b81318172 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:33.414397 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1173/2321] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:33 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:33.496521 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cfa06c-1dbe-4d96-bae2-13458e9b04be None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:33.508555 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cfa06c-1dbe-4d96-bae2-13458e9b04be None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:33.512189 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a1e9a-b0f7-4523-b3f5-3bb3ef04b79d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:33.512867 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a1e9a-b0f7-4523-b3f5-3bb3ef04b79d service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:33.513157 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a1e9a-b0f7-4523-b3f5-3bb3ef04b79d service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:33.513438 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a1e9a-b0f7-4523-b3f5-3bb3ef04b79d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:33.575227 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a1e9a-b0f7-4523-b3f5-3bb3ef04b79d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:33.576740 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a1e9a-b0f7-4523-b3f5-3bb3ef04b79d service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:33.586895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1149/2322] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:33 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:37.652126 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a8953-4a48-4346-826f-e91b81318172 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:37.656359 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:37.714977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a8953-4a48-4346-826f-e91b81318172 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:37.719577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd0065-c87e-4ff4-8706-5644061234bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:37.720469 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd0065-c87e-4ff4-8706-5644061234bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:37.720776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd0065-c87e-4ff4-8706-5644061234bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:37.721052 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd0065-c87e-4ff4-8706-5644061234bf admin admin] PATH_INFO: `/v3/users/daec46bb093d41ea9ac1bb09cddd89ec` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:37.722278 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd0065-c87e-4ff4-8706-5644061234bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=daec46bb093d41ea9ac1bb09cddd89ec)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:37.724247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd0065-c87e-4ff4-8706-5644061234bf admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:37.771768 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-29bd0065-c87e-4ff4-8706-5644061234bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daec46bb093d41ea9ac1bb09cddd89ec'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:37.778694 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-29bd0065-c87e-4ff4-8706-5644061234bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daec46bb093d41ea9ac1bb09cddd89ec'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:37.779364 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-29bd0065-c87e-4ff4-8706-5644061234bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daec46bb093d41ea9ac1bb09cddd89ec'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:37.791458 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-29bd0065-c87e-4ff4-8706-5644061234bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daec46bb093d41ea9ac1bb09cddd89ec'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:37.799864 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-29bd0065-c87e-4ff4-8706-5644061234bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daec46bb093d41ea9ac1bb09cddd89ec'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:37.805898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1174/2323] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:42:37 2022] DELETE /identity/v3/users/daec46bb093d41ea9ac1bb09cddd89ec => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:37.810313 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114a4e3-4283-4385-a815-a2a2ba476fc5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:37.810835 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114a4e3-4283-4385-a815-a2a2ba476fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:37.810935 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114a4e3-4283-4385-a815-a2a2ba476fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:37.818032 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:37.831744 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d114a4e3-4283-4385-a815-a2a2ba476fc5 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:37.833003 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d114a4e3-4283-4385-a815-a2a2ba476fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:37.898326 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1150/2324] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:42:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:37.908219 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd0065-c87e-4ff4-8706-5644061234bf admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:37.910346 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-29bd0065-c87e-4ff4-8706-5644061234bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:37.977205 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd0065-c87e-4ff4-8706-5644061234bf admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:37.981415 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6073e06-d3df-4bfc-8c69-cd2a736dcf0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:37.982277 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6073e06-d3df-4bfc-8c69-cd2a736dcf0a service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:37.982562 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6073e06-d3df-4bfc-8c69-cd2a736dcf0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:37.982843 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6073e06-d3df-4bfc-8c69-cd2a736dcf0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:37.992683 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6073e06-d3df-4bfc-8c69-cd2a736dcf0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:37.994116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6073e06-d3df-4bfc-8c69-cd2a736dcf0a service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:38.005677 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1175/2325] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:38.405745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114a4e3-4283-4385-a815-a2a2ba476fc5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:38.407419 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d114a4e3-4283-4385-a815-a2a2ba476fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:38.428796 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114a4e3-4283-4385-a815-a2a2ba476fc5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:38.455630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48602a4-4121-4fb6-b4ed-715cc5a70c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:38.457720 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48602a4-4121-4fb6-b4ed-715cc5a70c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:38.458123 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48602a4-4121-4fb6-b4ed-715cc5a70c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:38.458611 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48602a4-4121-4fb6-b4ed-715cc5a70c47 admin admin] PATH_INFO: `/v3/projects/2668831b90b34152bc91d3db5535063d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:38.460335 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48602a4-4121-4fb6-b4ed-715cc5a70c47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2668831b90b34152bc91d3db5535063d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:38.472171 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48602a4-4121-4fb6-b4ed-715cc5a70c47 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:38.517396 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f48602a4-4121-4fb6-b4ed-715cc5a70c47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2668831b90b34152bc91d3db5535063d', 'request_id': 'req-f48602a4-4121-4fb6-b4ed-715cc5a70c47'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:38.523272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f48602a4-4121-4fb6-b4ed-715cc5a70c47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2668831b90b34152bc91d3db5535063d', 'request_id': 'req-f48602a4-4121-4fb6-b4ed-715cc5a70c47'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:38.531299 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f48602a4-4121-4fb6-b4ed-715cc5a70c47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2668831b90b34152bc91d3db5535063d', 'request_id': 'req-f48602a4-4121-4fb6-b4ed-715cc5a70c47'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:38.543043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f48602a4-4121-4fb6-b4ed-715cc5a70c47 admin admin] The token cache is being invalidate because project 2668831b90b34152bc91d3db5535063d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:42:38.543332 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f48602a4-4121-4fb6-b4ed-715cc5a70c47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:38.544230 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f48602a4-4121-4fb6-b4ed-715cc5a70c47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:38.546093 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1151/2326] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:42:38 2022] DELETE /identity/v3/projects/2668831b90b34152bc91d3db5535063d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:38.549782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6073e06-d3df-4bfc-8c69-cd2a736dcf0a service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:38.559637 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6073e06-d3df-4bfc-8c69-cd2a736dcf0a service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:38.580494 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:38.618460 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51d25f-33d9-4fe2-b721-947eada2ae42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:38.619327 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51d25f-33d9-4fe2-b721-947eada2ae42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:38.619613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51d25f-33d9-4fe2-b721-947eada2ae42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:38.619893 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51d25f-33d9-4fe2-b721-947eada2ae42 admin admin] PATH_INFO: `/v3/users/31abfc78bc8e49c9b484fd43bd2ffa1e` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:38.621114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51d25f-33d9-4fe2-b721-947eada2ae42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31abfc78bc8e49c9b484fd43bd2ffa1e)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:38.623039 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51d25f-33d9-4fe2-b721-947eada2ae42 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:38.669101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1c51d25f-33d9-4fe2-b721-947eada2ae42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31abfc78bc8e49c9b484fd43bd2ffa1e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:38.676393 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1c51d25f-33d9-4fe2-b721-947eada2ae42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31abfc78bc8e49c9b484fd43bd2ffa1e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:38.677054 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1c51d25f-33d9-4fe2-b721-947eada2ae42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31abfc78bc8e49c9b484fd43bd2ffa1e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:38.688711 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1c51d25f-33d9-4fe2-b721-947eada2ae42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31abfc78bc8e49c9b484fd43bd2ffa1e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:38.697514 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1c51d25f-33d9-4fe2-b721-947eada2ae42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31abfc78bc8e49c9b484fd43bd2ffa1e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:38.705370 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1176/2327] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:42:38 2022] DELETE /identity/v3/users/31abfc78bc8e49c9b484fd43bd2ffa1e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:38.984008 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48602a4-4121-4fb6-b4ed-715cc5a70c47 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:38.985511 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f48602a4-4121-4fb6-b4ed-715cc5a70c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:39.000027 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48602a4-4121-4fb6-b4ed-715cc5a70c47 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:39.058758 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d69e16-c436-4d6e-b897-d62516aa8d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:39.059530 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d69e16-c436-4d6e-b897-d62516aa8d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:39.059811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d69e16-c436-4d6e-b897-d62516aa8d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:39.060080 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d69e16-c436-4d6e-b897-d62516aa8d58 admin admin] PATH_INFO: `/v3/projects/be2e140af5ea40519dea792d8b930ff4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:39.061289 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d69e16-c436-4d6e-b897-d62516aa8d58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be2e140af5ea40519dea792d8b930ff4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:39.063184 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d69e16-c436-4d6e-b897-d62516aa8d58 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:39.095061 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:39.110544 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-01d69e16-c436-4d6e-b897-d62516aa8d58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be2e140af5ea40519dea792d8b930ff4', 'request_id': 'req-01d69e16-c436-4d6e-b897-d62516aa8d58'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:39.115879 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-01d69e16-c436-4d6e-b897-d62516aa8d58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be2e140af5ea40519dea792d8b930ff4', 'request_id': 'req-01d69e16-c436-4d6e-b897-d62516aa8d58'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:39.122774 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-01d69e16-c436-4d6e-b897-d62516aa8d58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be2e140af5ea40519dea792d8b930ff4', 'request_id': 'req-01d69e16-c436-4d6e-b897-d62516aa8d58'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:39.134217 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-01d69e16-c436-4d6e-b897-d62516aa8d58 admin admin] The token cache is being invalidate because project be2e140af5ea40519dea792d8b930ff4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:42:39.134563 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-01d69e16-c436-4d6e-b897-d62516aa8d58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:39.135203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-01d69e16-c436-4d6e-b897-d62516aa8d58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:39.136760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1152/2328] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:42:38 2022] DELETE /identity/v3/projects/be2e140af5ea40519dea792d8b930ff4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:39.141606 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3b4a9-28a3-483c-a213-b64fe6d2ff06 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:39.141946 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3b4a9-28a3-483c-a213-b64fe6d2ff06 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:39.142230 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3b4a9-28a3-483c-a213-b64fe6d2ff06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:39.160651 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-35b3b4a9-28a3-483c-a213-b64fe6d2ff06 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:39.161851 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-35b3b4a9-28a3-483c-a213-b64fe6d2ff06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:39.220056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1177/2329] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:39.229488 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c3c84-ae1c-4cd7-92aa-1f757eb546b7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:39.229781 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c3c84-ae1c-4cd7-92aa-1f757eb546b7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:39.230064 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c3c84-ae1c-4cd7-92aa-1f757eb546b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:39.249546 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b65c3c84-ae1c-4cd7-92aa-1f757eb546b7 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:39.250751 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b65c3c84-ae1c-4cd7-92aa-1f757eb546b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:39.259748 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1153/2330] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:39.263981 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3b4a9-28a3-483c-a213-b64fe6d2ff06 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:39.273775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3b4a9-28a3-483c-a213-b64fe6d2ff06 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:39.278620 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92b162-538c-4de1-bb30-cc35ebe2eab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:39.279274 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92b162-538c-4de1-bb30-cc35ebe2eab9 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:39.279559 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92b162-538c-4de1-bb30-cc35ebe2eab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:39.279840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92b162-538c-4de1-bb30-cc35ebe2eab9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:39.280626 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92b162-538c-4de1-bb30-cc35ebe2eab9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:42:39.280940 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92b162-538c-4de1-bb30-cc35ebe2eab9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:39.282539 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92b162-538c-4de1-bb30-cc35ebe2eab9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:39.294752 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1178/2331] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:42:39.299154 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c3c84-ae1c-4cd7-92aa-1f757eb546b7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:39.309080 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c3c84-ae1c-4cd7-92aa-1f757eb546b7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:39.313671 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ec9da-0fdc-4527-9626-57547a7ff29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:39.314313 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ec9da-0fdc-4527-9626-57547a7ff29b admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:39.314598 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ec9da-0fdc-4527-9626-57547a7ff29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:39.314879 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ec9da-0fdc-4527-9626-57547a7ff29b admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:39.315570 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ec9da-0fdc-4527-9626-57547a7ff29b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:39.317514 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ec9da-0fdc-4527-9626-57547a7ff29b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:39.343073 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1154/2332] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:42:39 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:42:39.347642 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92b162-538c-4de1-bb30-cc35ebe2eab9 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:39.357674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92b162-538c-4de1-bb30-cc35ebe2eab9 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:39.386494 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:39.416463 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6136b-1af8-4483-96df-dd855791b881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:39.417222 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6136b-1af8-4483-96df-dd855791b881 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:39.417579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6136b-1af8-4483-96df-dd855791b881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:39.417855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6136b-1af8-4483-96df-dd855791b881 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:39.418542 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6136b-1af8-4483-96df-dd855791b881 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:39.420557 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6136b-1af8-4483-96df-dd855791b881 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:39.441632 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1179/2333] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:42:39 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:42:39.446013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ec9da-0fdc-4527-9626-57547a7ff29b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:39.457848 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ec9da-0fdc-4527-9626-57547a7ff29b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:39.462692 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213356d-eca7-4e6c-8306-ed5261299fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:39.463456 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213356d-eca7-4e6c-8306-ed5261299fec admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:39.463820 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213356d-eca7-4e6c-8306-ed5261299fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:39.464172 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213356d-eca7-4e6c-8306-ed5261299fec admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:39.465006 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213356d-eca7-4e6c-8306-ed5261299fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:39.466877 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213356d-eca7-4e6c-8306-ed5261299fec admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:39.479056 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1155/2334] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:42:39.482963 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6136b-1af8-4483-96df-dd855791b881 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:39.495488 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6136b-1af8-4483-96df-dd855791b881 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:39.500382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099075d-03c3-4731-8123-1593482f76e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:39.501050 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099075d-03c3-4731-8123-1593482f76e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:39.501341 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099075d-03c3-4731-8123-1593482f76e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:39.501626 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099075d-03c3-4731-8123-1593482f76e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:39.502360 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099075d-03c3-4731-8123-1593482f76e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:39.504652 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099075d-03c3-4731-8123-1593482f76e0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:39.520571 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1180/2335] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:42:39.521782 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213356d-eca7-4e6c-8306-ed5261299fec admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:39.533637 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213356d-eca7-4e6c-8306-ed5261299fec admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:39.539085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8c0d1-5f64-475a-a938-ca846efa8c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:39.539976 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8c0d1-5f64-475a-a938-ca846efa8c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:39.540262 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8c0d1-5f64-475a-a938-ca846efa8c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:39.540677 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8c0d1-5f64-475a-a938-ca846efa8c87 admin admin] PATH_INFO: `/v3/projects/2a2eaf908827424898caa5813b3052f4/users/16ac65a0ec3141059b6140ae930bbd38/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:39.556632 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8c0d1-5f64-475a-a938-ca846efa8c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a2eaf908827424898caa5813b3052f4, user_id=16ac65a0ec3141059b6140ae930bbd38, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:39.559428 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8c0d1-5f64-475a-a938-ca846efa8c87 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:39.573172 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1156/2336] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:42:39 2022] PUT /identity/v3/projects/2a2eaf908827424898caa5813b3052f4/users/16ac65a0ec3141059b6140ae930bbd38/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:39.583957 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98286fe-c4d6-416c-8aa8-9be353e2b4e2 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:39.584335 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98286fe-c4d6-416c-8aa8-9be353e2b4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:39.584708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98286fe-c4d6-416c-8aa8-9be353e2b4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:39.614757 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d98286fe-c4d6-416c-8aa8-9be353e2b4e2 None None] MFA Rules not processed for user `16ac65a0ec3141059b6140ae930bbd38`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:39.615970 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d98286fe-c4d6-416c-8aa8-9be353e2b4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:39.697331 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1181/2337] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:42:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:39.700447 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8c0d1-5f64-475a-a938-ca846efa8c87 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:39.769381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8c0d1-5f64-475a-a938-ca846efa8c87 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:39.774713 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cfe08-838d-4dac-a4d3-c2e7438d4e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:39.775627 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cfe08-838d-4dac-a4d3-c2e7438d4e42 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:39.776003 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cfe08-838d-4dac-a4d3-c2e7438d4e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:39.776411 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cfe08-838d-4dac-a4d3-c2e7438d4e42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:39.777328 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425cfe08-838d-4dac-a4d3-c2e7438d4e42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:39.779417 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425cfe08-838d-4dac-a4d3-c2e7438d4e42 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:39.811458 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1157/2338] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:42:39 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:42:39.817397 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98286fe-c4d6-416c-8aa8-9be353e2b4e2 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:39.830260 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98286fe-c4d6-416c-8aa8-9be353e2b4e2 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:39.861586 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3f492-7a1a-4ab8-82d5-1d95dd443a6d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:39.861877 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3f492-7a1a-4ab8-82d5-1d95dd443a6d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:39.862739 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3f492-7a1a-4ab8-82d5-1d95dd443a6d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:39.864489 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1158/2339] 10.222.0.32 () {54 vars in 921 bytes} [Thu Jun 2 13:42:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:42:39.871720 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1065014-9335-4cb9-8c11-c2ea4ca2bbd1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:39.872215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1065014-9335-4cb9-8c11-c2ea4ca2bbd1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:39.872701 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1065014-9335-4cb9-8c11-c2ea4ca2bbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:39.894145 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a1065014-9335-4cb9-8c11-c2ea4ca2bbd1 None None] MFA Rules not processed for user `9eb2722c122f4aeba23ec16b5a3c485f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:39.895899 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a1065014-9335-4cb9-8c11-c2ea4ca2bbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:39.913550 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743e1a9-aa96-4a3a-91d3-d45863fffa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:39.914474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743e1a9-aa96-4a3a-91d3-d45863fffa7d admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:39.914830 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743e1a9-aa96-4a3a-91d3-d45863fffa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:39.915571 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743e1a9-aa96-4a3a-91d3-d45863fffa7d admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:39.916846 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743e1a9-aa96-4a3a-91d3-d45863fffa7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:39.919550 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743e1a9-aa96-4a3a-91d3-d45863fffa7d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:39.953203 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1182/2340] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:42:39 2022] POST /identity/v3/users => generated 297 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:42:39.953689 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:39.955946 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743e1a9-aa96-4a3a-91d3-d45863fffa7d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:39.968909 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743e1a9-aa96-4a3a-91d3-d45863fffa7d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:39.976942 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3f101-4ea6-4e2f-8eb3-a8bd260a8878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:39.979657 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3f101-4ea6-4e2f-8eb3-a8bd260a8878 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:39.980051 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3f101-4ea6-4e2f-8eb3-a8bd260a8878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:39.980449 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3f101-4ea6-4e2f-8eb3-a8bd260a8878 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:39.981309 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3f101-4ea6-4e2f-8eb3-a8bd260a8878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:39.984103 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3f101-4ea6-4e2f-8eb3-a8bd260a8878 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:39.996741 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1183/2341] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:42:40.000554 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3f101-4ea6-4e2f-8eb3-a8bd260a8878 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:40.011777 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1159/2342] 10.222.0.32 () {58 vars in 1018 bytes} [Thu Jun 2 13:42:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:42:40.018219 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3f101-4ea6-4e2f-8eb3-a8bd260a8878 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:40.019438 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1065014-9335-4cb9-8c11-c2ea4ca2bbd1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:40.021003 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a1065014-9335-4cb9-8c11-c2ea4ca2bbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:40.023702 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f345d3-c0ea-40f3-83e4-3aafe84f76bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:40.024697 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f345d3-c0ea-40f3-83e4-3aafe84f76bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:40.025273 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f345d3-c0ea-40f3-83e4-3aafe84f76bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:40.025625 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f345d3-c0ea-40f3-83e4-3aafe84f76bb admin admin] PATH_INFO: `/v3/projects/23649ef44ee9471c9b142b88848b8805/users/4b8b2996451e45e9baa0968eb91da78e/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:40.032079 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1065014-9335-4cb9-8c11-c2ea4ca2bbd1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:40.036997 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2b573-bd51-4c06-ac43-c2e816c948ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:40.037785 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2b573-bd51-4c06-ac43-c2e816c948ca service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:40.038140 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2b573-bd51-4c06-ac43-c2e816c948ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:40.038503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2b573-bd51-4c06-ac43-c2e816c948ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:40.047469 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2b573-bd51-4c06-ac43-c2e816c948ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:40.048559 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f345d3-c0ea-40f3-83e4-3aafe84f76bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=23649ef44ee9471c9b142b88848b8805, user_id=4b8b2996451e45e9baa0968eb91da78e, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:40.049644 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2b573-bd51-4c06-ac43-c2e816c948ca service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:40.053718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f345d3-c0ea-40f3-83e4-3aafe84f76bb admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:40.056395 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:40.060950 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1160/2343] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:42:40.071841 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1184/2344] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:42:39 2022] PUT /identity/v3/projects/23649ef44ee9471c9b142b88848b8805/users/4b8b2996451e45e9baa0968eb91da78e/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:42:40.075997 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2b573-bd51-4c06-ac43-c2e816c948ca service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:40.092508 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2b573-bd51-4c06-ac43-c2e816c948ca service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:40.151243 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c207692-4aa9-4dbc-ac2d-eb8ae88051be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:40.151915 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c207692-4aa9-4dbc-ac2d-eb8ae88051be admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:40.152778 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c207692-4aa9-4dbc-ac2d-eb8ae88051be admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:40.152778 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c207692-4aa9-4dbc-ac2d-eb8ae88051be admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:40.153246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c207692-4aa9-4dbc-ac2d-eb8ae88051be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:40.154876 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c207692-4aa9-4dbc-ac2d-eb8ae88051be admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:40.167282 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1161/2345] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:42:40.171664 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f345d3-c0ea-40f3-83e4-3aafe84f76bb admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:40.183289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f345d3-c0ea-40f3-83e4-3aafe84f76bb admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:40.204069 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfad31-7c58-420b-a914-5e734844bb9d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:40.204247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625931a0-3b01-4335-98bc-9cfc5f5b8c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:40.204433 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfad31-7c58-420b-a914-5e734844bb9d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:40.204551 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfad31-7c58-420b-a914-5e734844bb9d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:40.204857 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625931a0-3b01-4335-98bc-9cfc5f5b8c26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:40.205201 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625931a0-3b01-4335-98bc-9cfc5f5b8c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:40.205542 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625931a0-3b01-4335-98bc-9cfc5f5b8c26 admin admin] PATH_INFO: `/v3/projects/23649ef44ee9471c9b142b88848b8805/users/4b8b2996451e45e9baa0968eb91da78e/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:40.206912 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1162/2346] 10.222.0.32 () {54 vars in 921 bytes} [Thu Jun 2 13:42:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:42:40.212265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625931a0-3b01-4335-98bc-9cfc5f5b8c26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23649ef44ee9471c9b142b88848b8805, user_id=4b8b2996451e45e9baa0968eb91da78e, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:40.213031 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940a1a5-42fe-4062-b906-641c9ff2904a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:40.213397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940a1a5-42fe-4062-b906-641c9ff2904a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:40.213752 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940a1a5-42fe-4062-b906-641c9ff2904a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:40.215249 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625931a0-3b01-4335-98bc-9cfc5f5b8c26 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:40.238131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1185/2347] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:42:40 2022] PUT /identity/v3/projects/23649ef44ee9471c9b142b88848b8805/users/4b8b2996451e45e9baa0968eb91da78e/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:40.239085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4940a1a5-42fe-4062-b906-641c9ff2904a None None] MFA Rules not processed for user `b2e5d9f3c4e04ca3bf52b28b67d2a4d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:40.239922 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc0ced-f2cd-4572-a527-9560e31f5a72 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:40.240335 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc0ced-f2cd-4572-a527-9560e31f5a72 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:40.240723 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc0ced-f2cd-4572-a527-9560e31f5a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:40.241025 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4940a1a5-42fe-4062-b906-641c9ff2904a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:40.270530 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-61cc0ced-f2cd-4572-a527-9560e31f5a72 None None] MFA Rules not processed for user `4b8b2996451e45e9baa0968eb91da78e`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:40.271943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-61cc0ced-f2cd-4572-a527-9560e31f5a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:40.366849 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1163/2348] 10.222.0.32 () {58 vars in 1018 bytes} [Thu Jun 2 13:42:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:42:40.367910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940a1a5-42fe-4062-b906-641c9ff2904a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:40.370147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4940a1a5-42fe-4062-b906-641c9ff2904a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:40.385891 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1186/2349] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:42:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:42:40.398345 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc0ced-f2cd-4572-a527-9560e31f5a72 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:40.400117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-61cc0ced-f2cd-4572-a527-9560e31f5a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:40.443754 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940a1a5-42fe-4062-b906-641c9ff2904a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:40.448212 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86edb3-def4-4ad4-b36a-e312c3dbc960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:40.448939 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86edb3-def4-4ad4-b36a-e312c3dbc960 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:40.449455 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86edb3-def4-4ad4-b36a-e312c3dbc960 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:40.449738 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86edb3-def4-4ad4-b36a-e312c3dbc960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:40.463047 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86edb3-def4-4ad4-b36a-e312c3dbc960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:40.464661 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86edb3-def4-4ad4-b36a-e312c3dbc960 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:40.476147 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc0ced-f2cd-4572-a527-9560e31f5a72 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:40.478135 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1164/2350] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:40.481545 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cfe94-8ad3-428a-acfc-9f0ad33253a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:40.482414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cfe94-8ad3-428a-acfc-9f0ad33253a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:40.482797 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cfe94-8ad3-428a-acfc-9f0ad33253a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:40.483377 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cfe94-8ad3-428a-acfc-9f0ad33253a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:40.498517 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cfe94-8ad3-428a-acfc-9f0ad33253a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:40.500074 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cfe94-8ad3-428a-acfc-9f0ad33253a3 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:40.510694 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1187/2351] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:42:40.627182 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86edb3-def4-4ad4-b36a-e312c3dbc960 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:40.633463 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:40.645598 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86edb3-def4-4ad4-b36a-e312c3dbc960 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:40.650184 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62a4f0-ae74-46c2-9d6d-5a13b3a90c3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:40.650924 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62a4f0-ae74-46c2-9d6d-5a13b3a90c3c service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:40.651327 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62a4f0-ae74-46c2-9d6d-5a13b3a90c3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:40.651672 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62a4f0-ae74-46c2-9d6d-5a13b3a90c3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:40.748958 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62a4f0-ae74-46c2-9d6d-5a13b3a90c3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:40.751123 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62a4f0-ae74-46c2-9d6d-5a13b3a90c3c service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:40.763766 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1165/2352] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:43.085887 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a026c3-eafd-4761-b942-e778808f441b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:43.086363 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a026c3-eafd-4761-b942-e778808f441b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:43.086497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a026c3-eafd-4761-b942-e778808f441b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:43.105796 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-83a026c3-eafd-4761-b942-e778808f441b None None] MFA Rules not processed for user `bbcd5ba866b84d099d183fe19ba61a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:43.107020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-83a026c3-eafd-4761-b942-e778808f441b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:43.165390 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1188/2353] 10.222.0.32 () {58 vars in 1009 bytes} [Thu Jun 2 13:42:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:43.179065 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62a4f0-ae74-46c2-9d6d-5a13b3a90c3c service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:43.180607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ed62a4f0-ae74-46c2-9d6d-5a13b3a90c3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:43.253595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62a4f0-ae74-46c2-9d6d-5a13b3a90c3c service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:43.258791 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5f8d0-d9b0-4f8a-b9f3-cc639d46e062 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aea97e7b39448a283032f662142b6e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:43.259539 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5f8d0-d9b0-4f8a-b9f3-cc639d46e062 service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:43.259922 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5f8d0-d9b0-4f8a-b9f3-cc639d46e062 service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:43.260290 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5f8d0-d9b0-4f8a-b9f3-cc639d46e062 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:43.269984 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5f8d0-d9b0-4f8a-b9f3-cc639d46e062 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:43.271779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5f8d0-d9b0-4f8a-b9f3-cc639d46e062 service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:43.281660 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1166/2354] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Jun 2 13:42:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:42:43.568939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a026c3-eafd-4761-b942-e778808f441b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:43.602124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:43.690719 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a026c3-eafd-4761-b942-e778808f441b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:43.695683 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99242b4f-e14f-4140-a16f-ec81a328928c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:43.696676 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99242b4f-e14f-4140-a16f-ec81a328928c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:43.696959 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99242b4f-e14f-4140-a16f-ec81a328928c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:43.697241 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99242b4f-e14f-4140-a16f-ec81a328928c admin admin] PATH_INFO: `/v3/users/16ac65a0ec3141059b6140ae930bbd38` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:43.698717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99242b4f-e14f-4140-a16f-ec81a328928c admin admin] RBAC: Authorizing `identity:delete_user(user_id=16ac65a0ec3141059b6140ae930bbd38)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:43.700688 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99242b4f-e14f-4140-a16f-ec81a328928c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:43.772290 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-99242b4f-e14f-4140-a16f-ec81a328928c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16ac65a0ec3141059b6140ae930bbd38'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:43.780398 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-99242b4f-e14f-4140-a16f-ec81a328928c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16ac65a0ec3141059b6140ae930bbd38'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:43.781123 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-99242b4f-e14f-4140-a16f-ec81a328928c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16ac65a0ec3141059b6140ae930bbd38'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:43.799153 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-99242b4f-e14f-4140-a16f-ec81a328928c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16ac65a0ec3141059b6140ae930bbd38'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:43.808524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-99242b4f-e14f-4140-a16f-ec81a328928c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16ac65a0ec3141059b6140ae930bbd38'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:43.819419 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1189/2355] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:42:43 2022] DELETE /identity/v3/users/16ac65a0ec3141059b6140ae930bbd38 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:43.821455 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a619b-bd9c-4515-aff3-cfd8cf48a476 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:43.821881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a619b-bd9c-4515-aff3-cfd8cf48a476 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:43.822380 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a619b-bd9c-4515-aff3-cfd8cf48a476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:43.843891 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-477a619b-bd9c-4515-aff3-cfd8cf48a476 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:43.845223 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-477a619b-bd9c-4515-aff3-cfd8cf48a476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:43.921990 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1167/2356] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:43.933349 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99242b4f-e14f-4140-a16f-ec81a328928c admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:43.934916 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-99242b4f-e14f-4140-a16f-ec81a328928c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:44.001242 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99242b4f-e14f-4140-a16f-ec81a328928c admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:44.007488 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be657eb7-e3ca-44a5-97eb-48a2acca5c5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:44.007488 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be657eb7-e3ca-44a5-97eb-48a2acca5c5e service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:44.007488 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be657eb7-e3ca-44a5-97eb-48a2acca5c5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:44.007488 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be657eb7-e3ca-44a5-97eb-48a2acca5c5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:44.021974 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be657eb7-e3ca-44a5-97eb-48a2acca5c5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:44.023637 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be657eb7-e3ca-44a5-97eb-48a2acca5c5e service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:44.036741 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1190/2357] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:44.347654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a619b-bd9c-4515-aff3-cfd8cf48a476 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:44.350073 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-477a619b-bd9c-4515-aff3-cfd8cf48a476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:44.370953 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a619b-bd9c-4515-aff3-cfd8cf48a476 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:44.377264 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720eda6-1870-4138-b93b-78de02ddc6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:44.378204 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720eda6-1870-4138-b93b-78de02ddc6e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:44.378512 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720eda6-1870-4138-b93b-78de02ddc6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:44.378760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720eda6-1870-4138-b93b-78de02ddc6e6 admin admin] PATH_INFO: `/v3/projects/2a2eaf908827424898caa5813b3052f4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:44.387184 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720eda6-1870-4138-b93b-78de02ddc6e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a2eaf908827424898caa5813b3052f4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:44.390214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720eda6-1870-4138-b93b-78de02ddc6e6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:44.455469 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:44.474294 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7720eda6-1870-4138-b93b-78de02ddc6e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a2eaf908827424898caa5813b3052f4', 'request_id': 'req-7720eda6-1870-4138-b93b-78de02ddc6e6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:44.480553 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7720eda6-1870-4138-b93b-78de02ddc6e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a2eaf908827424898caa5813b3052f4', 'request_id': 'req-7720eda6-1870-4138-b93b-78de02ddc6e6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:44.489640 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7720eda6-1870-4138-b93b-78de02ddc6e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a2eaf908827424898caa5813b3052f4', 'request_id': 'req-7720eda6-1870-4138-b93b-78de02ddc6e6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:44.528277 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7720eda6-1870-4138-b93b-78de02ddc6e6 admin admin] The token cache is being invalidate because project 2a2eaf908827424898caa5813b3052f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:42:44.528645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7720eda6-1870-4138-b93b-78de02ddc6e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:44.529260 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7720eda6-1870-4138-b93b-78de02ddc6e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:44.531034 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1168/2358] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:42:44 2022] DELETE /identity/v3/projects/2a2eaf908827424898caa5813b3052f4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:44.535334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be657eb7-e3ca-44a5-97eb-48a2acca5c5e service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:44.572501 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be657eb7-e3ca-44a5-97eb-48a2acca5c5e service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:44.611917 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:44.649679 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfda323-f367-4e16-8e17-7981a84dfdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:44.650658 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfda323-f367-4e16-8e17-7981a84dfdbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:44.651036 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfda323-f367-4e16-8e17-7981a84dfdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:44.651389 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfda323-f367-4e16-8e17-7981a84dfdbb admin admin] PATH_INFO: `/v3/users/4b8b2996451e45e9baa0968eb91da78e` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:44.652833 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfda323-f367-4e16-8e17-7981a84dfdbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b8b2996451e45e9baa0968eb91da78e)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:44.655619 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfda323-f367-4e16-8e17-7981a84dfdbb admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:44.713801 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fcfda323-f367-4e16-8e17-7981a84dfdbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b8b2996451e45e9baa0968eb91da78e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:44.722194 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fcfda323-f367-4e16-8e17-7981a84dfdbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b8b2996451e45e9baa0968eb91da78e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:44.722924 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fcfda323-f367-4e16-8e17-7981a84dfdbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b8b2996451e45e9baa0968eb91da78e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:44.737635 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fcfda323-f367-4e16-8e17-7981a84dfdbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b8b2996451e45e9baa0968eb91da78e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:44.747076 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-fcfda323-f367-4e16-8e17-7981a84dfdbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b8b2996451e45e9baa0968eb91da78e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:44.755489 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1191/2359] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:42:44 2022] DELETE /identity/v3/users/4b8b2996451e45e9baa0968eb91da78e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:45.177148 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720eda6-1870-4138-b93b-78de02ddc6e6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:45.178577 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7720eda6-1870-4138-b93b-78de02ddc6e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:45.193910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720eda6-1870-4138-b93b-78de02ddc6e6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:45.262002 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e847605-8e67-4caa-90b3-3bc584f24c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:45.263204 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e847605-8e67-4caa-90b3-3bc584f24c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:45.263539 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e847605-8e67-4caa-90b3-3bc584f24c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:45.263894 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e847605-8e67-4caa-90b3-3bc584f24c9e admin admin] PATH_INFO: `/v3/projects/23649ef44ee9471c9b142b88848b8805` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:45.265597 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e847605-8e67-4caa-90b3-3bc584f24c9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=23649ef44ee9471c9b142b88848b8805)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:45.267499 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e847605-8e67-4caa-90b3-3bc584f24c9e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:45.321037 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9e847605-8e67-4caa-90b3-3bc584f24c9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23649ef44ee9471c9b142b88848b8805', 'request_id': 'req-9e847605-8e67-4caa-90b3-3bc584f24c9e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:45.327654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9e847605-8e67-4caa-90b3-3bc584f24c9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23649ef44ee9471c9b142b88848b8805', 'request_id': 'req-9e847605-8e67-4caa-90b3-3bc584f24c9e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:45.337147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9e847605-8e67-4caa-90b3-3bc584f24c9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23649ef44ee9471c9b142b88848b8805', 'request_id': 'req-9e847605-8e67-4caa-90b3-3bc584f24c9e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:45.349413 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9e847605-8e67-4caa-90b3-3bc584f24c9e admin admin] The token cache is being invalidate because project 23649ef44ee9471c9b142b88848b8805 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:42:45.350030 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9e847605-8e67-4caa-90b3-3bc584f24c9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:45.350432 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9e847605-8e67-4caa-90b3-3bc584f24c9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:45.352365 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1169/2360] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:42:45 2022] DELETE /identity/v3/projects/23649ef44ee9471c9b142b88848b8805 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:45.358587 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8f0af-5803-4e32-a5e2-95b659fc5a6f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:45.358888 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8f0af-5803-4e32-a5e2-95b659fc5a6f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:45.359174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8f0af-5803-4e32-a5e2-95b659fc5a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:45.379436 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-0de8f0af-5803-4e32-a5e2-95b659fc5a6f None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:45.380714 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0de8f0af-5803-4e32-a5e2-95b659fc5a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:45.454673 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1192/2361] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:45.464033 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb2625-f0ee-408d-82b0-38b422e31b66 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:45.464348 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb2625-f0ee-408d-82b0-38b422e31b66 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:45.464643 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb2625-f0ee-408d-82b0-38b422e31b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:45.490112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-22bb2625-f0ee-408d-82b0-38b422e31b66 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:45.493357 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-22bb2625-f0ee-408d-82b0-38b422e31b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:45.508254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1170/2362] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:45.509190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8f0af-5803-4e32-a5e2-95b659fc5a6f None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:45.520738 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8f0af-5803-4e32-a5e2-95b659fc5a6f None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:45.525783 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b597606-8811-4b0a-894a-e6198b211941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:45.526556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b597606-8811-4b0a-894a-e6198b211941 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:45.526849 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b597606-8811-4b0a-894a-e6198b211941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:45.527129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b597606-8811-4b0a-894a-e6198b211941 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:45.527872 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b597606-8811-4b0a-894a-e6198b211941 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:42:45.528213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b597606-8811-4b0a-894a-e6198b211941 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:45.529880 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b597606-8811-4b0a-894a-e6198b211941 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:45.544337 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1193/2363] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:42:45.548762 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb2625-f0ee-408d-82b0-38b422e31b66 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:45.560885 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb2625-f0ee-408d-82b0-38b422e31b66 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:45.567132 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e6fb3-58de-49f2-9ed9-45d77ed2f0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:45.567805 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e6fb3-58de-49f2-9ed9-45d77ed2f0f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:45.568228 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e6fb3-58de-49f2-9ed9-45d77ed2f0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:45.568546 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e6fb3-58de-49f2-9ed9-45d77ed2f0f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:45.569255 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e6fb3-58de-49f2-9ed9-45d77ed2f0f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:45.571181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e6fb3-58de-49f2-9ed9-45d77ed2f0f8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:45.608620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1171/2364] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:42:45 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:42:45.613718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b597606-8811-4b0a-894a-e6198b211941 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:45.627443 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b597606-8811-4b0a-894a-e6198b211941 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:45.672558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:45.697674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315ab88-7c56-4589-8e9b-1e8d75e46c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:45.698430 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315ab88-7c56-4589-8e9b-1e8d75e46c95 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:45.698724 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315ab88-7c56-4589-8e9b-1e8d75e46c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:45.699008 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315ab88-7c56-4589-8e9b-1e8d75e46c95 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:45.699866 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315ab88-7c56-4589-8e9b-1e8d75e46c95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:45.702083 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315ab88-7c56-4589-8e9b-1e8d75e46c95 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:45.729199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1194/2365] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:42:45 2022] POST /identity/v3/users => generated 294 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:42:45.733171 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e6fb3-58de-49f2-9ed9-45d77ed2f0f8 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:45.744390 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e6fb3-58de-49f2-9ed9-45d77ed2f0f8 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:45.749878 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c2e49-9789-4640-b07d-c1ba8153f8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:45.750750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c2e49-9789-4640-b07d-c1ba8153f8cf admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:45.751232 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c2e49-9789-4640-b07d-c1ba8153f8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:45.751669 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c2e49-9789-4640-b07d-c1ba8153f8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:45.752630 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c2e49-9789-4640-b07d-c1ba8153f8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:45.754496 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c2e49-9789-4640-b07d-c1ba8153f8cf admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:45.767871 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1172/2366] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:42:45.772623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315ab88-7c56-4589-8e9b-1e8d75e46c95 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:45.783503 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315ab88-7c56-4589-8e9b-1e8d75e46c95 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:45.791024 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4773c-afc7-412e-8b16-164e377fe755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:45.791948 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4773c-afc7-412e-8b16-164e377fe755 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:45.792478 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4773c-afc7-412e-8b16-164e377fe755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:45.792973 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4773c-afc7-412e-8b16-164e377fe755 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:45.793905 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4773c-afc7-412e-8b16-164e377fe755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:45.796371 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4773c-afc7-412e-8b16-164e377fe755 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:45.808128 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1195/2367] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:42:45.812415 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c2e49-9789-4640-b07d-c1ba8153f8cf admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:45.825272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c2e49-9789-4640-b07d-c1ba8153f8cf admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:45.831788 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb71459-d9fa-4790-ac2e-f4480ecf5b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:45.833112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb71459-d9fa-4790-ac2e-f4480ecf5b44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:45.833594 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb71459-d9fa-4790-ac2e-f4480ecf5b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:45.834061 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb71459-d9fa-4790-ac2e-f4480ecf5b44 admin admin] PATH_INFO: `/v3/projects/f22b07b7e87743b6993665e259f92d81/users/9e3b3dd635a54b67bfb6501bc25a6c81/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:45.837198 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:45.856730 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb71459-d9fa-4790-ac2e-f4480ecf5b44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f22b07b7e87743b6993665e259f92d81, user_id=9e3b3dd635a54b67bfb6501bc25a6c81, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:45.860218 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb71459-d9fa-4790-ac2e-f4480ecf5b44 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:45.883330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1173/2368] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:42:45 2022] PUT /identity/v3/projects/f22b07b7e87743b6993665e259f92d81/users/9e3b3dd635a54b67bfb6501bc25a6c81/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:45.893858 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5158e1-86f9-4654-8ee0-916b303c402b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:45.894485 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5158e1-86f9-4654-8ee0-916b303c402b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:45.894995 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5158e1-86f9-4654-8ee0-916b303c402b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:45.929919 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-bd5158e1-86f9-4654-8ee0-916b303c402b None None] MFA Rules not processed for user `9e3b3dd635a54b67bfb6501bc25a6c81`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:45.931632 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bd5158e1-86f9-4654-8ee0-916b303c402b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:46.013440 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1196/2369] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:42:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:46.019565 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb71459-d9fa-4790-ac2e-f4480ecf5b44 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:46.111103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb71459-d9fa-4790-ac2e-f4480ecf5b44 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:46.119972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18aa241-6a8b-49d8-aca8-8bee7c7fe494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:46.121189 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18aa241-6a8b-49d8-aca8-8bee7c7fe494 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:46.121694 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18aa241-6a8b-49d8-aca8-8bee7c7fe494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:46.122191 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18aa241-6a8b-49d8-aca8-8bee7c7fe494 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:46.123169 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18aa241-6a8b-49d8-aca8-8bee7c7fe494 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:46.127165 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18aa241-6a8b-49d8-aca8-8bee7c7fe494 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:46.179889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1174/2370] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:42:46 2022] POST /identity/v3/projects => generated 389 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:42:46.184459 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5158e1-86f9-4654-8ee0-916b303c402b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:46.197760 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5158e1-86f9-4654-8ee0-916b303c402b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:46.280989 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f2f6f-0c7a-42ba-b4d8-7ba5a7fbf55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:46.281684 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f2f6f-0c7a-42ba-b4d8-7ba5a7fbf55e admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:46.281969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f2f6f-0c7a-42ba-b4d8-7ba5a7fbf55e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:46.282247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f2f6f-0c7a-42ba-b4d8-7ba5a7fbf55e admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:46.282950 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f2f6f-0c7a-42ba-b4d8-7ba5a7fbf55e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:46.285675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f2f6f-0c7a-42ba-b4d8-7ba5a7fbf55e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:46.323347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1197/2371] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:42:46 2022] POST /identity/v3/users => generated 301 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:42:46.327153 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18aa241-6a8b-49d8-aca8-8bee7c7fe494 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:46.340519 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18aa241-6a8b-49d8-aca8-8bee7c7fe494 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:46.343446 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6573e-8f59-40f8-adf1-04c1debb3068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:46.344178 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6573e-8f59-40f8-adf1-04c1debb3068 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:46.344586 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6573e-8f59-40f8-adf1-04c1debb3068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:46.344867 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6573e-8f59-40f8-adf1-04c1debb3068 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:46.345599 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6573e-8f59-40f8-adf1-04c1debb3068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:46.347813 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6573e-8f59-40f8-adf1-04c1debb3068 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:46.360343 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1175/2372] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:42:46.363542 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f2f6f-0c7a-42ba-b4d8-7ba5a7fbf55e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:46.374195 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f2f6f-0c7a-42ba-b4d8-7ba5a7fbf55e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:46.380052 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c46ec-33cc-4f2a-bc4b-1c017b12014b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:46.382787 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c46ec-33cc-4f2a-bc4b-1c017b12014b admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:46.382787 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c46ec-33cc-4f2a-bc4b-1c017b12014b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:46.382787 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c46ec-33cc-4f2a-bc4b-1c017b12014b admin admin] PATH_INFO: `/v3/projects/a0f036fe80db4ca2991145f01c8f591e/users/e9bff7b3623744c3923e8e74ec0e8ff5/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:46.401673 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c46ec-33cc-4f2a-bc4b-1c017b12014b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0f036fe80db4ca2991145f01c8f591e, user_id=e9bff7b3623744c3923e8e74ec0e8ff5, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:46.404707 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c46ec-33cc-4f2a-bc4b-1c017b12014b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:46.423719 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1198/2373] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:42:46 2022] PUT /identity/v3/projects/a0f036fe80db4ca2991145f01c8f591e/users/e9bff7b3623744c3923e8e74ec0e8ff5/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:46.427821 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6573e-8f59-40f8-adf1-04c1debb3068 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:46.440088 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6573e-8f59-40f8-adf1-04c1debb3068 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:46.509559 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779d209-dcf4-4cdc-9e4e-95a5cb9aa486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:46.510445 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779d209-dcf4-4cdc-9e4e-95a5cb9aa486 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:46.510629 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779d209-dcf4-4cdc-9e4e-95a5cb9aa486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:46.510989 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779d209-dcf4-4cdc-9e4e-95a5cb9aa486 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:46.511795 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779d209-dcf4-4cdc-9e4e-95a5cb9aa486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:46.513516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779d209-dcf4-4cdc-9e4e-95a5cb9aa486 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:46.525594 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1176/2374] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:42:46.529441 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c46ec-33cc-4f2a-bc4b-1c017b12014b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:46.543306 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c46ec-33cc-4f2a-bc4b-1c017b12014b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:46.548170 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a534f-76c2-4f77-a946-99aef490ce33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:46.549159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a534f-76c2-4f77-a946-99aef490ce33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:46.549546 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a534f-76c2-4f77-a946-99aef490ce33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:46.549913 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a534f-76c2-4f77-a946-99aef490ce33 admin admin] PATH_INFO: `/v3/projects/a0f036fe80db4ca2991145f01c8f591e/users/e9bff7b3623744c3923e8e74ec0e8ff5/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:46.551971 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a534f-76c2-4f77-a946-99aef490ce33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0f036fe80db4ca2991145f01c8f591e, user_id=e9bff7b3623744c3923e8e74ec0e8ff5, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:46.554761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a534f-76c2-4f77-a946-99aef490ce33 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:46.569344 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1199/2375] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:42:46 2022] PUT /identity/v3/projects/a0f036fe80db4ca2991145f01c8f591e/users/e9bff7b3623744c3923e8e74ec0e8ff5/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:42:46.580791 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb16917-134e-4d1f-80b6-5c88bd18dde3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:46.588965 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb16917-134e-4d1f-80b6-5c88bd18dde3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:46.588965 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb16917-134e-4d1f-80b6-5c88bd18dde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:46.611659 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-beb16917-134e-4d1f-80b6-5c88bd18dde3 None None] MFA Rules not processed for user `e9bff7b3623744c3923e8e74ec0e8ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:46.612950 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-beb16917-134e-4d1f-80b6-5c88bd18dde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:46.660112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:46.703827 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1177/2376] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:42:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:46.712135 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a534f-76c2-4f77-a946-99aef490ce33 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:46.713928 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-208a534f-76c2-4f77-a946-99aef490ce33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:46.719346 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:46.789879 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a534f-76c2-4f77-a946-99aef490ce33 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:46.793700 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e5da4-d54a-4067-865b-307181e0f126 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:46.794348 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e5da4-d54a-4067-865b-307181e0f126 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:46.794638 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e5da4-d54a-4067-865b-307181e0f126 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:46.794916 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e5da4-d54a-4067-865b-307181e0f126 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:46.805595 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e5da4-d54a-4067-865b-307181e0f126 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:46.807630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e5da4-d54a-4067-865b-307181e0f126 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:46.821842 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1200/2377] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:46.964292 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb16917-134e-4d1f-80b6-5c88bd18dde3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:47.050892 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb16917-134e-4d1f-80b6-5c88bd18dde3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:47.056422 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab68a90-6083-4925-b287-8044afe4a605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:47.057523 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab68a90-6083-4925-b287-8044afe4a605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:47.058180 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab68a90-6083-4925-b287-8044afe4a605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:47.058666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab68a90-6083-4925-b287-8044afe4a605 admin admin] PATH_INFO: `/v3/users/9e3b3dd635a54b67bfb6501bc25a6c81` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:47.060117 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab68a90-6083-4925-b287-8044afe4a605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e3b3dd635a54b67bfb6501bc25a6c81)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:47.062376 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab68a90-6083-4925-b287-8044afe4a605 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:47.119101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cab68a90-6083-4925-b287-8044afe4a605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e3b3dd635a54b67bfb6501bc25a6c81'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:47.130919 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cab68a90-6083-4925-b287-8044afe4a605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e3b3dd635a54b67bfb6501bc25a6c81'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:47.131650 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cab68a90-6083-4925-b287-8044afe4a605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e3b3dd635a54b67bfb6501bc25a6c81'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:47.150893 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cab68a90-6083-4925-b287-8044afe4a605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e3b3dd635a54b67bfb6501bc25a6c81'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:47.160890 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cab68a90-6083-4925-b287-8044afe4a605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e3b3dd635a54b67bfb6501bc25a6c81'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:47.169683 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1178/2378] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:42:46 2022] DELETE /identity/v3/users/9e3b3dd635a54b67bfb6501bc25a6c81 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:47.179535 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f8d76-14c6-461c-84d6-9b11d7e9ce5d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:47.180060 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f8d76-14c6-461c-84d6-9b11d7e9ce5d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:47.180552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f8d76-14c6-461c-84d6-9b11d7e9ce5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:47.212350 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f34f8d76-14c6-461c-84d6-9b11d7e9ce5d None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:47.213583 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f34f8d76-14c6-461c-84d6-9b11d7e9ce5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:47.316429 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1201/2379] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:47.324222 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab68a90-6083-4925-b287-8044afe4a605 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:47.326015 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cab68a90-6083-4925-b287-8044afe4a605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:47.439144 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab68a90-6083-4925-b287-8044afe4a605 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:47.443172 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73e0ec-7a56-41d4-82b0-63e148d18b24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:47.443985 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73e0ec-7a56-41d4-82b0-63e148d18b24 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:47.444282 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73e0ec-7a56-41d4-82b0-63e148d18b24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:47.444593 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73e0ec-7a56-41d4-82b0-63e148d18b24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:47.460174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73e0ec-7a56-41d4-82b0-63e148d18b24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:47.461687 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73e0ec-7a56-41d4-82b0-63e148d18b24 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:47.468658 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:47.479845 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1179/2380] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:47.812069 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f8d76-14c6-461c-84d6-9b11d7e9ce5d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:47.813943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f34f8d76-14c6-461c-84d6-9b11d7e9ce5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:47.838503 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f8d76-14c6-461c-84d6-9b11d7e9ce5d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:47.847821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9b8b8-0ab8-4075-946c-4c4f264cffe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:47.848821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9b8b8-0ab8-4075-946c-4c4f264cffe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:47.849110 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9b8b8-0ab8-4075-946c-4c4f264cffe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:47.849505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9b8b8-0ab8-4075-946c-4c4f264cffe9 admin admin] PATH_INFO: `/v3/projects/f22b07b7e87743b6993665e259f92d81` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:47.850649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc9b8b8-0ab8-4075-946c-4c4f264cffe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f22b07b7e87743b6993665e259f92d81)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:47.852942 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc9b8b8-0ab8-4075-946c-4c4f264cffe9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:47.917616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-edc9b8b8-0ab8-4075-946c-4c4f264cffe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f22b07b7e87743b6993665e259f92d81', 'request_id': 'req-edc9b8b8-0ab8-4075-946c-4c4f264cffe9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:47.925748 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-edc9b8b8-0ab8-4075-946c-4c4f264cffe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f22b07b7e87743b6993665e259f92d81', 'request_id': 'req-edc9b8b8-0ab8-4075-946c-4c4f264cffe9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:47.936123 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-edc9b8b8-0ab8-4075-946c-4c4f264cffe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f22b07b7e87743b6993665e259f92d81', 'request_id': 'req-edc9b8b8-0ab8-4075-946c-4c4f264cffe9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:47.948809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-edc9b8b8-0ab8-4075-946c-4c4f264cffe9 admin admin] The token cache is being invalidate because project f22b07b7e87743b6993665e259f92d81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:42:47.949104 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-edc9b8b8-0ab8-4075-946c-4c4f264cffe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:47.950392 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-edc9b8b8-0ab8-4075-946c-4c4f264cffe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:47.952242 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1202/2381] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:42:47 2022] DELETE /identity/v3/projects/f22b07b7e87743b6993665e259f92d81 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:47.959124 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73e0ec-7a56-41d4-82b0-63e148d18b24 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:47.970693 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73e0ec-7a56-41d4-82b0-63e148d18b24 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:48.055129 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd122bc3-5b4c-4cda-bc29-06c7b3a3c6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:48.056012 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd122bc3-5b4c-4cda-bc29-06c7b3a3c6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:48.056322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd122bc3-5b4c-4cda-bc29-06c7b3a3c6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:48.056647 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd122bc3-5b4c-4cda-bc29-06c7b3a3c6d2 admin admin] PATH_INFO: `/v3/users/e9bff7b3623744c3923e8e74ec0e8ff5` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:48.057850 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd122bc3-5b4c-4cda-bc29-06c7b3a3c6d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9bff7b3623744c3923e8e74ec0e8ff5)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:48.059811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd122bc3-5b4c-4cda-bc29-06c7b3a3c6d2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:48.121683 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cd122bc3-5b4c-4cda-bc29-06c7b3a3c6d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9bff7b3623744c3923e8e74ec0e8ff5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:48.129806 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cd122bc3-5b4c-4cda-bc29-06c7b3a3c6d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9bff7b3623744c3923e8e74ec0e8ff5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:48.130964 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cd122bc3-5b4c-4cda-bc29-06c7b3a3c6d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9bff7b3623744c3923e8e74ec0e8ff5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:48.148429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cd122bc3-5b4c-4cda-bc29-06c7b3a3c6d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9bff7b3623744c3923e8e74ec0e8ff5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:48.160829 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cd122bc3-5b4c-4cda-bc29-06c7b3a3c6d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9bff7b3623744c3923e8e74ec0e8ff5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:48.169957 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1180/2382] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:42:47 2022] DELETE /identity/v3/users/e9bff7b3623744c3923e8e74ec0e8ff5 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:42:48.536519 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9b8b8-0ab8-4075-946c-4c4f264cffe9 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:48.538049 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-edc9b8b8-0ab8-4075-946c-4c4f264cffe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:48.563138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9b8b8-0ab8-4075-946c-4c4f264cffe9 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:48.627131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:48.675167 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e237f9-8935-4a20-9128-09899f7664a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:48.676229 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e237f9-8935-4a20-9128-09899f7664a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:48.676637 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e237f9-8935-4a20-9128-09899f7664a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:48.677012 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e237f9-8935-4a20-9128-09899f7664a0 admin admin] PATH_INFO: `/v3/projects/a0f036fe80db4ca2991145f01c8f591e` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:48.678376 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e237f9-8935-4a20-9128-09899f7664a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0f036fe80db4ca2991145f01c8f591e)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:48.680407 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e237f9-8935-4a20-9128-09899f7664a0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:48.750491 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-03e237f9-8935-4a20-9128-09899f7664a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0f036fe80db4ca2991145f01c8f591e', 'request_id': 'req-03e237f9-8935-4a20-9128-09899f7664a0'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:48.768930 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-03e237f9-8935-4a20-9128-09899f7664a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0f036fe80db4ca2991145f01c8f591e', 'request_id': 'req-03e237f9-8935-4a20-9128-09899f7664a0'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:48.778319 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-03e237f9-8935-4a20-9128-09899f7664a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0f036fe80db4ca2991145f01c8f591e', 'request_id': 'req-03e237f9-8935-4a20-9128-09899f7664a0'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:48.792290 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-03e237f9-8935-4a20-9128-09899f7664a0 admin admin] The token cache is being invalidate because project a0f036fe80db4ca2991145f01c8f591e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:42:48.792744 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-03e237f9-8935-4a20-9128-09899f7664a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:48.793512 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-03e237f9-8935-4a20-9128-09899f7664a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:48.795186 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1203/2383] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:42:48 2022] DELETE /identity/v3/projects/a0f036fe80db4ca2991145f01c8f591e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:42:48.805111 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc559c-fd65-483e-b9be-47fcb1d76315 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:48.806511 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc559c-fd65-483e-b9be-47fcb1d76315 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:48.807216 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc559c-fd65-483e-b9be-47fcb1d76315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:48.833801 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f3dc559c-fd65-483e-b9be-47fcb1d76315 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:48.835199 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f3dc559c-fd65-483e-b9be-47fcb1d76315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:48.909793 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1181/2384] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:48.918576 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe1295-c104-4d51-8e46-9b8b864993bf None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:48.919144 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe1295-c104-4d51-8e46-9b8b864993bf None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:48.919693 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe1295-c104-4d51-8e46-9b8b864993bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:48.942418 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f8fe1295-c104-4d51-8e46-9b8b864993bf None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:48.943760 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f8fe1295-c104-4d51-8e46-9b8b864993bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:48.951988 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1204/2385] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:48.957180 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc559c-fd65-483e-b9be-47fcb1d76315 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:48.968230 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc559c-fd65-483e-b9be-47fcb1d76315 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:48.973347 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2dee6-5be8-4986-afdf-17777fc64041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:48.974032 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2dee6-5be8-4986-afdf-17777fc64041 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:48.974315 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2dee6-5be8-4986-afdf-17777fc64041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:48.974746 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2dee6-5be8-4986-afdf-17777fc64041 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:48.975546 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2dee6-5be8-4986-afdf-17777fc64041 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:42:48.975856 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2dee6-5be8-4986-afdf-17777fc64041 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:48.977712 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2dee6-5be8-4986-afdf-17777fc64041 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:48.994183 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1182/2386] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:42:48.998816 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe1295-c104-4d51-8e46-9b8b864993bf None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:49.015567 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe1295-c104-4d51-8e46-9b8b864993bf None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:49.021738 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30090ab2-862d-489d-a3c3-993ce23cd05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:49.022542 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30090ab2-862d-489d-a3c3-993ce23cd05b admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:49.023535 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30090ab2-862d-489d-a3c3-993ce23cd05b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:49.023817 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30090ab2-862d-489d-a3c3-993ce23cd05b admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:49.024603 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30090ab2-862d-489d-a3c3-993ce23cd05b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:49.026645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30090ab2-862d-489d-a3c3-993ce23cd05b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:49.056444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1205/2387] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:42:48 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:42:49.060796 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2dee6-5be8-4986-afdf-17777fc64041 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:49.072642 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2dee6-5be8-4986-afdf-17777fc64041 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:49.077243 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:49.168095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a2aa1-f9bf-44ae-806c-2c2189867051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:49.168721 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a2aa1-f9bf-44ae-806c-2c2189867051 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:49.169008 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a2aa1-f9bf-44ae-806c-2c2189867051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:49.169291 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a2aa1-f9bf-44ae-806c-2c2189867051 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:49.169988 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a2aa1-f9bf-44ae-806c-2c2189867051 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:49.171945 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a2aa1-f9bf-44ae-806c-2c2189867051 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:49.196552 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1183/2388] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:42:49 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:42:49.201029 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30090ab2-862d-489d-a3c3-993ce23cd05b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:49.215030 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30090ab2-862d-489d-a3c3-993ce23cd05b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:49.220343 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4396fa1-0b79-4336-84b0-e1fa2bb18f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:49.221138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4396fa1-0b79-4336-84b0-e1fa2bb18f67 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:49.221485 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4396fa1-0b79-4336-84b0-e1fa2bb18f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:49.221829 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4396fa1-0b79-4336-84b0-e1fa2bb18f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:49.222629 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4396fa1-0b79-4336-84b0-e1fa2bb18f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:49.224213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4396fa1-0b79-4336-84b0-e1fa2bb18f67 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:49.242578 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1206/2389] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:42:49.244130 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a2aa1-f9bf-44ae-806c-2c2189867051 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:49.256451 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a2aa1-f9bf-44ae-806c-2c2189867051 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:49.261974 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632089a7-69d3-433b-ad0a-460bfcf58313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:49.262922 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632089a7-69d3-433b-ad0a-460bfcf58313 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:49.263398 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632089a7-69d3-433b-ad0a-460bfcf58313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:49.263834 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632089a7-69d3-433b-ad0a-460bfcf58313 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:49.264880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632089a7-69d3-433b-ad0a-460bfcf58313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:49.266746 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632089a7-69d3-433b-ad0a-460bfcf58313 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:49.284099 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1184/2390] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:42:49.285119 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4396fa1-0b79-4336-84b0-e1fa2bb18f67 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:49.296041 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4396fa1-0b79-4336-84b0-e1fa2bb18f67 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:49.303437 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883b7f9-5f72-420e-abd7-3f03a0be986d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:49.304531 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883b7f9-5f72-420e-abd7-3f03a0be986d admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:49.304915 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883b7f9-5f72-420e-abd7-3f03a0be986d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:49.305287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883b7f9-5f72-420e-abd7-3f03a0be986d admin admin] PATH_INFO: `/v3/projects/990383d9e7654221b4c9ad00b0dd04b3/users/0a4df2a5528e4330ad7a6395fd0cc228/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:49.322334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883b7f9-5f72-420e-abd7-3f03a0be986d admin admin] RBAC: Authorizing `identity:create_grant(project_id=990383d9e7654221b4c9ad00b0dd04b3, user_id=0a4df2a5528e4330ad7a6395fd0cc228, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:49.325239 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883b7f9-5f72-420e-abd7-3f03a0be986d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:49.340239 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1207/2391] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:42:49 2022] PUT /identity/v3/projects/990383d9e7654221b4c9ad00b0dd04b3/users/0a4df2a5528e4330ad7a6395fd0cc228/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:42:49.350533 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a611e75-1ece-475d-9561-fd83631dd04f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:49.350823 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a611e75-1ece-475d-9561-fd83631dd04f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:49.351111 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a611e75-1ece-475d-9561-fd83631dd04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:49.380978 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4a611e75-1ece-475d-9561-fd83631dd04f None None] MFA Rules not processed for user `0a4df2a5528e4330ad7a6395fd0cc228`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:49.382214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4a611e75-1ece-475d-9561-fd83631dd04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:49.462688 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1185/2392] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:42:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:42:49.467409 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883b7f9-5f72-420e-abd7-3f03a0be986d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:49.542965 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:49.550252 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883b7f9-5f72-420e-abd7-3f03a0be986d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:49.567466 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e2580-7471-4ad7-9b2b-37fe1b7b8993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:49.568863 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e2580-7471-4ad7-9b2b-37fe1b7b8993 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:49.569253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e2580-7471-4ad7-9b2b-37fe1b7b8993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:49.569698 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e2580-7471-4ad7-9b2b-37fe1b7b8993 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:49.570503 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e2580-7471-4ad7-9b2b-37fe1b7b8993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:49.572852 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e2580-7471-4ad7-9b2b-37fe1b7b8993 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:49.607941 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1208/2393] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:42:49 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:42:49.609418 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a611e75-1ece-475d-9561-fd83631dd04f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:49.622588 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a611e75-1ece-475d-9561-fd83631dd04f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:49.701566 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf253e-4997-44c6-a01b-d89dbd49a148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:49.702839 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf253e-4997-44c6-a01b-d89dbd49a148 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:49.703279 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf253e-4997-44c6-a01b-d89dbd49a148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:49.703787 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf253e-4997-44c6-a01b-d89dbd49a148 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:49.705680 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf253e-4997-44c6-a01b-d89dbd49a148 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:49.708469 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf253e-4997-44c6-a01b-d89dbd49a148 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:49.738125 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1186/2394] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:42:49 2022] POST /identity/v3/users => generated 299 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:42:49.741719 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e2580-7471-4ad7-9b2b-37fe1b7b8993 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:49.753466 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e2580-7471-4ad7-9b2b-37fe1b7b8993 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:49.759004 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b544d-54d1-4129-85da-78669aa7e7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:49.759796 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b544d-54d1-4129-85da-78669aa7e7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:49.760184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b544d-54d1-4129-85da-78669aa7e7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:49.760853 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b544d-54d1-4129-85da-78669aa7e7c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:49.761694 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b544d-54d1-4129-85da-78669aa7e7c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:49.763519 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b544d-54d1-4129-85da-78669aa7e7c9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:49.779813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1209/2395] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:42:49.781195 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf253e-4997-44c6-a01b-d89dbd49a148 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:49.790175 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:49.796939 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf253e-4997-44c6-a01b-d89dbd49a148 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:49.804977 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348451da-61da-446a-ba68-5aefc1d7bc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:49.806363 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348451da-61da-446a-ba68-5aefc1d7bc5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:49.807370 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348451da-61da-446a-ba68-5aefc1d7bc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:49.808008 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348451da-61da-446a-ba68-5aefc1d7bc5d admin admin] PATH_INFO: `/v3/projects/302b8a30c208473aa9cdbece2dea6dd3/users/1a9aae9210a54c1ea09aa794c8dd5c54/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:49.827164 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348451da-61da-446a-ba68-5aefc1d7bc5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=302b8a30c208473aa9cdbece2dea6dd3, user_id=1a9aae9210a54c1ea09aa794c8dd5c54, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:49.830286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348451da-61da-446a-ba68-5aefc1d7bc5d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:49.852429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1187/2396] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:42:49 2022] PUT /identity/v3/projects/302b8a30c208473aa9cdbece2dea6dd3/users/1a9aae9210a54c1ea09aa794c8dd5c54/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:49.852888 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b544d-54d1-4129-85da-78669aa7e7c9 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:49.868752 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b544d-54d1-4129-85da-78669aa7e7c9 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:49.977844 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8979681-2397-4169-a3c1-21834250c30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:49.979457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8979681-2397-4169-a3c1-21834250c30b admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:49.979961 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8979681-2397-4169-a3c1-21834250c30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:49.980466 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8979681-2397-4169-a3c1-21834250c30b admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:49.981362 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8979681-2397-4169-a3c1-21834250c30b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:49.983124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8979681-2397-4169-a3c1-21834250c30b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:49.995990 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1210/2397] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:42:50.000045 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348451da-61da-446a-ba68-5aefc1d7bc5d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:50.016558 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348451da-61da-446a-ba68-5aefc1d7bc5d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:50.024627 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602db29-d30a-421c-900b-d5e997d1cdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:50.025653 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602db29-d30a-421c-900b-d5e997d1cdb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:50.026012 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602db29-d30a-421c-900b-d5e997d1cdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:50.026394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602db29-d30a-421c-900b-d5e997d1cdb5 admin admin] PATH_INFO: `/v3/projects/302b8a30c208473aa9cdbece2dea6dd3/users/1a9aae9210a54c1ea09aa794c8dd5c54/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:50.028784 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602db29-d30a-421c-900b-d5e997d1cdb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=302b8a30c208473aa9cdbece2dea6dd3, user_id=1a9aae9210a54c1ea09aa794c8dd5c54, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:50.031861 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602db29-d30a-421c-900b-d5e997d1cdb5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:50.043901 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1188/2398] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:42:49 2022] PUT /identity/v3/projects/302b8a30c208473aa9cdbece2dea6dd3/users/1a9aae9210a54c1ea09aa794c8dd5c54/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:50.055488 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959e71d-fb8f-46f0-91e9-2ed3cb712de3 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:50.056060 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959e71d-fb8f-46f0-91e9-2ed3cb712de3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:50.056376 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959e71d-fb8f-46f0-91e9-2ed3cb712de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:50.095426 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d959e71d-fb8f-46f0-91e9-2ed3cb712de3 None None] MFA Rules not processed for user `1a9aae9210a54c1ea09aa794c8dd5c54`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:50.097237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d959e71d-fb8f-46f0-91e9-2ed3cb712de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:50.204349 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1211/2399] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:42:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:50.215452 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602db29-d30a-421c-900b-d5e997d1cdb5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:50.217270 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a602db29-d30a-421c-900b-d5e997d1cdb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:50.290691 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602db29-d30a-421c-900b-d5e997d1cdb5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:50.295127 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f140d6-6a73-4871-a011-e6387a4dc202 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:50.296091 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f140d6-6a73-4871-a011-e6387a4dc202 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:50.296483 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f140d6-6a73-4871-a011-e6387a4dc202 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:50.296831 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f140d6-6a73-4871-a011-e6387a4dc202 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:50.366112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f140d6-6a73-4871-a011-e6387a4dc202 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:50.367873 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f140d6-6a73-4871-a011-e6387a4dc202 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:50.378758 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1189/2400] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:54.779331 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959e71d-fb8f-46f0-91e9-2ed3cb712de3 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:54.780958 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d959e71d-fb8f-46f0-91e9-2ed3cb712de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:54.792918 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959e71d-fb8f-46f0-91e9-2ed3cb712de3 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:54.796515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76bc14f-ee31-4f32-a733-a1db8c921ce9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:54.797346 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bc14f-ee31-4f32-a733-a1db8c921ce9 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:54.797631 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bc14f-ee31-4f32-a733-a1db8c921ce9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:54.797904 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bc14f-ee31-4f32-a733-a1db8c921ce9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:54.807894 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76bc14f-ee31-4f32-a733-a1db8c921ce9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:54.809425 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76bc14f-ee31-4f32-a733-a1db8c921ce9 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:54.820028 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1212/2401] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:42:59.698781 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f140d6-6a73-4871-a011-e6387a4dc202 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:59.764375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f140d6-6a73-4871-a011-e6387a4dc202 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:42:59.769484 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b0fe0-a6db-47a3-a1dd-cb364b71ca21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:42:59.770381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b0fe0-a6db-47a3-a1dd-cb364b71ca21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:59.770663 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b0fe0-a6db-47a3-a1dd-cb364b71ca21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:59.770937 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b0fe0-a6db-47a3-a1dd-cb364b71ca21 admin admin] PATH_INFO: `/v3/users/0a4df2a5528e4330ad7a6395fd0cc228` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:59.772146 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b0fe0-a6db-47a3-a1dd-cb364b71ca21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a4df2a5528e4330ad7a6395fd0cc228)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:42:59.774116 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b0fe0-a6db-47a3-a1dd-cb364b71ca21 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:42:59.799621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:59.827996 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7d7b0fe0-a6db-47a3-a1dd-cb364b71ca21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a4df2a5528e4330ad7a6395fd0cc228'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:59.835531 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7d7b0fe0-a6db-47a3-a1dd-cb364b71ca21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a4df2a5528e4330ad7a6395fd0cc228'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:59.836236 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7d7b0fe0-a6db-47a3-a1dd-cb364b71ca21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a4df2a5528e4330ad7a6395fd0cc228'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:59.848793 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7d7b0fe0-a6db-47a3-a1dd-cb364b71ca21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a4df2a5528e4330ad7a6395fd0cc228'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:59.857432 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7d7b0fe0-a6db-47a3-a1dd-cb364b71ca21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a4df2a5528e4330ad7a6395fd0cc228'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:42:59.863330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1190/2402] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:42:59 2022] DELETE /identity/v3/users/0a4df2a5528e4330ad7a6395fd0cc228 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:42:59.868050 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050e4f3-2d97-49ba-9b3f-809cc1e65dc1 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:42:59.868581 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050e4f3-2d97-49ba-9b3f-809cc1e65dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:42:59.868683 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050e4f3-2d97-49ba-9b3f-809cc1e65dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:42:59.886669 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f050e4f3-2d97-49ba-9b3f-809cc1e65dc1 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:42:59.887886 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f050e4f3-2d97-49ba-9b3f-809cc1e65dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:42:59.922050 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:59.953241 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1213/2403] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:42:59.967770 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b0fe0-a6db-47a3-a1dd-cb364b71ca21 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:42:59.969200 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7d7b0fe0-a6db-47a3-a1dd-cb364b71ca21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:00.039931 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b0fe0-a6db-47a3-a1dd-cb364b71ca21 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:00.043522 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8db53-b68f-4544-ad4b-e5dec6ccbd0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:00.044167 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8db53-b68f-4544-ad4b-e5dec6ccbd0f service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:00.044482 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8db53-b68f-4544-ad4b-e5dec6ccbd0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:00.044763 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8db53-b68f-4544-ad4b-e5dec6ccbd0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:00.053729 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8db53-b68f-4544-ad4b-e5dec6ccbd0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:00.055167 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8db53-b68f-4544-ad4b-e5dec6ccbd0f service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:00.064544 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1191/2404] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:42:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:43:00.320066 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050e4f3-2d97-49ba-9b3f-809cc1e65dc1 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:00.321610 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f050e4f3-2d97-49ba-9b3f-809cc1e65dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:00.335054 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050e4f3-2d97-49ba-9b3f-809cc1e65dc1 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:00.340178 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f7469-39a7-46e2-ae31-ba23c49e962b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:00.341074 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f7469-39a7-46e2-ae31-ba23c49e962b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:00.341369 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f7469-39a7-46e2-ae31-ba23c49e962b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:00.341650 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f7469-39a7-46e2-ae31-ba23c49e962b admin admin] PATH_INFO: `/v3/projects/990383d9e7654221b4c9ad00b0dd04b3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:00.343237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f7469-39a7-46e2-ae31-ba23c49e962b admin admin] RBAC: Authorizing `identity:delete_project(project_id=990383d9e7654221b4c9ad00b0dd04b3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:00.345483 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f7469-39a7-46e2-ae31-ba23c49e962b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:00.394986 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1f4f7469-39a7-46e2-ae31-ba23c49e962b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '990383d9e7654221b4c9ad00b0dd04b3', 'request_id': 'req-1f4f7469-39a7-46e2-ae31-ba23c49e962b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:00.403944 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1f4f7469-39a7-46e2-ae31-ba23c49e962b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '990383d9e7654221b4c9ad00b0dd04b3', 'request_id': 'req-1f4f7469-39a7-46e2-ae31-ba23c49e962b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:00.410046 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1f4f7469-39a7-46e2-ae31-ba23c49e962b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '990383d9e7654221b4c9ad00b0dd04b3', 'request_id': 'req-1f4f7469-39a7-46e2-ae31-ba23c49e962b'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:00.421160 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1f4f7469-39a7-46e2-ae31-ba23c49e962b admin admin] The token cache is being invalidate because project 990383d9e7654221b4c9ad00b0dd04b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:43:00.421447 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1f4f7469-39a7-46e2-ae31-ba23c49e962b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:00.422084 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1f4f7469-39a7-46e2-ae31-ba23c49e962b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:00.423643 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1214/2405] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:43:00 2022] DELETE /identity/v3/projects/990383d9e7654221b4c9ad00b0dd04b3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:43:00.428036 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8db53-b68f-4544-ad4b-e5dec6ccbd0f service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:00.437661 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8db53-b68f-4544-ad4b-e5dec6ccbd0f service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:00.502125 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdc589-ed61-4ff0-a001-34fc5669f90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:00.503615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdc589-ed61-4ff0-a001-34fc5669f90b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:00.503939 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdc589-ed61-4ff0-a001-34fc5669f90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:00.504187 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdc589-ed61-4ff0-a001-34fc5669f90b admin admin] PATH_INFO: `/v3/users/1a9aae9210a54c1ea09aa794c8dd5c54` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:00.505459 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdc589-ed61-4ff0-a001-34fc5669f90b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a9aae9210a54c1ea09aa794c8dd5c54)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:00.507424 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdc589-ed61-4ff0-a001-34fc5669f90b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:00.553508 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:43:00.555237 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-44bdc589-ed61-4ff0-a001-34fc5669f90b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a9aae9210a54c1ea09aa794c8dd5c54'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:00.564763 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-44bdc589-ed61-4ff0-a001-34fc5669f90b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a9aae9210a54c1ea09aa794c8dd5c54'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:00.566263 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-44bdc589-ed61-4ff0-a001-34fc5669f90b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a9aae9210a54c1ea09aa794c8dd5c54'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:00.579431 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-44bdc589-ed61-4ff0-a001-34fc5669f90b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a9aae9210a54c1ea09aa794c8dd5c54'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:00.586901 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-44bdc589-ed61-4ff0-a001-34fc5669f90b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a9aae9210a54c1ea09aa794c8dd5c54'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:00.596030 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1192/2406] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:43:00 2022] DELETE /identity/v3/users/1a9aae9210a54c1ea09aa794c8dd5c54 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:43:00.873026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f7469-39a7-46e2-ae31-ba23c49e962b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:00.875377 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1f4f7469-39a7-46e2-ae31-ba23c49e962b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:00.899093 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f7469-39a7-46e2-ae31-ba23c49e962b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:00.967963 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147d834-765e-438e-822b-49d177c9c584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:00.968966 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147d834-765e-438e-822b-49d177c9c584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:00.969318 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147d834-765e-438e-822b-49d177c9c584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:00.969661 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147d834-765e-438e-822b-49d177c9c584 admin admin] PATH_INFO: `/v3/projects/302b8a30c208473aa9cdbece2dea6dd3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:00.970966 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7147d834-765e-438e-822b-49d177c9c584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=302b8a30c208473aa9cdbece2dea6dd3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:00.973521 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7147d834-765e-438e-822b-49d177c9c584 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:01.026522 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7147d834-765e-438e-822b-49d177c9c584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '302b8a30c208473aa9cdbece2dea6dd3', 'request_id': 'req-7147d834-765e-438e-822b-49d177c9c584'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:01.033837 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7147d834-765e-438e-822b-49d177c9c584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '302b8a30c208473aa9cdbece2dea6dd3', 'request_id': 'req-7147d834-765e-438e-822b-49d177c9c584'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:01.039226 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:43:01.040579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7147d834-765e-438e-822b-49d177c9c584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '302b8a30c208473aa9cdbece2dea6dd3', 'request_id': 'req-7147d834-765e-438e-822b-49d177c9c584'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:01.055539 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7147d834-765e-438e-822b-49d177c9c584 admin admin] The token cache is being invalidate because project 302b8a30c208473aa9cdbece2dea6dd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:43:01.055826 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7147d834-765e-438e-822b-49d177c9c584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:01.056507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-7147d834-765e-438e-822b-49d177c9c584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:01.058093 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1215/2407] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:43:00 2022] DELETE /identity/v3/projects/302b8a30c208473aa9cdbece2dea6dd3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:43:01.063881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df3101-eefe-40f4-b895-16c253b78981 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:01.064416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df3101-eefe-40f4-b895-16c253b78981 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:01.064543 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df3101-eefe-40f4-b895-16c253b78981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:01.083397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c3df3101-eefe-40f4-b895-16c253b78981 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:43:01.084617 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c3df3101-eefe-40f4-b895-16c253b78981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:01.145100 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1193/2408] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:43:01.153382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8f729-f4f2-4bd9-847c-0fb18139b1ba None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:01.153671 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8f729-f4f2-4bd9-847c-0fb18139b1ba None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:01.153977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8f729-f4f2-4bd9-847c-0fb18139b1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:01.172593 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-69a8f729-f4f2-4bd9-847c-0fb18139b1ba None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:43:01.173793 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-69a8f729-f4f2-4bd9-847c-0fb18139b1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:01.181732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1216/2409] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:43:01.185791 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df3101-eefe-40f4-b895-16c253b78981 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:01.195677 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df3101-eefe-40f4-b895-16c253b78981 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:01.200190 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dadc9-ae1e-4424-8b5b-c25fde78bdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:01.200873 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dadc9-ae1e-4424-8b5b-c25fde78bdc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:01.201171 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dadc9-ae1e-4424-8b5b-c25fde78bdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:01.201434 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dadc9-ae1e-4424-8b5b-c25fde78bdc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:01.202154 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898dadc9-ae1e-4424-8b5b-c25fde78bdc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:43:01.202722 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898dadc9-ae1e-4424-8b5b-c25fde78bdc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:01.204341 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898dadc9-ae1e-4424-8b5b-c25fde78bdc5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:01.216217 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1194/2410] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:43:01.220410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8f729-f4f2-4bd9-847c-0fb18139b1ba None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:01.230114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8f729-f4f2-4bd9-847c-0fb18139b1ba None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:01.234868 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30e351-9c36-44d8-aa56-06f660398588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:01.235520 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30e351-9c36-44d8-aa56-06f660398588 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:01.235804 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30e351-9c36-44d8-aa56-06f660398588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:01.236084 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30e351-9c36-44d8-aa56-06f660398588 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:01.236809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b30e351-9c36-44d8-aa56-06f660398588 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:01.238787 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b30e351-9c36-44d8-aa56-06f660398588 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:01.265434 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1217/2411] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:43:01 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:43:01.270427 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dadc9-ae1e-4424-8b5b-c25fde78bdc5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:01.280656 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dadc9-ae1e-4424-8b5b-c25fde78bdc5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:01.301200 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5822f9-cb97-448b-af2c-a6bd1c3d877b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:01.301495 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5822f9-cb97-448b-af2c-a6bd1c3d877b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:01.301784 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5822f9-cb97-448b-af2c-a6bd1c3d877b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:01.319580 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-9d5822f9-cb97-448b-af2c-a6bd1c3d877b None None] MFA Rules not processed for user `bbcd5ba866b84d099d183fe19ba61a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:43:01.320825 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9d5822f9-cb97-448b-af2c-a6bd1c3d877b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:01.340481 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90542cb5-c0e2-4c7d-bb11-5888d698a270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:01.341141 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90542cb5-c0e2-4c7d-bb11-5888d698a270 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:01.341421 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90542cb5-c0e2-4c7d-bb11-5888d698a270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:01.341703 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90542cb5-c0e2-4c7d-bb11-5888d698a270 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:01.342415 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90542cb5-c0e2-4c7d-bb11-5888d698a270 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:01.344415 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90542cb5-c0e2-4c7d-bb11-5888d698a270 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:01.364376 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1195/2412] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:43:01 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:43:01.368281 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90542cb5-c0e2-4c7d-bb11-5888d698a270 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:01.377704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90542cb5-c0e2-4c7d-bb11-5888d698a270 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:01.379941 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1218/2413] 10.222.0.32 () {58 vars in 1009 bytes} [Thu Jun 2 13:43:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:43:01.382296 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdd4de-1f1c-49bb-9fe5-3227ffac5123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:01.382925 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdd4de-1f1c-49bb-9fe5-3227ffac5123 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:01.383223 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdd4de-1f1c-49bb-9fe5-3227ffac5123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:01.383478 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdd4de-1f1c-49bb-9fe5-3227ffac5123 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:01.384187 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdd4de-1f1c-49bb-9fe5-3227ffac5123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:01.385811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdd4de-1f1c-49bb-9fe5-3227ffac5123 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:01.391890 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5822f9-cb97-448b-af2c-a6bd1c3d877b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:01.393242 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9d5822f9-cb97-448b-af2c-a6bd1c3d877b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:01.399434 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1196/2414] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:43:01.400440 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdd4de-1f1c-49bb-9fe5-3227ffac5123 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:01.410700 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdd4de-1f1c-49bb-9fe5-3227ffac5123 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:01.415373 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20fabe-7358-4b83-bff7-8a4332b83e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:01.416009 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20fabe-7358-4b83-bff7-8a4332b83e96 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:01.416318 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20fabe-7358-4b83-bff7-8a4332b83e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:01.416605 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20fabe-7358-4b83-bff7-8a4332b83e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:01.417320 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20fabe-7358-4b83-bff7-8a4332b83e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:01.418907 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20fabe-7358-4b83-bff7-8a4332b83e96 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:01.429440 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1197/2415] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:43:01.433624 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20fabe-7358-4b83-bff7-8a4332b83e96 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:01.443054 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20fabe-7358-4b83-bff7-8a4332b83e96 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:01.447677 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6347875-a87c-4738-b283-ef37b5ea84ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:01.448550 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6347875-a87c-4738-b283-ef37b5ea84ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:01.448837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6347875-a87c-4738-b283-ef37b5ea84ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:01.449116 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6347875-a87c-4738-b283-ef37b5ea84ef admin admin] PATH_INFO: `/v3/projects/a1d95c6bbdae456ea7c8ad12124c8efc/users/e6a8f2fa23c345058a76d64dfc45ef37/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:01.462981 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5822f9-cb97-448b-af2c-a6bd1c3d877b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:01.464163 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6347875-a87c-4738-b283-ef37b5ea84ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1d95c6bbdae456ea7c8ad12124c8efc, user_id=e6a8f2fa23c345058a76d64dfc45ef37, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:01.466846 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6347875-a87c-4738-b283-ef37b5ea84ef admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:01.467972 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed8a19-beee-4b7c-a8b6-68d4144dd792 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aea97e7b39448a283032f662142b6e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:01.468635 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed8a19-beee-4b7c-a8b6-68d4144dd792 service swift] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:01.468924 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed8a19-beee-4b7c-a8b6-68d4144dd792 service swift] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:01.469078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:43:01.469181 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed8a19-beee-4b7c-a8b6-68d4144dd792 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:01.478821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed8a19-beee-4b7c-a8b6-68d4144dd792 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:01.480437 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed8a19-beee-4b7c-a8b6-68d4144dd792 service swift] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:01.482798 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1198/2416] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:43:01 2022] PUT /identity/v3/projects/a1d95c6bbdae456ea7c8ad12124c8efc/users/e6a8f2fa23c345058a76d64dfc45ef37/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:43:01.488972 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1219/2417] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Jun 2 13:43:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 13:43:01.494319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b0856-2ec0-4e11-8f16-0fb44f423dc6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:01.494614 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b0856-2ec0-4e11-8f16-0fb44f423dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:01.494893 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b0856-2ec0-4e11-8f16-0fb44f423dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:01.523871 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1b2b0856-2ec0-4e11-8f16-0fb44f423dc6 None None] MFA Rules not processed for user `e6a8f2fa23c345058a76d64dfc45ef37`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:43:01.525133 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1b2b0856-2ec0-4e11-8f16-0fb44f423dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:01.634064 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1199/2418] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:43:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:43:01.647352 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed8a19-beee-4b7c-a8b6-68d4144dd792 service swift] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:01.649751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f4ed8a19-beee-4b7c-a8b6-68d4144dd792 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:01.725728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed8a19-beee-4b7c-a8b6-68d4144dd792 service swift] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:01.742184 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:43:01.800182 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9baf102-17cf-4b1b-8f12-56fb72d8c400 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e239e4e9b99433ca9d1a8db45e24b56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:01.800932 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9baf102-17cf-4b1b-8f12-56fb72d8c400 service glance] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:01.801223 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9baf102-17cf-4b1b-8f12-56fb72d8c400 service glance] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:01.801507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9baf102-17cf-4b1b-8f12-56fb72d8c400 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:01.812432 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9baf102-17cf-4b1b-8f12-56fb72d8c400 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:01.814375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9baf102-17cf-4b1b-8f12-56fb72d8c400 service glance] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:01.827002 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1220/2419] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:43:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:43:11.628920 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:INSERT=1,keystone:SELECT=34 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:43:11.821702 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=20 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:43:20.543686 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a382563-e0b1-435c-82dd-a1f091c34d2b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:20.544212 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a382563-e0b1-435c-82dd-a1f091c34d2b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:20.544333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a382563-e0b1-435c-82dd-a1f091c34d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:20.565635 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0a382563-e0b1-435c-82dd-a1f091c34d2b None None] MFA Rules not processed for user `bbcd5ba866b84d099d183fe19ba61a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:43:20.566906 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0a382563-e0b1-435c-82dd-a1f091c34d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:20.621874 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1200/2420] 10.222.0.32 () {58 vars in 967 bytes} [Thu Jun 2 13:43:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:43:20.643518 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9baf102-17cf-4b1b-8f12-56fb72d8c400 service glance] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:20.712129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9baf102-17cf-4b1b-8f12-56fb72d8c400 service glance] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:20.717639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da18992-7011-4908-a542-8eea1d219341 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aea97e7b39448a283032f662142b6e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:20.718275 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da18992-7011-4908-a542-8eea1d219341 service swift] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:20.718557 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da18992-7011-4908-a542-8eea1d219341 service swift] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:20.718832 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da18992-7011-4908-a542-8eea1d219341 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:20.728443 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da18992-7011-4908-a542-8eea1d219341 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:20.730018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da18992-7011-4908-a542-8eea1d219341 service swift] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:20.738179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1221/2421] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Jun 2 13:43:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:43:21.585959 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a382563-e0b1-435c-82dd-a1f091c34d2b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:21.649075 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a382563-e0b1-435c-82dd-a1f091c34d2b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:21.653574 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc5307-5e40-498a-955e-2380ae737a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:21.654437 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc5307-5e40-498a-955e-2380ae737a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:21.654721 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc5307-5e40-498a-955e-2380ae737a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:21.654999 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc5307-5e40-498a-955e-2380ae737a66 admin admin] PATH_INFO: `/v3/users/e6a8f2fa23c345058a76d64dfc45ef37` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:21.656174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc5307-5e40-498a-955e-2380ae737a66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6a8f2fa23c345058a76d64dfc45ef37)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:21.658169 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc5307-5e40-498a-955e-2380ae737a66 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:21.703085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-45cc5307-5e40-498a-955e-2380ae737a66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6a8f2fa23c345058a76d64dfc45ef37'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:21.710447 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-45cc5307-5e40-498a-955e-2380ae737a66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6a8f2fa23c345058a76d64dfc45ef37'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:21.711105 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-45cc5307-5e40-498a-955e-2380ae737a66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6a8f2fa23c345058a76d64dfc45ef37'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:21.722956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-45cc5307-5e40-498a-955e-2380ae737a66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6a8f2fa23c345058a76d64dfc45ef37'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:21.730240 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-45cc5307-5e40-498a-955e-2380ae737a66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6a8f2fa23c345058a76d64dfc45ef37'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:21.736122 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1201/2422] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:43:21 2022] DELETE /identity/v3/users/e6a8f2fa23c345058a76d64dfc45ef37 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:43:21.740584 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a88a6-86f9-4829-983f-f04dc48d520d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:21.741080 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a88a6-86f9-4829-983f-f04dc48d520d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:21.741187 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a88a6-86f9-4829-983f-f04dc48d520d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:21.758245 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-aa0a88a6-86f9-4829-983f-f04dc48d520d None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:43:21.759435 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-aa0a88a6-86f9-4829-983f-f04dc48d520d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:21.816639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1222/2423] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:43:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:43:21.827456 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc5307-5e40-498a-955e-2380ae737a66 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:21.828885 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-45cc5307-5e40-498a-955e-2380ae737a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:21.857413 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:43:21.889336 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc5307-5e40-498a-955e-2380ae737a66 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:21.893010 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a165143-72d5-4162-82c7-1f88213b620e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:21.893666 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a165143-72d5-4162-82c7-1f88213b620e service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:21.893951 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a165143-72d5-4162-82c7-1f88213b620e service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:21.894231 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a165143-72d5-4162-82c7-1f88213b620e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:21.904207 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a165143-72d5-4162-82c7-1f88213b620e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:21.905697 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a165143-72d5-4162-82c7-1f88213b620e service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:21.915906 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1202/2424] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:43:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:43:22.191862 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a88a6-86f9-4829-983f-f04dc48d520d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:22.193941 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-aa0a88a6-86f9-4829-983f-f04dc48d520d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:22.205993 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a88a6-86f9-4829-983f-f04dc48d520d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:22.210944 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd43a9-0d45-4845-b3ae-1f851dc8f743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:22.211805 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd43a9-0d45-4845-b3ae-1f851dc8f743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:22.212094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd43a9-0d45-4845-b3ae-1f851dc8f743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:22.212405 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd43a9-0d45-4845-b3ae-1f851dc8f743 admin admin] PATH_INFO: `/v3/projects/a1d95c6bbdae456ea7c8ad12124c8efc` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:22.213612 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd43a9-0d45-4845-b3ae-1f851dc8f743 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1d95c6bbdae456ea7c8ad12124c8efc)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:22.215716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd43a9-0d45-4845-b3ae-1f851dc8f743 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:22.262541 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f8cd43a9-0d45-4845-b3ae-1f851dc8f743 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1d95c6bbdae456ea7c8ad12124c8efc', 'request_id': 'req-f8cd43a9-0d45-4845-b3ae-1f851dc8f743'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:22.269584 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f8cd43a9-0d45-4845-b3ae-1f851dc8f743 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1d95c6bbdae456ea7c8ad12124c8efc', 'request_id': 'req-f8cd43a9-0d45-4845-b3ae-1f851dc8f743'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:22.275412 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f8cd43a9-0d45-4845-b3ae-1f851dc8f743 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1d95c6bbdae456ea7c8ad12124c8efc', 'request_id': 'req-f8cd43a9-0d45-4845-b3ae-1f851dc8f743'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:22.286122 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f8cd43a9-0d45-4845-b3ae-1f851dc8f743 admin admin] The token cache is being invalidate because project a1d95c6bbdae456ea7c8ad12124c8efc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:43:22.286407 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f8cd43a9-0d45-4845-b3ae-1f851dc8f743 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:22.287018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f8cd43a9-0d45-4845-b3ae-1f851dc8f743 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:22.288586 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1223/2425] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:43:22 2022] DELETE /identity/v3/projects/a1d95c6bbdae456ea7c8ad12124c8efc => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:43:22.293402 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcee82-ef99-4a1e-92d8-31e1f979720c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:22.293697 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcee82-ef99-4a1e-92d8-31e1f979720c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:22.293986 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcee82-ef99-4a1e-92d8-31e1f979720c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:22.311681 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-cadcee82-ef99-4a1e-92d8-31e1f979720c None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:43:22.312912 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cadcee82-ef99-4a1e-92d8-31e1f979720c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:22.370782 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1203/2426] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:43:22.431875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357e8fe-2428-4f9a-b24d-457d7e67d60c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:22.432171 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357e8fe-2428-4f9a-b24d-457d7e67d60c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:22.432493 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357e8fe-2428-4f9a-b24d-457d7e67d60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:22.451347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f357e8fe-2428-4f9a-b24d-457d7e67d60c None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:43:22.452847 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f357e8fe-2428-4f9a-b24d-457d7e67d60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:22.460809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1224/2427] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:43:22.464949 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcee82-ef99-4a1e-92d8-31e1f979720c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:22.475313 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcee82-ef99-4a1e-92d8-31e1f979720c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:22.479977 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312351a-d822-420e-b4d4-cc2397cf1938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:22.480737 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312351a-d822-420e-b4d4-cc2397cf1938 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:22.481027 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312351a-d822-420e-b4d4-cc2397cf1938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:22.481307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312351a-d822-420e-b4d4-cc2397cf1938 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:22.482032 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312351a-d822-420e-b4d4-cc2397cf1938 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:43:22.482344 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312351a-d822-420e-b4d4-cc2397cf1938 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:22.483945 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312351a-d822-420e-b4d4-cc2397cf1938 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:22.496046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1204/2428] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:43:22.500218 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357e8fe-2428-4f9a-b24d-457d7e67d60c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:22.509626 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357e8fe-2428-4f9a-b24d-457d7e67d60c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:22.514260 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6de97-3802-4104-bca1-8e49a83025f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:22.514901 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6de97-3802-4104-bca1-8e49a83025f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:22.515185 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6de97-3802-4104-bca1-8e49a83025f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:22.515463 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6de97-3802-4104-bca1-8e49a83025f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:22.516191 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d6de97-3802-4104-bca1-8e49a83025f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:22.518212 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d6de97-3802-4104-bca1-8e49a83025f3 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:22.521380 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:43:22.545106 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1225/2429] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:43:22 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:43:22.549275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312351a-d822-420e-b4d4-cc2397cf1938 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:22.559562 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312351a-d822-420e-b4d4-cc2397cf1938 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:22.615261 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c48e0-487d-426c-82d7-4953734aaaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:22.615902 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c48e0-487d-426c-82d7-4953734aaaf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:22.616192 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c48e0-487d-426c-82d7-4953734aaaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:22.616506 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c48e0-487d-426c-82d7-4953734aaaf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:22.617189 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c48e0-487d-426c-82d7-4953734aaaf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:22.619123 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c48e0-487d-426c-82d7-4953734aaaf4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:22.638176 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1205/2430] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:43:22 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:43:22.642245 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6de97-3802-4104-bca1-8e49a83025f3 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:22.652511 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6de97-3802-4104-bca1-8e49a83025f3 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:22.657159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8032b-212b-4b47-aef1-d63558beb53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:22.657804 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8032b-212b-4b47-aef1-d63558beb53d admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:22.658085 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8032b-212b-4b47-aef1-d63558beb53d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:22.658365 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8032b-212b-4b47-aef1-d63558beb53d admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:22.659083 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8032b-212b-4b47-aef1-d63558beb53d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:22.660717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8032b-212b-4b47-aef1-d63558beb53d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:22.671420 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1226/2431] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:43:22.675120 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c48e0-487d-426c-82d7-4953734aaaf4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:22.685484 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c48e0-487d-426c-82d7-4953734aaaf4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:22.690007 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74d074-52e2-483a-9c87-e6c75992fe76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:22.690643 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74d074-52e2-483a-9c87-e6c75992fe76 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:22.690924 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74d074-52e2-483a-9c87-e6c75992fe76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:22.691199 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74d074-52e2-483a-9c87-e6c75992fe76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:22.691909 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74d074-52e2-483a-9c87-e6c75992fe76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:22.694042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74d074-52e2-483a-9c87-e6c75992fe76 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:22.704242 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1206/2432] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:43:22.708647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8032b-212b-4b47-aef1-d63558beb53d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:22.718321 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8032b-212b-4b47-aef1-d63558beb53d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:22.722927 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07443d-782a-4c0b-976a-cb47d7eec7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:22.723789 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07443d-782a-4c0b-976a-cb47d7eec7ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:22.724075 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07443d-782a-4c0b-976a-cb47d7eec7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:22.724387 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07443d-782a-4c0b-976a-cb47d7eec7ee admin admin] PATH_INFO: `/v3/projects/7ef4e4f7a0934a7985ac56522217c513/users/2db46cb36cdb453ca18a0f974bfa3621/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:22.740109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07443d-782a-4c0b-976a-cb47d7eec7ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef4e4f7a0934a7985ac56522217c513, user_id=2db46cb36cdb453ca18a0f974bfa3621, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:22.742770 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07443d-782a-4c0b-976a-cb47d7eec7ee admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:22.755702 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1227/2433] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:43:22 2022] PUT /identity/v3/projects/7ef4e4f7a0934a7985ac56522217c513/users/2db46cb36cdb453ca18a0f974bfa3621/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:43:22.765734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fff718-b12e-4b4c-9a6d-0b10b3468f48 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:22.766029 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fff718-b12e-4b4c-9a6d-0b10b3468f48 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:22.766314 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fff718-b12e-4b4c-9a6d-0b10b3468f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:22.794417 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d4fff718-b12e-4b4c-9a6d-0b10b3468f48 None None] MFA Rules not processed for user `2db46cb36cdb453ca18a0f974bfa3621`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:43:22.795616 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d4fff718-b12e-4b4c-9a6d-0b10b3468f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:22.814765 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:43:22.859858 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1207/2434] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:43:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:43:22.871423 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07443d-782a-4c0b-976a-cb47d7eec7ee admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:22.873118 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5a07443d-782a-4c0b-976a-cb47d7eec7ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:22.928687 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07443d-782a-4c0b-976a-cb47d7eec7ee admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:22.932152 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3597a6-d202-45bd-8dec-432aebd22fdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:22.933010 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3597a6-d202-45bd-8dec-432aebd22fdf service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:22.933328 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3597a6-d202-45bd-8dec-432aebd22fdf service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:22.933626 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3597a6-d202-45bd-8dec-432aebd22fdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:22.943428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3597a6-d202-45bd-8dec-432aebd22fdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:22.944894 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3597a6-d202-45bd-8dec-432aebd22fdf service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:22.953657 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1228/2435] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:43:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:43:22.977272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fff718-b12e-4b4c-9a6d-0b10b3468f48 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:23.041591 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fff718-b12e-4b4c-9a6d-0b10b3468f48 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:23.046130 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc4714-d323-401e-8f19-be7784ffd236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:23.047018 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc4714-d323-401e-8f19-be7784ffd236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:23.047299 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc4714-d323-401e-8f19-be7784ffd236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:23.047570 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc4714-d323-401e-8f19-be7784ffd236 admin admin] PATH_INFO: `/v3/users/2db46cb36cdb453ca18a0f974bfa3621` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:23.048784 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc4714-d323-401e-8f19-be7784ffd236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2db46cb36cdb453ca18a0f974bfa3621)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:23.050690 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc4714-d323-401e-8f19-be7784ffd236 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:23.096142 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d5dc4714-d323-401e-8f19-be7784ffd236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2db46cb36cdb453ca18a0f974bfa3621'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:23.103498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d5dc4714-d323-401e-8f19-be7784ffd236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2db46cb36cdb453ca18a0f974bfa3621'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:23.104206 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d5dc4714-d323-401e-8f19-be7784ffd236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2db46cb36cdb453ca18a0f974bfa3621'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:23.116329 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d5dc4714-d323-401e-8f19-be7784ffd236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2db46cb36cdb453ca18a0f974bfa3621'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:23.123027 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d5dc4714-d323-401e-8f19-be7784ffd236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2db46cb36cdb453ca18a0f974bfa3621'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:23.129064 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1208/2436] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:43:22 2022] DELETE /identity/v3/users/2db46cb36cdb453ca18a0f974bfa3621 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:43:23.134244 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd1c2b-25f2-4300-9a4f-2c4d2468572b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:23.134534 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd1c2b-25f2-4300-9a4f-2c4d2468572b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:23.134808 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd1c2b-25f2-4300-9a4f-2c4d2468572b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:23.151291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-22cd1c2b-25f2-4300-9a4f-2c4d2468572b None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:43:23.152508 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-22cd1c2b-25f2-4300-9a4f-2c4d2468572b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:23.210545 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1229/2437] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:43:23.219949 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc4714-d323-401e-8f19-be7784ffd236 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:23.221354 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d5dc4714-d323-401e-8f19-be7784ffd236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:23.266381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:43:23.279186 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc4714-d323-401e-8f19-be7784ffd236 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:23.282922 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba422c-bfce-41eb-8045-0e15913eb66b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:23.283569 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba422c-bfce-41eb-8045-0e15913eb66b service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:23.283858 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba422c-bfce-41eb-8045-0e15913eb66b service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:23.284137 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba422c-bfce-41eb-8045-0e15913eb66b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:23.293642 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba422c-bfce-41eb-8045-0e15913eb66b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:23.295078 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba422c-bfce-41eb-8045-0e15913eb66b service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:23.305174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1209/2438] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:43:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:43:23.565751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd1c2b-25f2-4300-9a4f-2c4d2468572b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:23.567304 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-22cd1c2b-25f2-4300-9a4f-2c4d2468572b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:23.579639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd1c2b-25f2-4300-9a4f-2c4d2468572b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:23.584920 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966d4e1-74e8-4aa9-9e0d-d4ca53978cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:23.585788 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966d4e1-74e8-4aa9-9e0d-d4ca53978cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:23.586080 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966d4e1-74e8-4aa9-9e0d-d4ca53978cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:23.586361 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966d4e1-74e8-4aa9-9e0d-d4ca53978cad admin admin] PATH_INFO: `/v3/projects/7ef4e4f7a0934a7985ac56522217c513` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:23.587560 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966d4e1-74e8-4aa9-9e0d-d4ca53978cad admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ef4e4f7a0934a7985ac56522217c513)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:23.589524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966d4e1-74e8-4aa9-9e0d-d4ca53978cad admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:23.643371 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:43:23.644701 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c966d4e1-74e8-4aa9-9e0d-d4ca53978cad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ef4e4f7a0934a7985ac56522217c513', 'request_id': 'req-c966d4e1-74e8-4aa9-9e0d-d4ca53978cad'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:23.652966 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c966d4e1-74e8-4aa9-9e0d-d4ca53978cad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ef4e4f7a0934a7985ac56522217c513', 'request_id': 'req-c966d4e1-74e8-4aa9-9e0d-d4ca53978cad'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:23.658722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c966d4e1-74e8-4aa9-9e0d-d4ca53978cad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ef4e4f7a0934a7985ac56522217c513', 'request_id': 'req-c966d4e1-74e8-4aa9-9e0d-d4ca53978cad'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:23.670173 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c966d4e1-74e8-4aa9-9e0d-d4ca53978cad admin admin] The token cache is being invalidate because project 7ef4e4f7a0934a7985ac56522217c513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:43:23.670459 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c966d4e1-74e8-4aa9-9e0d-d4ca53978cad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:23.671102 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c966d4e1-74e8-4aa9-9e0d-d4ca53978cad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:43:23.672660 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1230/2439] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:43:23 2022] DELETE /identity/v3/projects/7ef4e4f7a0934a7985ac56522217c513 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:43:23.677703 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0793990-902f-4f1a-b995-f0ccf5c7c0a2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:23.678190 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0793990-902f-4f1a-b995-f0ccf5c7c0a2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:23.678294 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0793990-902f-4f1a-b995-f0ccf5c7c0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:23.695563 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d0793990-902f-4f1a-b995-f0ccf5c7c0a2 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:43:23.696798 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d0793990-902f-4f1a-b995-f0ccf5c7c0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:23.755242 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1210/2440] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:43:23.762794 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfd45c-f892-404c-80b8-627318f5cbe4 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:23.763291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfd45c-f892-404c-80b8-627318f5cbe4 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:23.763395 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfd45c-f892-404c-80b8-627318f5cbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:23.781498 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-74bfd45c-f892-404c-80b8-627318f5cbe4 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:43:23.782683 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-74bfd45c-f892-404c-80b8-627318f5cbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:23.790954 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1231/2441] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:43:23.794835 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0793990-902f-4f1a-b995-f0ccf5c7c0a2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:23.804326 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0793990-902f-4f1a-b995-f0ccf5c7c0a2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:23.808909 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80424f-c6bd-458d-8e77-2e721739e42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:23.809551 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80424f-c6bd-458d-8e77-2e721739e42a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:23.809836 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80424f-c6bd-458d-8e77-2e721739e42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:23.810113 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80424f-c6bd-458d-8e77-2e721739e42a admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:23.810832 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80424f-c6bd-458d-8e77-2e721739e42a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:43:23.811141 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80424f-c6bd-458d-8e77-2e721739e42a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:23.812787 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80424f-c6bd-458d-8e77-2e721739e42a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:23.824121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1211/2442] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:43:23.828349 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfd45c-f892-404c-80b8-627318f5cbe4 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:23.837713 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfd45c-f892-404c-80b8-627318f5cbe4 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:23.842230 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63f996-d271-423d-84bb-6b5780e1a2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:23.842887 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63f996-d271-423d-84bb-6b5780e1a2f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:23.843168 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63f996-d271-423d-84bb-6b5780e1a2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:23.843442 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63f996-d271-423d-84bb-6b5780e1a2f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:23.844124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63f996-d271-423d-84bb-6b5780e1a2f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:23.846025 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63f996-d271-423d-84bb-6b5780e1a2f8 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:23.870677 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1232/2443] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:43:23 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:43:23.874714 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80424f-c6bd-458d-8e77-2e721739e42a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:23.884884 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80424f-c6bd-458d-8e77-2e721739e42a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:23.941304 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815f274-274e-43cf-b5b9-d4c0a9d1ed25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:23.941987 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815f274-274e-43cf-b5b9-d4c0a9d1ed25 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:23.942774 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815f274-274e-43cf-b5b9-d4c0a9d1ed25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:23.943054 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815f274-274e-43cf-b5b9-d4c0a9d1ed25 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:23.943746 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815f274-274e-43cf-b5b9-d4c0a9d1ed25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:23.945703 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815f274-274e-43cf-b5b9-d4c0a9d1ed25 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:23.965306 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1212/2444] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:43:23 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:43:23.969331 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63f996-d271-423d-84bb-6b5780e1a2f8 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:23.979276 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63f996-d271-423d-84bb-6b5780e1a2f8 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:23.983801 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8de79-b478-4996-9171-c6bec82ca536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:23.984484 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8de79-b478-4996-9171-c6bec82ca536 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:23.984766 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8de79-b478-4996-9171-c6bec82ca536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:23.985041 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8de79-b478-4996-9171-c6bec82ca536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:23.985760 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8de79-b478-4996-9171-c6bec82ca536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:23.987372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8de79-b478-4996-9171-c6bec82ca536 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:23.997814 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1233/2445] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:43:24.001506 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815f274-274e-43cf-b5b9-d4c0a9d1ed25 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:24.012516 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815f274-274e-43cf-b5b9-d4c0a9d1ed25 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:24.016750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b64013-b494-4840-a782-b68a3b674fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:24.017440 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b64013-b494-4840-a782-b68a3b674fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:24.017725 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b64013-b494-4840-a782-b68a3b674fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:24.018002 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b64013-b494-4840-a782-b68a3b674fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:24.018724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b64013-b494-4840-a782-b68a3b674fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:24.020343 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b64013-b494-4840-a782-b68a3b674fc1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:24.030918 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1213/2446] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:43:24.035252 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8de79-b478-4996-9171-c6bec82ca536 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:24.045215 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8de79-b478-4996-9171-c6bec82ca536 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:24.049776 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e2147-25b5-44b3-9b73-f98eae7f095a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:24.050638 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e2147-25b5-44b3-9b73-f98eae7f095a admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:24.050923 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e2147-25b5-44b3-9b73-f98eae7f095a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:24.051203 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e2147-25b5-44b3-9b73-f98eae7f095a admin admin] PATH_INFO: `/v3/projects/aa0c8692daa04252a385888208812cf4/users/4c181d9000214ce78c5acb11ac6f6f7e/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:24.065367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e2147-25b5-44b3-9b73-f98eae7f095a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa0c8692daa04252a385888208812cf4, user_id=4c181d9000214ce78c5acb11ac6f6f7e, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:24.068991 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e2147-25b5-44b3-9b73-f98eae7f095a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:24.082082 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1234/2447] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:43:24 2022] PUT /identity/v3/projects/aa0c8692daa04252a385888208812cf4/users/4c181d9000214ce78c5acb11ac6f6f7e/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:43:24.087766 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37247c07-2a91-4ebf-9b57-7834cea77d54 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:24.088055 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37247c07-2a91-4ebf-9b57-7834cea77d54 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:24.088360 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37247c07-2a91-4ebf-9b57-7834cea77d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:24.106708 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-37247c07-2a91-4ebf-9b57-7834cea77d54 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:43:24.107894 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-37247c07-2a91-4ebf-9b57-7834cea77d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:24.151897 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:43:24.166404 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1214/2448] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:43:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:43:24.177480 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e2147-25b5-44b3-9b73-f98eae7f095a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:24.179164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9f1e2147-25b5-44b3-9b73-f98eae7f095a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:24.235286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e2147-25b5-44b3-9b73-f98eae7f095a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:24.238921 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbac81-c9ca-4dd9-8228-8fb50992bf3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:24.239548 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbac81-c9ca-4dd9-8228-8fb50992bf3e service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:24.239828 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbac81-c9ca-4dd9-8228-8fb50992bf3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:24.240101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbac81-c9ca-4dd9-8228-8fb50992bf3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:24.248914 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbac81-c9ca-4dd9-8228-8fb50992bf3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:24.250332 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbac81-c9ca-4dd9-8228-8fb50992bf3e service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:24.259963 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1235/2449] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:43:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:43:24.865947 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e2647-8fef-4c1b-9776-c567e35a7bac None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:24.866427 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e2647-8fef-4c1b-9776-c567e35a7bac None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:24.866540 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e2647-8fef-4c1b-9776-c567e35a7bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:24.893488 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0e9e2647-8fef-4c1b-9776-c567e35a7bac None None] MFA Rules not processed for user `4c181d9000214ce78c5acb11ac6f6f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:43:24.894689 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0e9e2647-8fef-4c1b-9776-c567e35a7bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:24.965345 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1215/2450] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:43:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:43:24.976668 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbac81-c9ca-4dd9-8228-8fb50992bf3e service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:43:24.978065 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-21fbac81-c9ca-4dd9-8228-8fb50992bf3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:25.042710 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbac81-c9ca-4dd9-8228-8fb50992bf3e service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:43:25.046355 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b0a2e-d462-4e4f-8237-403acb22ed1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:43:25.046936 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b0a2e-d462-4e4f-8237-403acb22ed1c service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:25.047223 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b0a2e-d462-4e4f-8237-403acb22ed1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:25.047500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b0a2e-d462-4e4f-8237-403acb22ed1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:25.055641 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b0a2e-d462-4e4f-8237-403acb22ed1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:43:25.057091 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b0a2e-d462-4e4f-8237-403acb22ed1c service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:43:25.065765 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1236/2451] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:43:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:43:26.397935 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a9442-b643-4ea4-946f-79d9058947aa None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:43:26.398440 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a9442-b643-4ea4-946f-79d9058947aa None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:43:26.398561 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a9442-b643-4ea4-946f-79d9058947aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:43:26.415949 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5a6a9442-b643-4ea4-946f-79d9058947aa None None] MFA Rules not processed for user `4c181d9000214ce78c5acb11ac6f6f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:43:26.417191 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5a6a9442-b643-4ea4-946f-79d9058947aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:43:26.423880 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1216/2452] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:43:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:43:35.061830 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:43:36.410496 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=39 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:04.099136 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b0a2e-d462-4e4f-8237-403acb22ed1c service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:04.100619 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b49b0a2e-d462-4e4f-8237-403acb22ed1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:04.112902 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b0a2e-d462-4e4f-8237-403acb22ed1c service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:04.116533 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714d657-edf8-4ef5-81b9-b925b1a16c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:04.117161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714d657-edf8-4ef5-81b9-b925b1a16c6c service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:04.117456 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714d657-edf8-4ef5-81b9-b925b1a16c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:04.117736 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714d657-edf8-4ef5-81b9-b925b1a16c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:04.119603 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0714d657-edf8-4ef5-81b9-b925b1a16c6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:04.131664 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714d657-edf8-4ef5-81b9-b925b1a16c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:04.133112 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714d657-edf8-4ef5-81b9-b925b1a16c6c service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:04.142659 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1237/2453] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:08.208143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a9442-b643-4ea4-946f-79d9058947aa None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:08.209714 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5a6a9442-b643-4ea4-946f-79d9058947aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:08.231168 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a9442-b643-4ea4-946f-79d9058947aa None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:08.235706 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ab12f-d53b-44fb-89e3-b1d5bb023783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:08.236677 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ab12f-d53b-44fb-89e3-b1d5bb023783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:08.237207 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ab12f-d53b-44fb-89e3-b1d5bb023783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:08.237501 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ab12f-d53b-44fb-89e3-b1d5bb023783 admin admin] PATH_INFO: `/v3/users/a1622acb057f419ca98e7d44584c276d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:08.238761 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ab12f-d53b-44fb-89e3-b1d5bb023783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1622acb057f419ca98e7d44584c276d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:08.240877 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ab12f-d53b-44fb-89e3-b1d5bb023783 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:08.292073 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5b2ab12f-d53b-44fb-89e3-b1d5bb023783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1622acb057f419ca98e7d44584c276d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:08.298893 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5b2ab12f-d53b-44fb-89e3-b1d5bb023783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1622acb057f419ca98e7d44584c276d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:08.299554 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5b2ab12f-d53b-44fb-89e3-b1d5bb023783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1622acb057f419ca98e7d44584c276d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:08.312221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5b2ab12f-d53b-44fb-89e3-b1d5bb023783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1622acb057f419ca98e7d44584c276d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:08.319469 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5b2ab12f-d53b-44fb-89e3-b1d5bb023783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1622acb057f419ca98e7d44584c276d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:08.326007 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1217/2454] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:44:08 2022] DELETE /identity/v3/users/a1622acb057f419ca98e7d44584c276d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:08.498092 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714d657-edf8-4ef5-81b9-b925b1a16c6c service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:08.509834 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714d657-edf8-4ef5-81b9-b925b1a16c6c service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:08.566979 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded3580-980d-4722-8ffa-c731cf8d833e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:08.567798 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded3580-980d-4722-8ffa-c731cf8d833e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:08.568088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded3580-980d-4722-8ffa-c731cf8d833e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:08.568403 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded3580-980d-4722-8ffa-c731cf8d833e admin admin] PATH_INFO: `/v3/projects/e2a60aa73c3943e18fea2b2f38fadffe` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:08.569591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded3580-980d-4722-8ffa-c731cf8d833e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2a60aa73c3943e18fea2b2f38fadffe)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:08.571503 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded3580-980d-4722-8ffa-c731cf8d833e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:08.616727 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-eded3580-980d-4722-8ffa-c731cf8d833e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2a60aa73c3943e18fea2b2f38fadffe', 'request_id': 'req-eded3580-980d-4722-8ffa-c731cf8d833e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:08.624642 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-eded3580-980d-4722-8ffa-c731cf8d833e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2a60aa73c3943e18fea2b2f38fadffe', 'request_id': 'req-eded3580-980d-4722-8ffa-c731cf8d833e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:08.630092 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-eded3580-980d-4722-8ffa-c731cf8d833e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2a60aa73c3943e18fea2b2f38fadffe', 'request_id': 'req-eded3580-980d-4722-8ffa-c731cf8d833e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:08.640782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-eded3580-980d-4722-8ffa-c731cf8d833e admin admin] The token cache is being invalidate because project e2a60aa73c3943e18fea2b2f38fadffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:44:08.641071 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-eded3580-980d-4722-8ffa-c731cf8d833e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:08.641701 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-eded3580-980d-4722-8ffa-c731cf8d833e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:08.643216 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1238/2455] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:44:08 2022] DELETE /identity/v3/projects/e2a60aa73c3943e18fea2b2f38fadffe => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:08.648332 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09ca4d-6dd2-4dee-87a5-699edac9197d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:08.648690 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09ca4d-6dd2-4dee-87a5-699edac9197d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:08.648973 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09ca4d-6dd2-4dee-87a5-699edac9197d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:08.666420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-bd09ca4d-6dd2-4dee-87a5-699edac9197d None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:08.668248 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bd09ca4d-6dd2-4dee-87a5-699edac9197d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:08.728623 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1218/2456] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:08.737026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316ddf6-e1f4-4743-a7ab-67284fc4dc6f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:08.737464 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316ddf6-e1f4-4743-a7ab-67284fc4dc6f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:08.737754 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316ddf6-e1f4-4743-a7ab-67284fc4dc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:08.756782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d316ddf6-e1f4-4743-a7ab-67284fc4dc6f None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:08.758004 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d316ddf6-e1f4-4743-a7ab-67284fc4dc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:08.765961 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1239/2457] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:08.770227 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09ca4d-6dd2-4dee-87a5-699edac9197d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:08.780360 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09ca4d-6dd2-4dee-87a5-699edac9197d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:08.784997 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced05cd6-6050-4f03-9d26-c1a54a3bc9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:08.785711 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced05cd6-6050-4f03-9d26-c1a54a3bc9ad admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:08.786003 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced05cd6-6050-4f03-9d26-c1a54a3bc9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:08.786284 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced05cd6-6050-4f03-9d26-c1a54a3bc9ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:08.787012 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced05cd6-6050-4f03-9d26-c1a54a3bc9ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:44:08.787322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced05cd6-6050-4f03-9d26-c1a54a3bc9ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:08.788970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced05cd6-6050-4f03-9d26-c1a54a3bc9ad admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:08.801167 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1219/2458] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:44:08.805364 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316ddf6-e1f4-4743-a7ab-67284fc4dc6f None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:08.814783 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316ddf6-e1f4-4743-a7ab-67284fc4dc6f None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:08.819932 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a7b2c-3c86-4af4-ab7a-32cd1c642607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:08.820672 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a7b2c-3c86-4af4-ab7a-32cd1c642607 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:08.820958 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a7b2c-3c86-4af4-ab7a-32cd1c642607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:08.821241 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a7b2c-3c86-4af4-ab7a-32cd1c642607 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:08.821950 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a7b2c-3c86-4af4-ab7a-32cd1c642607 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:08.823872 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a7b2c-3c86-4af4-ab7a-32cd1c642607 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:08.853722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1240/2459] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:44:08 2022] POST /identity/v3/projects => generated 361 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:08.856183 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced05cd6-6050-4f03-9d26-c1a54a3bc9ad admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:08.866505 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced05cd6-6050-4f03-9d26-c1a54a3bc9ad admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:08.943489 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16caf1-f644-4c65-9b23-60accf146414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:08.944203 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16caf1-f644-4c65-9b23-60accf146414 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:08.944552 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16caf1-f644-4c65-9b23-60accf146414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:08.944847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16caf1-f644-4c65-9b23-60accf146414 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:08.946921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16caf1-f644-4c65-9b23-60accf146414 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:08.948968 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16caf1-f644-4c65-9b23-60accf146414 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:08.956108 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:08.973971 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1220/2460] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:44:08 2022] POST /identity/v3/users => generated 281 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:44:08.978764 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a7b2c-3c86-4af4-ab7a-32cd1c642607 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:08.990374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a7b2c-3c86-4af4-ab7a-32cd1c642607 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:08.995462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1883c-0072-45d5-8c25-3773572a4098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:08.996128 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1883c-0072-45d5-8c25-3773572a4098 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:08.996451 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1883c-0072-45d5-8c25-3773572a4098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:08.996734 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1883c-0072-45d5-8c25-3773572a4098 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:08.998095 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1883c-0072-45d5-8c25-3773572a4098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:08.999771 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1883c-0072-45d5-8c25-3773572a4098 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:09.016103 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1241/2461] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:09.020180 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16caf1-f644-4c65-9b23-60accf146414 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:09.030646 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16caf1-f644-4c65-9b23-60accf146414 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:09.035344 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bc958-6756-48c5-90df-8d9d790c5791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:09.036011 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bc958-6756-48c5-90df-8d9d790c5791 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:09.036315 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bc958-6756-48c5-90df-8d9d790c5791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:09.036645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bc958-6756-48c5-90df-8d9d790c5791 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:09.037336 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7bc958-6756-48c5-90df-8d9d790c5791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:09.038940 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7bc958-6756-48c5-90df-8d9d790c5791 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:09.053628 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1221/2462] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:44:09.054917 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1883c-0072-45d5-8c25-3773572a4098 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:09.066490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1883c-0072-45d5-8c25-3773572a4098 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:09.071359 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32be32-2548-4238-9492-3878bfefe3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:09.072114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32be32-2548-4238-9492-3878bfefe3e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:09.072441 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32be32-2548-4238-9492-3878bfefe3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:09.072802 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32be32-2548-4238-9492-3878bfefe3e3 admin admin] PATH_INFO: `/v3/projects/31e49e5530fe4c7d83fe850a2c6913b6/users/74d3fb6170004e0b96b025a4ba109bde/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:09.090849 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32be32-2548-4238-9492-3878bfefe3e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e49e5530fe4c7d83fe850a2c6913b6, user_id=74d3fb6170004e0b96b025a4ba109bde, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:09.093682 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32be32-2548-4238-9492-3878bfefe3e3 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:09.108014 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1242/2463] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:09 2022] PUT /identity/v3/projects/31e49e5530fe4c7d83fe850a2c6913b6/users/74d3fb6170004e0b96b025a4ba109bde/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:09.118835 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569bef0-96b6-4c51-b037-66bd64518745 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:09.119131 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569bef0-96b6-4c51-b037-66bd64518745 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:09.119416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569bef0-96b6-4c51-b037-66bd64518745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:09.145385 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b569bef0-96b6-4c51-b037-66bd64518745 None None] MFA Rules not processed for user `74d3fb6170004e0b96b025a4ba109bde`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:09.146599 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b569bef0-96b6-4c51-b037-66bd64518745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:09.217672 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1222/2464] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:09.221844 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32be32-2548-4238-9492-3878bfefe3e3 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:09.239964 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:09.300642 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32be32-2548-4238-9492-3878bfefe3e3 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:09.305535 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76564fd4-4aae-45c1-935b-1e9e61e267e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:09.306563 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76564fd4-4aae-45c1-935b-1e9e61e267e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:09.306563 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76564fd4-4aae-45c1-935b-1e9e61e267e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:09.306838 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76564fd4-4aae-45c1-935b-1e9e61e267e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:09.307586 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76564fd4-4aae-45c1-935b-1e9e61e267e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:09.310807 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76564fd4-4aae-45c1-935b-1e9e61e267e4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:09.341836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1243/2465] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:44:09 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:09.345935 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569bef0-96b6-4c51-b037-66bd64518745 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:09.358327 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569bef0-96b6-4c51-b037-66bd64518745 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:09.422130 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9bdd0-2135-4aee-bd68-74d878c27aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:09.422898 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9bdd0-2135-4aee-bd68-74d878c27aaa admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:09.423325 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9bdd0-2135-4aee-bd68-74d878c27aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:09.423738 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9bdd0-2135-4aee-bd68-74d878c27aaa admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:09.424620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9bdd0-2135-4aee-bd68-74d878c27aaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:09.429895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9bdd0-2135-4aee-bd68-74d878c27aaa admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:09.453752 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1223/2466] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:44:09 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:09.457777 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76564fd4-4aae-45c1-935b-1e9e61e267e4 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:09.469439 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76564fd4-4aae-45c1-935b-1e9e61e267e4 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:09.474440 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963783e-2812-4051-b2bc-deef42342072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:09.475174 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963783e-2812-4051-b2bc-deef42342072 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:09.475532 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963783e-2812-4051-b2bc-deef42342072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:09.475882 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963783e-2812-4051-b2bc-deef42342072 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:09.476744 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4963783e-2812-4051-b2bc-deef42342072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:09.478416 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4963783e-2812-4051-b2bc-deef42342072 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:09.492333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1244/2467] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:44:09.493858 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9bdd0-2135-4aee-bd68-74d878c27aaa admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:09.504218 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9bdd0-2135-4aee-bd68-74d878c27aaa admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:09.508935 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3619d-1b44-422e-ad46-3a8fd25a0e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:09.509807 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3619d-1b44-422e-ad46-3a8fd25a0e65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:09.510089 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3619d-1b44-422e-ad46-3a8fd25a0e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:09.510364 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3619d-1b44-422e-ad46-3a8fd25a0e65 admin admin] PATH_INFO: `/v3/projects/ea234c7783794ef0bd5510865ba82572/users/a2fc198c61a64c85a53a52644d68873f/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:09.527214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3619d-1b44-422e-ad46-3a8fd25a0e65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea234c7783794ef0bd5510865ba82572, user_id=a2fc198c61a64c85a53a52644d68873f, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:09.530048 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3619d-1b44-422e-ad46-3a8fd25a0e65 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:09.544265 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1224/2468] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:09 2022] PUT /identity/v3/projects/ea234c7783794ef0bd5510865ba82572/users/a2fc198c61a64c85a53a52644d68873f/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:09.548212 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963783e-2812-4051-b2bc-deef42342072 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:09.559646 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963783e-2812-4051-b2bc-deef42342072 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:09.618951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014332d0-8e45-46c9-9b75-feb916b35521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:09.619670 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014332d0-8e45-46c9-9b75-feb916b35521 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:09.620557 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014332d0-8e45-46c9-9b75-feb916b35521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:09.620903 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014332d0-8e45-46c9-9b75-feb916b35521 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:09.621717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014332d0-8e45-46c9-9b75-feb916b35521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:09.623514 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014332d0-8e45-46c9-9b75-feb916b35521 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:09.634043 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1245/2469] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:09.638494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3619d-1b44-422e-ad46-3a8fd25a0e65 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:09.648662 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3619d-1b44-422e-ad46-3a8fd25a0e65 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:09.653484 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe152ea-dbe3-4afe-aa4e-24f0448c1027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:09.654362 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe152ea-dbe3-4afe-aa4e-24f0448c1027 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:09.654645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe152ea-dbe3-4afe-aa4e-24f0448c1027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:09.654921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe152ea-dbe3-4afe-aa4e-24f0448c1027 admin admin] PATH_INFO: `/v3/projects/ea234c7783794ef0bd5510865ba82572/users/a2fc198c61a64c85a53a52644d68873f/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:09.656916 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe152ea-dbe3-4afe-aa4e-24f0448c1027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea234c7783794ef0bd5510865ba82572, user_id=a2fc198c61a64c85a53a52644d68873f, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:09.659557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe152ea-dbe3-4afe-aa4e-24f0448c1027 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:09.670120 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1225/2470] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:09 2022] PUT /identity/v3/projects/ea234c7783794ef0bd5510865ba82572/users/a2fc198c61a64c85a53a52644d68873f/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:09.679777 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacc7fb-2a56-4e52-a96f-8692e2036f85 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:09.680223 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacc7fb-2a56-4e52-a96f-8692e2036f85 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:09.680648 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacc7fb-2a56-4e52-a96f-8692e2036f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:09.709456 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ebacc7fb-2a56-4e52-a96f-8692e2036f85 None None] MFA Rules not processed for user `a2fc198c61a64c85a53a52644d68873f`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:09.710990 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ebacc7fb-2a56-4e52-a96f-8692e2036f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:09.779573 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1246/2471] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:09 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:44:09.790964 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe152ea-dbe3-4afe-aa4e-24f0448c1027 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:09.792796 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2fe152ea-dbe3-4afe-aa4e-24f0448c1027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:09.816911 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:09.859135 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe152ea-dbe3-4afe-aa4e-24f0448c1027 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:09.862509 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bead5d-7afe-4d0e-898b-dc4269833926 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:09.863156 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bead5d-7afe-4d0e-898b-dc4269833926 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:09.863442 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bead5d-7afe-4d0e-898b-dc4269833926 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:09.863723 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bead5d-7afe-4d0e-898b-dc4269833926 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:09.873609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bead5d-7afe-4d0e-898b-dc4269833926 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:09.874989 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bead5d-7afe-4d0e-898b-dc4269833926 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:09.887181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1226/2472] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:09 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:10.018687 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacc7fb-2a56-4e52-a96f-8692e2036f85 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:10.020273 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ebacc7fb-2a56-4e52-a96f-8692e2036f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:10.032247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacc7fb-2a56-4e52-a96f-8692e2036f85 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:10.035943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b5143-6956-4bf9-9d8c-01123c0ae5ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:10.036608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b5143-6956-4bf9-9d8c-01123c0ae5ab service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:10.036962 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b5143-6956-4bf9-9d8c-01123c0ae5ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:10.037242 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b5143-6956-4bf9-9d8c-01123c0ae5ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:10.043217 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:10.099811 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b5143-6956-4bf9-9d8c-01123c0ae5ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:10.101395 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b5143-6956-4bf9-9d8c-01123c0ae5ab service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:10.113267 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1247/2473] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:13.898850 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bead5d-7afe-4d0e-898b-dc4269833926 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:13.963948 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bead5d-7afe-4d0e-898b-dc4269833926 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:13.969107 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9581a-149c-4f37-90d4-2c668f90add5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:13.969999 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9581a-149c-4f37-90d4-2c668f90add5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:13.970300 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9581a-149c-4f37-90d4-2c668f90add5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:13.970575 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9581a-149c-4f37-90d4-2c668f90add5 admin admin] PATH_INFO: `/v3/users/74d3fb6170004e0b96b025a4ba109bde` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:13.971780 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9581a-149c-4f37-90d4-2c668f90add5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74d3fb6170004e0b96b025a4ba109bde)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:13.973758 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9581a-149c-4f37-90d4-2c668f90add5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:14.036611 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3fc9581a-149c-4f37-90d4-2c668f90add5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74d3fb6170004e0b96b025a4ba109bde'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:14.044891 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3fc9581a-149c-4f37-90d4-2c668f90add5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74d3fb6170004e0b96b025a4ba109bde'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:14.045652 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3fc9581a-149c-4f37-90d4-2c668f90add5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74d3fb6170004e0b96b025a4ba109bde'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:14.058727 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3fc9581a-149c-4f37-90d4-2c668f90add5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74d3fb6170004e0b96b025a4ba109bde'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:14.066236 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3fc9581a-149c-4f37-90d4-2c668f90add5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74d3fb6170004e0b96b025a4ba109bde'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:14.072355 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1227/2474] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:44:13 2022] DELETE /identity/v3/users/74d3fb6170004e0b96b025a4ba109bde => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:14.077972 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e2daf-463b-400b-9b7d-104e7756b3b3 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:14.078486 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e2daf-463b-400b-9b7d-104e7756b3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:14.078825 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e2daf-463b-400b-9b7d-104e7756b3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:14.097138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-094e2daf-463b-400b-9b7d-104e7756b3b3 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:14.098434 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-094e2daf-463b-400b-9b7d-104e7756b3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:14.159274 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1248/2475] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:14.168851 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9581a-149c-4f37-90d4-2c668f90add5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:14.170378 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3fc9581a-149c-4f37-90d4-2c668f90add5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:14.218762 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:14.235197 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9581a-149c-4f37-90d4-2c668f90add5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:14.239283 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645fc5b-b0dc-49cb-bd65-9c5382cb5552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:14.239930 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645fc5b-b0dc-49cb-bd65-9c5382cb5552 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:14.240219 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645fc5b-b0dc-49cb-bd65-9c5382cb5552 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:14.240531 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645fc5b-b0dc-49cb-bd65-9c5382cb5552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:14.250372 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645fc5b-b0dc-49cb-bd65-9c5382cb5552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:14.251826 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645fc5b-b0dc-49cb-bd65-9c5382cb5552 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:14.262744 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1228/2476] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:14.418022 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e2daf-463b-400b-9b7d-104e7756b3b3 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:14.428941 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e2daf-463b-400b-9b7d-104e7756b3b3 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:14.434415 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadb71c-048c-42a6-a41e-978c779b62a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:14.435311 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadb71c-048c-42a6-a41e-978c779b62a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:14.435780 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadb71c-048c-42a6-a41e-978c779b62a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:14.438094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadb71c-048c-42a6-a41e-978c779b62a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:14.438094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bdadb71c-048c-42a6-a41e-978c779b62a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:14.453823 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadb71c-048c-42a6-a41e-978c779b62a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:14.455212 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadb71c-048c-42a6-a41e-978c779b62a4 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:14.465886 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1249/2477] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:44:14.699701 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645fc5b-b0dc-49cb-bd65-9c5382cb5552 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:14.701681 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c645fc5b-b0dc-49cb-bd65-9c5382cb5552 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:14.721493 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645fc5b-b0dc-49cb-bd65-9c5382cb5552 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:14.727854 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c044034-d872-4851-9767-8c305d6504bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:14.730601 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c044034-d872-4851-9767-8c305d6504bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:14.731183 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c044034-d872-4851-9767-8c305d6504bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:14.731543 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c044034-d872-4851-9767-8c305d6504bd admin admin] PATH_INFO: `/v3/projects/31e49e5530fe4c7d83fe850a2c6913b6` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:14.732967 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c044034-d872-4851-9767-8c305d6504bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=31e49e5530fe4c7d83fe850a2c6913b6)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:14.734975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c044034-d872-4851-9767-8c305d6504bd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:14.799424 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5c044034-d872-4851-9767-8c305d6504bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31e49e5530fe4c7d83fe850a2c6913b6', 'request_id': 'req-5c044034-d872-4851-9767-8c305d6504bd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:14.805294 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5c044034-d872-4851-9767-8c305d6504bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31e49e5530fe4c7d83fe850a2c6913b6', 'request_id': 'req-5c044034-d872-4851-9767-8c305d6504bd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:14.813611 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5c044034-d872-4851-9767-8c305d6504bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31e49e5530fe4c7d83fe850a2c6913b6', 'request_id': 'req-5c044034-d872-4851-9767-8c305d6504bd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:14.831807 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5c044034-d872-4851-9767-8c305d6504bd admin admin] The token cache is being invalidate because project 31e49e5530fe4c7d83fe850a2c6913b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:44:14.832140 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5c044034-d872-4851-9767-8c305d6504bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:14.832934 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5c044034-d872-4851-9767-8c305d6504bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:14.835013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1229/2478] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:44:14 2022] DELETE /identity/v3/projects/31e49e5530fe4c7d83fe850a2c6913b6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:14.839792 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadb71c-048c-42a6-a41e-978c779b62a4 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:14.849788 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadb71c-048c-42a6-a41e-978c779b62a4 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:14.919230 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcc548-1342-4266-a4d0-410ad8ceac82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:14.920049 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcc548-1342-4266-a4d0-410ad8ceac82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:14.920363 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcc548-1342-4266-a4d0-410ad8ceac82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:14.920674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcc548-1342-4266-a4d0-410ad8ceac82 admin admin] PATH_INFO: `/v3/users/a2fc198c61a64c85a53a52644d68873f` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:14.921919 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcc548-1342-4266-a4d0-410ad8ceac82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2fc198c61a64c85a53a52644d68873f)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:14.923961 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcc548-1342-4266-a4d0-410ad8ceac82 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:14.981308 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:14.993279 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-87bcc548-1342-4266-a4d0-410ad8ceac82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2fc198c61a64c85a53a52644d68873f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:15.010700 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-87bcc548-1342-4266-a4d0-410ad8ceac82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2fc198c61a64c85a53a52644d68873f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:15.012024 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-87bcc548-1342-4266-a4d0-410ad8ceac82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2fc198c61a64c85a53a52644d68873f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:15.035698 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-87bcc548-1342-4266-a4d0-410ad8ceac82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2fc198c61a64c85a53a52644d68873f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:15.046018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-87bcc548-1342-4266-a4d0-410ad8ceac82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2fc198c61a64c85a53a52644d68873f'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:15.054856 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1250/2479] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:44:14 2022] DELETE /identity/v3/users/a2fc198c61a64c85a53a52644d68873f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:15.904479 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c044034-d872-4851-9767-8c305d6504bd admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:15.906053 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5c044034-d872-4851-9767-8c305d6504bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:15.921130 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c044034-d872-4851-9767-8c305d6504bd admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:16.001517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c43e0-e616-4c7c-9c81-1cc167cc3b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:16.002427 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c43e0-e616-4c7c-9c81-1cc167cc3b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:16.002707 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c43e0-e616-4c7c-9c81-1cc167cc3b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:16.002987 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c43e0-e616-4c7c-9c81-1cc167cc3b11 admin admin] PATH_INFO: `/v3/projects/ea234c7783794ef0bd5510865ba82572` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:16.009363 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c43e0-e616-4c7c-9c81-1cc167cc3b11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea234c7783794ef0bd5510865ba82572)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:16.009363 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c43e0-e616-4c7c-9c81-1cc167cc3b11 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:16.071859 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b82c43e0-e616-4c7c-9c81-1cc167cc3b11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea234c7783794ef0bd5510865ba82572', 'request_id': 'req-b82c43e0-e616-4c7c-9c81-1cc167cc3b11'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:16.078733 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b82c43e0-e616-4c7c-9c81-1cc167cc3b11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea234c7783794ef0bd5510865ba82572', 'request_id': 'req-b82c43e0-e616-4c7c-9c81-1cc167cc3b11'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:16.087776 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b82c43e0-e616-4c7c-9c81-1cc167cc3b11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea234c7783794ef0bd5510865ba82572', 'request_id': 'req-b82c43e0-e616-4c7c-9c81-1cc167cc3b11'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:16.100622 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:16.107285 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b82c43e0-e616-4c7c-9c81-1cc167cc3b11 admin admin] The token cache is being invalidate because project ea234c7783794ef0bd5510865ba82572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:44:16.107645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b82c43e0-e616-4c7c-9c81-1cc167cc3b11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:16.109027 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b82c43e0-e616-4c7c-9c81-1cc167cc3b11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:16.112463 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1230/2480] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:44:15 2022] DELETE /identity/v3/projects/ea234c7783794ef0bd5510865ba82572 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:16.120681 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28afce4a-9aa4-466e-98de-73aa0f96cab0 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:16.121198 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28afce4a-9aa4-466e-98de-73aa0f96cab0 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:16.121501 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28afce4a-9aa4-466e-98de-73aa0f96cab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:16.143011 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-28afce4a-9aa4-466e-98de-73aa0f96cab0 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:16.144187 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-28afce4a-9aa4-466e-98de-73aa0f96cab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:16.240151 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1251/2481] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:16.241965 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd3c8c-542e-4df5-abff-cea42b9d6da8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:16.242256 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd3c8c-542e-4df5-abff-cea42b9d6da8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:16.242534 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd3c8c-542e-4df5-abff-cea42b9d6da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:16.264530 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-70bd3c8c-542e-4df5-abff-cea42b9d6da8 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:16.265924 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-70bd3c8c-542e-4df5-abff-cea42b9d6da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:16.274314 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1231/2482] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:16.278807 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28afce4a-9aa4-466e-98de-73aa0f96cab0 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:16.290645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28afce4a-9aa4-466e-98de-73aa0f96cab0 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:16.295587 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0c625-b23d-4e9c-be9e-95bfb75b950d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:16.296373 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0c625-b23d-4e9c-be9e-95bfb75b950d admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:16.296731 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0c625-b23d-4e9c-be9e-95bfb75b950d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:16.297080 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0c625-b23d-4e9c-be9e-95bfb75b950d admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:16.297889 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0c625-b23d-4e9c-be9e-95bfb75b950d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:44:16.298297 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0c625-b23d-4e9c-be9e-95bfb75b950d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:16.300052 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0c625-b23d-4e9c-be9e-95bfb75b950d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:16.313517 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1252/2483] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:44:16.318015 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd3c8c-542e-4df5-abff-cea42b9d6da8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:16.329154 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd3c8c-542e-4df5-abff-cea42b9d6da8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:16.335224 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d927b45-6689-46f1-813f-b7637e935241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:16.336505 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d927b45-6689-46f1-813f-b7637e935241 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:16.336987 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d927b45-6689-46f1-813f-b7637e935241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:16.337269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d927b45-6689-46f1-813f-b7637e935241 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:16.337975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d927b45-6689-46f1-813f-b7637e935241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:16.339958 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d927b45-6689-46f1-813f-b7637e935241 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:16.369990 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1232/2484] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:44:16 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:16.374730 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0c625-b23d-4e9c-be9e-95bfb75b950d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:16.385943 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0c625-b23d-4e9c-be9e-95bfb75b950d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:16.446971 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9634289-3a58-4278-bb7c-080908a5ff0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:16.447647 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9634289-3a58-4278-bb7c-080908a5ff0c admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:16.447960 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9634289-3a58-4278-bb7c-080908a5ff0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:16.448244 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9634289-3a58-4278-bb7c-080908a5ff0c admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:16.449672 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9634289-3a58-4278-bb7c-080908a5ff0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:16.451546 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9634289-3a58-4278-bb7c-080908a5ff0c admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:16.474314 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1253/2485] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:44:16 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:44:16.475519 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d927b45-6689-46f1-813f-b7637e935241 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:16.485719 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d927b45-6689-46f1-813f-b7637e935241 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:16.490412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b02a9-a512-44b2-aadc-4ed5dac1429b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:16.491066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b02a9-a512-44b2-aadc-4ed5dac1429b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:16.491371 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b02a9-a512-44b2-aadc-4ed5dac1429b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:16.491648 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b02a9-a512-44b2-aadc-4ed5dac1429b admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:16.492409 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b02a9-a512-44b2-aadc-4ed5dac1429b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:16.494011 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b02a9-a512-44b2-aadc-4ed5dac1429b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:16.509246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1233/2486] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:16.512694 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9634289-3a58-4278-bb7c-080908a5ff0c admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:16.523244 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9634289-3a58-4278-bb7c-080908a5ff0c admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:16.528130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470c75c-a049-46bb-8b7e-5ac1bbc18d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:16.528947 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470c75c-a049-46bb-8b7e-5ac1bbc18d2b admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:16.529236 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470c75c-a049-46bb-8b7e-5ac1bbc18d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:16.529573 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470c75c-a049-46bb-8b7e-5ac1bbc18d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:16.530370 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470c75c-a049-46bb-8b7e-5ac1bbc18d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:16.532017 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470c75c-a049-46bb-8b7e-5ac1bbc18d2b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:16.545780 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1254/2487] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:16.546961 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b02a9-a512-44b2-aadc-4ed5dac1429b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:16.557446 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b02a9-a512-44b2-aadc-4ed5dac1429b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:16.562879 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd845800-608d-491a-bbc7-7c848c7cb81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:16.564066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd845800-608d-491a-bbc7-7c848c7cb81f admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:16.564216 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd845800-608d-491a-bbc7-7c848c7cb81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:16.564547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd845800-608d-491a-bbc7-7c848c7cb81f admin admin] PATH_INFO: `/v3/projects/e41d267b02b64164939ca255a531a669/users/d5743d776c2a472083bc5b39f40e581c/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:16.581578 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd845800-608d-491a-bbc7-7c848c7cb81f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e41d267b02b64164939ca255a531a669, user_id=d5743d776c2a472083bc5b39f40e581c, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:16.584378 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd845800-608d-491a-bbc7-7c848c7cb81f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:16.600879 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1234/2488] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:16 2022] PUT /identity/v3/projects/e41d267b02b64164939ca255a531a669/users/d5743d776c2a472083bc5b39f40e581c/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:16.611598 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa88b1-e8d3-4b2e-901a-9e563289b9c3 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:16.611898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa88b1-e8d3-4b2e-901a-9e563289b9c3 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:16.612182 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa88b1-e8d3-4b2e-901a-9e563289b9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:16.647253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-7dfa88b1-e8d3-4b2e-901a-9e563289b9c3 None None] MFA Rules not processed for user `d5743d776c2a472083bc5b39f40e581c`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:16.648593 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7dfa88b1-e8d3-4b2e-901a-9e563289b9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:16.657770 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:16.766526 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1255/2489] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:16.770907 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd845800-608d-491a-bbc7-7c848c7cb81f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:16.846124 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd845800-608d-491a-bbc7-7c848c7cb81f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:16.851350 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673699d9-3ebb-42fe-9f7e-3a5004981ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:16.852014 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673699d9-3ebb-42fe-9f7e-3a5004981ece admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:16.852388 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673699d9-3ebb-42fe-9f7e-3a5004981ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:16.852644 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673699d9-3ebb-42fe-9f7e-3a5004981ece admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:16.853348 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673699d9-3ebb-42fe-9f7e-3a5004981ece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:16.855922 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673699d9-3ebb-42fe-9f7e-3a5004981ece admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:16.892772 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1235/2490] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:44:16 2022] POST /identity/v3/projects => generated 393 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:16.896857 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa88b1-e8d3-4b2e-901a-9e563289b9c3 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:16.907704 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa88b1-e8d3-4b2e-901a-9e563289b9c3 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:16.970204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e6b5a-5e71-4a03-8817-e447a541b954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:16.970890 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e6b5a-5e71-4a03-8817-e447a541b954 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:16.971171 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e6b5a-5e71-4a03-8817-e447a541b954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:16.971446 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e6b5a-5e71-4a03-8817-e447a541b954 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:16.972339 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e6b5a-5e71-4a03-8817-e447a541b954 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:16.974310 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e6b5a-5e71-4a03-8817-e447a541b954 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:16.998432 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1256/2491] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:44:16 2022] POST /identity/v3/users => generated 303 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:44:17.002499 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673699d9-3ebb-42fe-9f7e-3a5004981ece admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:17.028633 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673699d9-3ebb-42fe-9f7e-3a5004981ece admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:17.033984 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e4970-1c9a-4f1c-b6e2-5a764779f17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:17.034664 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e4970-1c9a-4f1c-b6e2-5a764779f17f admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:17.034957 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e4970-1c9a-4f1c-b6e2-5a764779f17f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:17.035237 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e4970-1c9a-4f1c-b6e2-5a764779f17f admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:17.035964 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e4970-1c9a-4f1c-b6e2-5a764779f17f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:17.037622 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e4970-1c9a-4f1c-b6e2-5a764779f17f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:17.049769 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1236/2492] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:17.054090 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e6b5a-5e71-4a03-8817-e447a541b954 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:17.066211 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e6b5a-5e71-4a03-8817-e447a541b954 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:17.071149 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5e10e-947c-495c-9be6-4d0c713cb9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:17.072027 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5e10e-947c-495c-9be6-4d0c713cb9c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:17.072336 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5e10e-947c-495c-9be6-4d0c713cb9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:17.072637 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5e10e-947c-495c-9be6-4d0c713cb9c6 admin admin] PATH_INFO: `/v3/projects/eec8774181d24dd798ce0a35c1757682/users/1ff2aae2328b4b438eea2631364e57fb/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:17.090000 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5e10e-947c-495c-9be6-4d0c713cb9c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec8774181d24dd798ce0a35c1757682, user_id=1ff2aae2328b4b438eea2631364e57fb, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:17.092851 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5e10e-947c-495c-9be6-4d0c713cb9c6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:17.108369 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1257/2493] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:17 2022] PUT /identity/v3/projects/eec8774181d24dd798ce0a35c1757682/users/1ff2aae2328b4b438eea2631364e57fb/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:44:17.112749 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e4970-1c9a-4f1c-b6e2-5a764779f17f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:17.125550 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e4970-1c9a-4f1c-b6e2-5a764779f17f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:17.191094 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267de3a-2a20-42c9-a323-2a45b0cfa610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:17.191898 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267de3a-2a20-42c9-a323-2a45b0cfa610 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:17.192259 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267de3a-2a20-42c9-a323-2a45b0cfa610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:17.192639 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267de3a-2a20-42c9-a323-2a45b0cfa610 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:17.193961 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267de3a-2a20-42c9-a323-2a45b0cfa610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:17.195703 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267de3a-2a20-42c9-a323-2a45b0cfa610 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:17.207066 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1237/2494] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:17.211343 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5e10e-947c-495c-9be6-4d0c713cb9c6 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:17.222340 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5e10e-947c-495c-9be6-4d0c713cb9c6 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:17.227018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815bc6d-607b-40d6-b87d-b4184d2e09cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:17.227893 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815bc6d-607b-40d6-b87d-b4184d2e09cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:17.228179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815bc6d-607b-40d6-b87d-b4184d2e09cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:17.228493 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815bc6d-607b-40d6-b87d-b4184d2e09cb admin admin] PATH_INFO: `/v3/projects/eec8774181d24dd798ce0a35c1757682/users/1ff2aae2328b4b438eea2631364e57fb/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:17.231064 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815bc6d-607b-40d6-b87d-b4184d2e09cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec8774181d24dd798ce0a35c1757682, user_id=1ff2aae2328b4b438eea2631364e57fb, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:17.233748 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815bc6d-607b-40d6-b87d-b4184d2e09cb admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:17.244124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1258/2495] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:17 2022] PUT /identity/v3/projects/eec8774181d24dd798ce0a35c1757682/users/1ff2aae2328b4b438eea2631364e57fb/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:44:17.254524 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234d6e1-0108-40a2-ba8f-0307c78bae74 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:17.254916 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234d6e1-0108-40a2-ba8f-0307c78bae74 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:17.255247 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234d6e1-0108-40a2-ba8f-0307c78bae74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:17.262628 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:17.286417 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2234d6e1-0108-40a2-ba8f-0307c78bae74 None None] MFA Rules not processed for user `1ff2aae2328b4b438eea2631364e57fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:17.287637 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2234d6e1-0108-40a2-ba8f-0307c78bae74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:17.360601 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1238/2496] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:17 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:17.371707 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815bc6d-607b-40d6-b87d-b4184d2e09cb admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:17.373431 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1815bc6d-607b-40d6-b87d-b4184d2e09cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:17.431566 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815bc6d-607b-40d6-b87d-b4184d2e09cb admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:17.435773 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda065c0-ba5d-42c9-b91b-89dd77ee68ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:17.436489 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda065c0-ba5d-42c9-b91b-89dd77ee68ce service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:17.436777 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda065c0-ba5d-42c9-b91b-89dd77ee68ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:17.437056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda065c0-ba5d-42c9-b91b-89dd77ee68ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:17.446341 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda065c0-ba5d-42c9-b91b-89dd77ee68ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:17.447807 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda065c0-ba5d-42c9-b91b-89dd77ee68ce service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:17.458541 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1259/2497] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:17.511645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234d6e1-0108-40a2-ba8f-0307c78bae74 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:17.513086 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2234d6e1-0108-40a2-ba8f-0307c78bae74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:17.539952 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234d6e1-0108-40a2-ba8f-0307c78bae74 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:17.545108 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411e02a-84f2-4eef-a3cb-d64fa5ee40b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:17.545792 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411e02a-84f2-4eef-a3cb-d64fa5ee40b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:17.546402 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411e02a-84f2-4eef-a3cb-d64fa5ee40b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:17.546402 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411e02a-84f2-4eef-a3cb-d64fa5ee40b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:17.657360 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411e02a-84f2-4eef-a3cb-d64fa5ee40b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:17.663594 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411e02a-84f2-4eef-a3cb-d64fa5ee40b7 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:17.681695 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1239/2498] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:18.187167 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda065c0-ba5d-42c9-b91b-89dd77ee68ce service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:18.190316 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fda065c0-ba5d-42c9-b91b-89dd77ee68ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:18.205969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:18.249287 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411e02a-84f2-4eef-a3cb-d64fa5ee40b7 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:18.251937 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f411e02a-84f2-4eef-a3cb-d64fa5ee40b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:18.282560 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda065c0-ba5d-42c9-b91b-89dd77ee68ce service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:18.289593 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a77151-2c86-48e6-8a34-d9cca9dc0dfa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24410ef5e78042c79c5b4a0d78b56258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:18.290422 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a77151-2c86-48e6-8a34-d9cca9dc0dfa service placement] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:18.290708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a77151-2c86-48e6-8a34-d9cca9dc0dfa service placement] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:18.290979 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a77151-2c86-48e6-8a34-d9cca9dc0dfa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:18.293774 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-03a77151-2c86-48e6-8a34-d9cca9dc0dfa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:18.310972 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a77151-2c86-48e6-8a34-d9cca9dc0dfa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:18.313355 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a77151-2c86-48e6-8a34-d9cca9dc0dfa service placement] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:18.326386 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1260/2499] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:18.342377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411e02a-84f2-4eef-a3cb-d64fa5ee40b7 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:18.347181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506e0dc-c410-46ad-9655-916733a1e7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:18.348106 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506e0dc-c410-46ad-9655-916733a1e7ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:18.348425 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506e0dc-c410-46ad-9655-916733a1e7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:18.348703 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506e0dc-c410-46ad-9655-916733a1e7ab admin admin] PATH_INFO: `/v3/users/88bc03c141d64772b606e087d86e973e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:18.349894 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506e0dc-c410-46ad-9655-916733a1e7ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=88bc03c141d64772b606e087d86e973e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:18.352656 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506e0dc-c410-46ad-9655-916733a1e7ab admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:18.391239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:18.405532 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6506e0dc-c410-46ad-9655-916733a1e7ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88bc03c141d64772b606e087d86e973e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:18.412264 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6506e0dc-c410-46ad-9655-916733a1e7ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88bc03c141d64772b606e087d86e973e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:18.412967 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6506e0dc-c410-46ad-9655-916733a1e7ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88bc03c141d64772b606e087d86e973e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:18.425614 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6506e0dc-c410-46ad-9655-916733a1e7ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88bc03c141d64772b606e087d86e973e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:18.433642 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6506e0dc-c410-46ad-9655-916733a1e7ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88bc03c141d64772b606e087d86e973e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:18.439641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1240/2500] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:44:18 2022] DELETE /identity/v3/users/88bc03c141d64772b606e087d86e973e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:44:18.622816 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a77151-2c86-48e6-8a34-d9cca9dc0dfa service placement] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:18.639162 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a77151-2c86-48e6-8a34-d9cca9dc0dfa service placement] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:18.719149 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fafed-f889-4d50-b8dd-49afcc0e9de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:18.720155 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fafed-f889-4d50-b8dd-49afcc0e9de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:18.720537 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fafed-f889-4d50-b8dd-49afcc0e9de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:18.720887 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fafed-f889-4d50-b8dd-49afcc0e9de4 admin admin] PATH_INFO: `/v3/projects/8e9e2d5c93274eb781bd76912178bae6` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:18.722161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fafed-f889-4d50-b8dd-49afcc0e9de4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e9e2d5c93274eb781bd76912178bae6)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:18.724153 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fafed-f889-4d50-b8dd-49afcc0e9de4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:18.781450 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-957fafed-f889-4d50-b8dd-49afcc0e9de4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e9e2d5c93274eb781bd76912178bae6', 'request_id': 'req-957fafed-f889-4d50-b8dd-49afcc0e9de4'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:18.794394 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-957fafed-f889-4d50-b8dd-49afcc0e9de4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e9e2d5c93274eb781bd76912178bae6', 'request_id': 'req-957fafed-f889-4d50-b8dd-49afcc0e9de4'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:18.805144 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-957fafed-f889-4d50-b8dd-49afcc0e9de4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e9e2d5c93274eb781bd76912178bae6', 'request_id': 'req-957fafed-f889-4d50-b8dd-49afcc0e9de4'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:18.822708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-957fafed-f889-4d50-b8dd-49afcc0e9de4 admin admin] The token cache is being invalidate because project 8e9e2d5c93274eb781bd76912178bae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:44:18.823006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-957fafed-f889-4d50-b8dd-49afcc0e9de4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:18.825140 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-957fafed-f889-4d50-b8dd-49afcc0e9de4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:18.830769 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1261/2501] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:44:18 2022] DELETE /identity/v3/projects/8e9e2d5c93274eb781bd76912178bae6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:44:18.833133 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104d10a-5609-4eb1-bc8b-d914bf304ce2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:18.833323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104d10a-5609-4eb1-bc8b-d914bf304ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:18.833599 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104d10a-5609-4eb1-bc8b-d914bf304ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:18.866681 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b104d10a-5609-4eb1-bc8b-d914bf304ce2 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:18.868023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b104d10a-5609-4eb1-bc8b-d914bf304ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:18.951426 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1241/2502] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:18.954098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f9a28-7294-4a82-9162-04439257b34a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:18.954395 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f9a28-7294-4a82-9162-04439257b34a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:18.954678 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f9a28-7294-4a82-9162-04439257b34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:18.974935 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-366f9a28-7294-4a82-9162-04439257b34a None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:18.976158 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-366f9a28-7294-4a82-9162-04439257b34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:18.986850 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1262/2503] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:18.992109 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104d10a-5609-4eb1-bc8b-d914bf304ce2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:19.020956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104d10a-5609-4eb1-bc8b-d914bf304ce2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:19.028474 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519dd784-b6b1-4504-a163-e6510277c4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:19.029189 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519dd784-b6b1-4504-a163-e6510277c4fb admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:19.029541 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519dd784-b6b1-4504-a163-e6510277c4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:19.029892 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519dd784-b6b1-4504-a163-e6510277c4fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:19.030706 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519dd784-b6b1-4504-a163-e6510277c4fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:44:19.031075 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519dd784-b6b1-4504-a163-e6510277c4fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:19.032956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519dd784-b6b1-4504-a163-e6510277c4fb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:19.052680 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1242/2504] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:44:19.054829 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f9a28-7294-4a82-9162-04439257b34a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:19.068847 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f9a28-7294-4a82-9162-04439257b34a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:19.077551 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcded8-8875-4c03-b90c-079788ae78c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:19.078678 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcded8-8875-4c03-b90c-079788ae78c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:19.079272 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcded8-8875-4c03-b90c-079788ae78c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:19.079655 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcded8-8875-4c03-b90c-079788ae78c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:19.081704 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bcded8-8875-4c03-b90c-079788ae78c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:19.082962 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bcded8-8875-4c03-b90c-079788ae78c4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:19.107959 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:19.130661 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1263/2505] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:44:19 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:19.135131 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519dd784-b6b1-4504-a163-e6510277c4fb admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:19.149498 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519dd784-b6b1-4504-a163-e6510277c4fb admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:19.225975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d3c8a-e15e-494a-8544-f6fd03372c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:19.226926 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d3c8a-e15e-494a-8544-f6fd03372c52 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:19.227307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d3c8a-e15e-494a-8544-f6fd03372c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:19.227665 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d3c8a-e15e-494a-8544-f6fd03372c52 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:19.228517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d3c8a-e15e-494a-8544-f6fd03372c52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:19.231518 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d3c8a-e15e-494a-8544-f6fd03372c52 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:19.259460 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1243/2506] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:44:19 2022] POST /identity/v3/users => generated 287 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:19.263452 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcded8-8875-4c03-b90c-079788ae78c4 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:19.274130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcded8-8875-4c03-b90c-079788ae78c4 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:19.279643 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a7054-e079-4066-8bc7-9903b372bcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:19.280409 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a7054-e079-4066-8bc7-9903b372bcd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:19.280762 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a7054-e079-4066-8bc7-9903b372bcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:19.281303 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a7054-e079-4066-8bc7-9903b372bcd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:19.282171 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a7054-e079-4066-8bc7-9903b372bcd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:19.283916 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a7054-e079-4066-8bc7-9903b372bcd6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:19.299058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1264/2507] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:19.300850 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d3c8a-e15e-494a-8544-f6fd03372c52 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:19.316362 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d3c8a-e15e-494a-8544-f6fd03372c52 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:19.322354 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647ac05-418f-497b-8111-886954cc53dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:19.323111 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647ac05-418f-497b-8111-886954cc53dc admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:19.323676 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647ac05-418f-497b-8111-886954cc53dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:19.323972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647ac05-418f-497b-8111-886954cc53dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:19.324740 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647ac05-418f-497b-8111-886954cc53dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:19.326495 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647ac05-418f-497b-8111-886954cc53dc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:19.338005 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1244/2508] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:44:19.342701 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a7054-e079-4066-8bc7-9903b372bcd6 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:19.352851 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a7054-e079-4066-8bc7-9903b372bcd6 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:19.361522 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2cb21-d960-4935-984a-321a750a908e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:19.362686 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2cb21-d960-4935-984a-321a750a908e admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:19.363324 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2cb21-d960-4935-984a-321a750a908e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:19.363598 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2cb21-d960-4935-984a-321a750a908e admin admin] PATH_INFO: `/v3/projects/c79cb057f7e4470faf76deb8d9b12dcf/users/b27a9ac8ea0c4f6ea438a6cd252053fd/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:19.383445 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2cb21-d960-4935-984a-321a750a908e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c79cb057f7e4470faf76deb8d9b12dcf, user_id=b27a9ac8ea0c4f6ea438a6cd252053fd, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:19.386297 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2cb21-d960-4935-984a-321a750a908e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:19.400871 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1265/2509] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:19 2022] PUT /identity/v3/projects/c79cb057f7e4470faf76deb8d9b12dcf/users/b27a9ac8ea0c4f6ea438a6cd252053fd/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:44:19.411619 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce582e1-eed4-4bc4-a97c-3f1fd74e2eb4 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:19.411865 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce582e1-eed4-4bc4-a97c-3f1fd74e2eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:19.412161 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce582e1-eed4-4bc4-a97c-3f1fd74e2eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:19.437767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:19.441278 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9ce582e1-eed4-4bc4-a97c-3f1fd74e2eb4 None None] MFA Rules not processed for user `b27a9ac8ea0c4f6ea438a6cd252053fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:19.443023 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9ce582e1-eed4-4bc4-a97c-3f1fd74e2eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:19.510746 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1245/2510] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:44:19.521856 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2cb21-d960-4935-984a-321a750a908e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:19.523645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f0c2cb21-d960-4935-984a-321a750a908e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:19.597744 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2cb21-d960-4935-984a-321a750a908e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:19.603690 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7add76-c202-479d-9b2b-ef6ae5ed2389 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:19.604368 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7add76-c202-479d-9b2b-ef6ae5ed2389 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:19.605277 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7add76-c202-479d-9b2b-ef6ae5ed2389 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:19.605566 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7add76-c202-479d-9b2b-ef6ae5ed2389 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:19.613467 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7add76-c202-479d-9b2b-ef6ae5ed2389 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:19.615051 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7add76-c202-479d-9b2b-ef6ae5ed2389 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:19.625135 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1266/2511] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:21.115974 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce582e1-eed4-4bc4-a97c-3f1fd74e2eb4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:21.117704 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9ce582e1-eed4-4bc4-a97c-3f1fd74e2eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:21.204179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce582e1-eed4-4bc4-a97c-3f1fd74e2eb4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:21.208820 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e7e85-aefc-471c-8029-138ae4b21ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:21.209694 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e7e85-aefc-471c-8029-138ae4b21ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:21.210126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e7e85-aefc-471c-8029-138ae4b21ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:21.210242 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e7e85-aefc-471c-8029-138ae4b21ad3 admin admin] PATH_INFO: `/v3/users/d5743d776c2a472083bc5b39f40e581c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:21.211432 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e7e85-aefc-471c-8029-138ae4b21ad3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5743d776c2a472083bc5b39f40e581c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:21.213415 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e7e85-aefc-471c-8029-138ae4b21ad3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:21.261639 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-820e7e85-aefc-471c-8029-138ae4b21ad3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5743d776c2a472083bc5b39f40e581c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:21.268904 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-820e7e85-aefc-471c-8029-138ae4b21ad3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5743d776c2a472083bc5b39f40e581c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:21.269588 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-820e7e85-aefc-471c-8029-138ae4b21ad3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5743d776c2a472083bc5b39f40e581c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:21.283295 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-820e7e85-aefc-471c-8029-138ae4b21ad3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5743d776c2a472083bc5b39f40e581c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:21.293486 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-820e7e85-aefc-471c-8029-138ae4b21ad3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5743d776c2a472083bc5b39f40e581c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:21.299999 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1246/2512] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:44:21 2022] DELETE /identity/v3/users/d5743d776c2a472083bc5b39f40e581c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:21.308039 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14176e-e545-4c15-8253-af4253b9debd None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:21.308576 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14176e-e545-4c15-8253-af4253b9debd None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:21.308751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14176e-e545-4c15-8253-af4253b9debd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:21.326014 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-fa14176e-e545-4c15-8253-af4253b9debd None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:21.327461 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fa14176e-e545-4c15-8253-af4253b9debd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:21.383980 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1267/2513] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:21.394176 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e7e85-aefc-471c-8029-138ae4b21ad3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:21.395568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-820e7e85-aefc-471c-8029-138ae4b21ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:21.422021 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:21.456443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e7e85-aefc-471c-8029-138ae4b21ad3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:21.460166 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd755fc8-d17e-4986-a0b4-b16bcbeaa862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:21.460834 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd755fc8-d17e-4986-a0b4-b16bcbeaa862 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:21.461119 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd755fc8-d17e-4986-a0b4-b16bcbeaa862 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:21.461456 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd755fc8-d17e-4986-a0b4-b16bcbeaa862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:21.471047 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd755fc8-d17e-4986-a0b4-b16bcbeaa862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:21.472538 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd755fc8-d17e-4986-a0b4-b16bcbeaa862 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:21.482147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1247/2514] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:21.784731 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14176e-e545-4c15-8253-af4253b9debd None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:21.786359 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fa14176e-e545-4c15-8253-af4253b9debd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:21.801132 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14176e-e545-4c15-8253-af4253b9debd None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:21.805785 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6ce39-65e5-4b70-b09b-7a6f63d9ecbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:21.806645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6ce39-65e5-4b70-b09b-7a6f63d9ecbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:21.806929 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6ce39-65e5-4b70-b09b-7a6f63d9ecbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:21.807203 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6ce39-65e5-4b70-b09b-7a6f63d9ecbc admin admin] PATH_INFO: `/v3/projects/e41d267b02b64164939ca255a531a669` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:21.809351 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6ce39-65e5-4b70-b09b-7a6f63d9ecbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e41d267b02b64164939ca255a531a669)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:21.810971 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6ce39-65e5-4b70-b09b-7a6f63d9ecbc admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:21.852848 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:21.859315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ebe6ce39-65e5-4b70-b09b-7a6f63d9ecbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e41d267b02b64164939ca255a531a669', 'request_id': 'req-ebe6ce39-65e5-4b70-b09b-7a6f63d9ecbc'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:21.866304 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ebe6ce39-65e5-4b70-b09b-7a6f63d9ecbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e41d267b02b64164939ca255a531a669', 'request_id': 'req-ebe6ce39-65e5-4b70-b09b-7a6f63d9ecbc'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:21.872319 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ebe6ce39-65e5-4b70-b09b-7a6f63d9ecbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e41d267b02b64164939ca255a531a669', 'request_id': 'req-ebe6ce39-65e5-4b70-b09b-7a6f63d9ecbc'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:21.882917 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ebe6ce39-65e5-4b70-b09b-7a6f63d9ecbc admin admin] The token cache is being invalidate because project e41d267b02b64164939ca255a531a669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:44:21.883200 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ebe6ce39-65e5-4b70-b09b-7a6f63d9ecbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:21.883814 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ebe6ce39-65e5-4b70-b09b-7a6f63d9ecbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:21.885390 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1268/2515] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:44:21 2022] DELETE /identity/v3/projects/e41d267b02b64164939ca255a531a669 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:21.890479 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd755fc8-d17e-4986-a0b4-b16bcbeaa862 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:21.909234 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd755fc8-d17e-4986-a0b4-b16bcbeaa862 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:21.971296 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19350e3-4424-44ff-a4ec-762b8c2bc27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:21.972196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19350e3-4424-44ff-a4ec-762b8c2bc27b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:21.972479 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19350e3-4424-44ff-a4ec-762b8c2bc27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:21.972759 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19350e3-4424-44ff-a4ec-762b8c2bc27b admin admin] PATH_INFO: `/v3/users/1ff2aae2328b4b438eea2631364e57fb` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:21.973954 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19350e3-4424-44ff-a4ec-762b8c2bc27b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ff2aae2328b4b438eea2631364e57fb)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:21.975956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19350e3-4424-44ff-a4ec-762b8c2bc27b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:22.025556 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f19350e3-4424-44ff-a4ec-762b8c2bc27b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ff2aae2328b4b438eea2631364e57fb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:22.033521 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f19350e3-4424-44ff-a4ec-762b8c2bc27b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ff2aae2328b4b438eea2631364e57fb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:22.034204 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f19350e3-4424-44ff-a4ec-762b8c2bc27b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ff2aae2328b4b438eea2631364e57fb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:22.046859 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f19350e3-4424-44ff-a4ec-762b8c2bc27b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ff2aae2328b4b438eea2631364e57fb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:22.053847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f19350e3-4424-44ff-a4ec-762b8c2bc27b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ff2aae2328b4b438eea2631364e57fb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:22.060398 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1248/2516] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:44:21 2022] DELETE /identity/v3/users/1ff2aae2328b4b438eea2631364e57fb => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:22.326163 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6ce39-65e5-4b70-b09b-7a6f63d9ecbc admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:22.328276 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ebe6ce39-65e5-4b70-b09b-7a6f63d9ecbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:22.347003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6ce39-65e5-4b70-b09b-7a6f63d9ecbc admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:22.368517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19350e3-4424-44ff-a4ec-762b8c2bc27b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:22.370336 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f19350e3-4424-44ff-a4ec-762b8c2bc27b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:22.422506 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe42ac0-f299-4adf-b8b1-3441dd484893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:22.423807 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe42ac0-f299-4adf-b8b1-3441dd484893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:22.424250 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe42ac0-f299-4adf-b8b1-3441dd484893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:22.424789 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe42ac0-f299-4adf-b8b1-3441dd484893 admin admin] PATH_INFO: `/v3/projects/eec8774181d24dd798ce0a35c1757682` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:22.425863 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:22.426797 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe42ac0-f299-4adf-b8b1-3441dd484893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eec8774181d24dd798ce0a35c1757682)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:22.430697 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe42ac0-f299-4adf-b8b1-3441dd484893 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:22.455609 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19350e3-4424-44ff-a4ec-762b8c2bc27b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:22.460586 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25156f5c-3682-4516-a717-2b52b1bae2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:22.461466 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25156f5c-3682-4516-a717-2b52b1bae2d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:22.461759 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25156f5c-3682-4516-a717-2b52b1bae2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:22.462035 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25156f5c-3682-4516-a717-2b52b1bae2d0 admin admin] PATH_INFO: `/v3/users/b27a9ac8ea0c4f6ea438a6cd252053fd` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:22.463229 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25156f5c-3682-4516-a717-2b52b1bae2d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b27a9ac8ea0c4f6ea438a6cd252053fd)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:22.465942 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25156f5c-3682-4516-a717-2b52b1bae2d0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:22.507761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-abe42ac0-f299-4adf-b8b1-3441dd484893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eec8774181d24dd798ce0a35c1757682', 'request_id': 'req-abe42ac0-f299-4adf-b8b1-3441dd484893'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:22.516828 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-abe42ac0-f299-4adf-b8b1-3441dd484893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eec8774181d24dd798ce0a35c1757682', 'request_id': 'req-abe42ac0-f299-4adf-b8b1-3441dd484893'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:22.520454 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-25156f5c-3682-4516-a717-2b52b1bae2d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b27a9ac8ea0c4f6ea438a6cd252053fd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:22.523437 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-abe42ac0-f299-4adf-b8b1-3441dd484893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eec8774181d24dd798ce0a35c1757682', 'request_id': 'req-abe42ac0-f299-4adf-b8b1-3441dd484893'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:22.531415 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-25156f5c-3682-4516-a717-2b52b1bae2d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b27a9ac8ea0c4f6ea438a6cd252053fd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:22.532130 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-25156f5c-3682-4516-a717-2b52b1bae2d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b27a9ac8ea0c4f6ea438a6cd252053fd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:22.538418 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-abe42ac0-f299-4adf-b8b1-3441dd484893 admin admin] The token cache is being invalidate because project eec8774181d24dd798ce0a35c1757682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:44:22.538800 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-abe42ac0-f299-4adf-b8b1-3441dd484893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:22.539590 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-abe42ac0-f299-4adf-b8b1-3441dd484893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:22.544662 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1269/2517] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:44:22 2022] DELETE /identity/v3/projects/eec8774181d24dd798ce0a35c1757682 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:22.547100 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d0d7e-9532-490d-94c6-83885505c6cc None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:22.547473 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d0d7e-9532-490d-94c6-83885505c6cc None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:22.547752 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d0d7e-9532-490d-94c6-83885505c6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:22.551356 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-25156f5c-3682-4516-a717-2b52b1bae2d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b27a9ac8ea0c4f6ea438a6cd252053fd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:22.561127 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-25156f5c-3682-4516-a717-2b52b1bae2d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b27a9ac8ea0c4f6ea438a6cd252053fd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:22.568431 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-248d0d7e-9532-490d-94c6-83885505c6cc None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:22.569164 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1249/2518] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:44:22 2022] DELETE /identity/v3/users/b27a9ac8ea0c4f6ea438a6cd252053fd => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:22.569646 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-248d0d7e-9532-490d-94c6-83885505c6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:22.573364 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79c7c7-0aa2-48f0-96f5-af1b3956f70b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:22.573661 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79c7c7-0aa2-48f0-96f5-af1b3956f70b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:22.573946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79c7c7-0aa2-48f0-96f5-af1b3956f70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:22.594374 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-da79c7c7-0aa2-48f0-96f5-af1b3956f70b None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:22.595687 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-da79c7c7-0aa2-48f0-96f5-af1b3956f70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:22.622836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:22.632942 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1270/2519] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:44:22.642074 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6ad26-a77f-48d8-9c18-ebcaff0d8169 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:22.642365 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6ad26-a77f-48d8-9c18-ebcaff0d8169 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:22.642668 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6ad26-a77f-48d8-9c18-ebcaff0d8169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:22.658121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1250/2520] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:44:22.660852 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-32c6ad26-a77f-48d8-9c18-ebcaff0d8169 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:22.662038 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-32c6ad26-a77f-48d8-9c18-ebcaff0d8169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:22.667687 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79c7c7-0aa2-48f0-96f5-af1b3956f70b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:22.668991 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-da79c7c7-0aa2-48f0-96f5-af1b3956f70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:22.669897 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1271/2521] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:44:22.673842 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6ad26-a77f-48d8-9c18-ebcaff0d8169 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:22.682652 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6ad26-a77f-48d8-9c18-ebcaff0d8169 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:22.687286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2f7dd-0e46-4dd9-91cb-a0c73d31d439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:22.688042 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2f7dd-0e46-4dd9-91cb-a0c73d31d439 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:22.688242 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2f7dd-0e46-4dd9-91cb-a0c73d31d439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:22.688555 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2f7dd-0e46-4dd9-91cb-a0c73d31d439 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:22.689414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2f7dd-0e46-4dd9-91cb-a0c73d31d439 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:44:22.689760 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2f7dd-0e46-4dd9-91cb-a0c73d31d439 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:22.691351 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2f7dd-0e46-4dd9-91cb-a0c73d31d439 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:22.703997 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1272/2522] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:44:22.708947 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2f7dd-0e46-4dd9-91cb-a0c73d31d439 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:22.719115 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2f7dd-0e46-4dd9-91cb-a0c73d31d439 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:22.723673 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6bbc2-b28f-46bd-97ab-6426f57292a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:22.724323 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6bbc2-b28f-46bd-97ab-6426f57292a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:22.724614 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6bbc2-b28f-46bd-97ab-6426f57292a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:22.724890 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6bbc2-b28f-46bd-97ab-6426f57292a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:22.725579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6bbc2-b28f-46bd-97ab-6426f57292a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:22.727736 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6bbc2-b28f-46bd-97ab-6426f57292a8 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:22.730940 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79c7c7-0aa2-48f0-96f5-af1b3956f70b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:22.734554 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903d625-f144-4b3d-aa2f-89155fdc664f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:22.735196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903d625-f144-4b3d-aa2f-89155fdc664f service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:22.735481 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903d625-f144-4b3d-aa2f-89155fdc664f service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:22.735758 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903d625-f144-4b3d-aa2f-89155fdc664f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:22.745231 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903d625-f144-4b3d-aa2f-89155fdc664f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:22.746613 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903d625-f144-4b3d-aa2f-89155fdc664f service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:22.753400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1273/2523] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:44:22 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:44:22.757048 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6bbc2-b28f-46bd-97ab-6426f57292a8 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:22.759701 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1251/2524] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:44:22.836070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6bbc2-b28f-46bd-97ab-6426f57292a8 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:22.842341 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6901a0-2e33-4553-974b-d27f2d463bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:22.843061 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6901a0-2e33-4553-974b-d27f2d463bba admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:22.843481 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6901a0-2e33-4553-974b-d27f2d463bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:22.844659 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6901a0-2e33-4553-974b-d27f2d463bba admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:22.845518 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6901a0-2e33-4553-974b-d27f2d463bba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:22.849440 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6901a0-2e33-4553-974b-d27f2d463bba admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:22.859964 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903d625-f144-4b3d-aa2f-89155fdc664f service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:22.861505 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d903d625-f144-4b3d-aa2f-89155fdc664f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:22.879884 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903d625-f144-4b3d-aa2f-89155fdc664f service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:22.883760 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1274/2525] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:44:22 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:44:22.885035 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6901a0-2e33-4553-974b-d27f2d463bba admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:22.888627 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:22.899203 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6901a0-2e33-4553-974b-d27f2d463bba admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:22.906034 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e38110-effc-4f65-8a86-c60e01ee705d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:22.906749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e38110-effc-4f65-8a86-c60e01ee705d admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:22.907016 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e38110-effc-4f65-8a86-c60e01ee705d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:22.907259 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e38110-effc-4f65-8a86-c60e01ee705d admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:22.908073 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e38110-effc-4f65-8a86-c60e01ee705d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:22.909724 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e38110-effc-4f65-8a86-c60e01ee705d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:22.922520 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1275/2526] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:22.927417 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e38110-effc-4f65-8a86-c60e01ee705d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:22.940558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e38110-effc-4f65-8a86-c60e01ee705d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:22.946837 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c44076-da91-454a-81a2-df4bfec3abd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:22.955961 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00241f-6a9b-479c-8195-01bfb44ce859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:22.956739 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00241f-6a9b-479c-8195-01bfb44ce859 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:22.957337 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00241f-6a9b-479c-8195-01bfb44ce859 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:22.957337 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00241f-6a9b-479c-8195-01bfb44ce859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:22.957670 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c44076-da91-454a-81a2-df4bfec3abd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:22.958351 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c44076-da91-454a-81a2-df4bfec3abd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:22.958351 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c44076-da91-454a-81a2-df4bfec3abd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:22.958983 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c44076-da91-454a-81a2-df4bfec3abd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:22.959745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fa00241f-6a9b-479c-8195-01bfb44ce859 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:22.960799 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c44076-da91-454a-81a2-df4bfec3abd1 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:22.975659 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00241f-6a9b-479c-8195-01bfb44ce859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:22.976911 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1276/2527] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:22.977595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00241f-6a9b-479c-8195-01bfb44ce859 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:22.977799 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c44076-da91-454a-81a2-df4bfec3abd1 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:22.989239 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c44076-da91-454a-81a2-df4bfec3abd1 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:22.992143 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1252/2528] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:44:22.994259 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863395d-a83e-4733-ac0d-3d9ca2932f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:22.995228 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863395d-a83e-4733-ac0d-3d9ca2932f4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:22.995568 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863395d-a83e-4733-ac0d-3d9ca2932f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:22.995779 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863395d-a83e-4733-ac0d-3d9ca2932f4e admin admin] PATH_INFO: `/v3/projects/73f7af6b497c49c38a44eb779f95d600/users/04573d548e3048f79cff9437a0cfd9f2/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:23.020447 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863395d-a83e-4733-ac0d-3d9ca2932f4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f7af6b497c49c38a44eb779f95d600, user_id=04573d548e3048f79cff9437a0cfd9f2, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:23.023343 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863395d-a83e-4733-ac0d-3d9ca2932f4e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:23.041041 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1277/2529] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:22 2022] PUT /identity/v3/projects/73f7af6b497c49c38a44eb779f95d600/users/04573d548e3048f79cff9437a0cfd9f2/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:23.053076 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb4ac4-3399-4f3e-924b-f796e524613f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:23.053341 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb4ac4-3399-4f3e-924b-f796e524613f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:23.053622 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb4ac4-3399-4f3e-924b-f796e524613f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:23.091447 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863395d-a83e-4733-ac0d-3d9ca2932f4e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:23.093481 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6863395d-a83e-4733-ac0d-3d9ca2932f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:23.098079 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0dfb4ac4-3399-4f3e-924b-f796e524613f None None] MFA Rules not processed for user `04573d548e3048f79cff9437a0cfd9f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:23.099448 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0dfb4ac4-3399-4f3e-924b-f796e524613f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:23.186814 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863395d-a83e-4733-ac0d-3d9ca2932f4e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:23.191313 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87efc0-8ae1-4600-88d6-318c8a611938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:23.192249 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87efc0-8ae1-4600-88d6-318c8a611938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:23.192726 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87efc0-8ae1-4600-88d6-318c8a611938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:23.193286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87efc0-8ae1-4600-88d6-318c8a611938 admin admin] PATH_INFO: `/v3/projects/c79cb057f7e4470faf76deb8d9b12dcf` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:23.194678 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87efc0-8ae1-4600-88d6-318c8a611938 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c79cb057f7e4470faf76deb8d9b12dcf)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:23.197120 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87efc0-8ae1-4600-88d6-318c8a611938 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:23.202958 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1253/2530] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:23.203144 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:23.204052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb4ac4-3399-4f3e-924b-f796e524613f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:23.218297 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb4ac4-3399-4f3e-924b-f796e524613f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:23.223306 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3684e-3a1a-4c99-8a11-f8ba03eeddb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:23.224119 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3684e-3a1a-4c99-8a11-f8ba03eeddb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:23.224501 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3684e-3a1a-4c99-8a11-f8ba03eeddb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:23.224845 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3684e-3a1a-4c99-8a11-f8ba03eeddb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:23.225719 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e3684e-3a1a-4c99-8a11-f8ba03eeddb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:23.227836 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e3684e-3a1a-4c99-8a11-f8ba03eeddb5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:23.250171 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0a87efc0-8ae1-4600-88d6-318c8a611938 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c79cb057f7e4470faf76deb8d9b12dcf', 'request_id': 'req-0a87efc0-8ae1-4600-88d6-318c8a611938'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:23.258203 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0a87efc0-8ae1-4600-88d6-318c8a611938 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c79cb057f7e4470faf76deb8d9b12dcf', 'request_id': 'req-0a87efc0-8ae1-4600-88d6-318c8a611938'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:23.259038 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1254/2531] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:44:23 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:44:23.265643 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3684e-3a1a-4c99-8a11-f8ba03eeddb5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:23.269070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0a87efc0-8ae1-4600-88d6-318c8a611938 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c79cb057f7e4470faf76deb8d9b12dcf', 'request_id': 'req-0a87efc0-8ae1-4600-88d6-318c8a611938'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:23.281583 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0a87efc0-8ae1-4600-88d6-318c8a611938 admin admin] The token cache is being invalidate because project c79cb057f7e4470faf76deb8d9b12dcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:44:23.281880 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0a87efc0-8ae1-4600-88d6-318c8a611938 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:23.282550 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0a87efc0-8ae1-4600-88d6-318c8a611938 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:23.284346 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1278/2532] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:44:23 2022] DELETE /identity/v3/projects/c79cb057f7e4470faf76deb8d9b12dcf => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:44:23.288897 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9265e6-dca8-4069-a8f7-f469f180649a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:23.289326 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9265e6-dca8-4069-a8f7-f469f180649a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:23.289613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9265e6-dca8-4069-a8f7-f469f180649a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:23.311699 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ba9265e6-dca8-4069-a8f7-f469f180649a None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:23.313060 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ba9265e6-dca8-4069-a8f7-f469f180649a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:23.363567 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3684e-3a1a-4c99-8a11-f8ba03eeddb5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:23.371719 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d3179-6b45-420f-9d0c-6cd25f7eaa2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:23.372393 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d3179-6b45-420f-9d0c-6cd25f7eaa2e admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:23.372707 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d3179-6b45-420f-9d0c-6cd25f7eaa2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:23.373036 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d3179-6b45-420f-9d0c-6cd25f7eaa2e admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:23.373734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d3179-6b45-420f-9d0c-6cd25f7eaa2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:23.375793 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d3179-6b45-420f-9d0c-6cd25f7eaa2e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:23.396369 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1279/2533] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:44:23.399773 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f35a2-c309-4591-8535-0ef0ef08b7e8 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:23.400456 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f35a2-c309-4591-8535-0ef0ef08b7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:23.401088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f35a2-c309-4591-8535-0ef0ef08b7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:23.408134 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1255/2534] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:44:23 2022] POST /identity/v3/users => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:23.410177 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d3179-6b45-420f-9d0c-6cd25f7eaa2e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:23.411915 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7c1d3179-6b45-420f-9d0c-6cd25f7eaa2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:23.424400 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3a5f35a2-c309-4591-8535-0ef0ef08b7e8 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:23.425924 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3a5f35a2-c309-4591-8535-0ef0ef08b7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:23.428244 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d3179-6b45-420f-9d0c-6cd25f7eaa2e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:23.434201 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72f737-f560-451f-b2b7-e42be790446f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:23.434870 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72f737-f560-451f-b2b7-e42be790446f admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:23.435381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72f737-f560-451f-b2b7-e42be790446f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:23.435514 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1280/2535] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:44:23.436547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72f737-f560-451f-b2b7-e42be790446f admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:23.437424 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa72f737-f560-451f-b2b7-e42be790446f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:23.439824 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f35a2-c309-4591-8535-0ef0ef08b7e8 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:23.440398 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa72f737-f560-451f-b2b7-e42be790446f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:23.442068 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:23.455549 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f35a2-c309-4591-8535-0ef0ef08b7e8 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:23.456154 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1256/2536] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:23.461309 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72f737-f560-451f-b2b7-e42be790446f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:23.463706 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557721b-d77f-412b-95b1-6f003c7fde5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:23.464471 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557721b-d77f-412b-95b1-6f003c7fde5d admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:23.464756 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557721b-d77f-412b-95b1-6f003c7fde5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:23.465032 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557721b-d77f-412b-95b1-6f003c7fde5d admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:23.465823 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557721b-d77f-412b-95b1-6f003c7fde5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:44:23.466697 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557721b-d77f-412b-95b1-6f003c7fde5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:23.468454 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557721b-d77f-412b-95b1-6f003c7fde5d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:23.476724 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72f737-f560-451f-b2b7-e42be790446f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:23.485465 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1281/2537] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:44:23.486703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557721b-d77f-412b-95b1-6f003c7fde5d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:23.486919 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd25891-efc8-4c03-8871-47e8513204dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:23.488194 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd25891-efc8-4c03-8871-47e8513204dd admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:23.488669 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd25891-efc8-4c03-8871-47e8513204dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:23.489608 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd25891-efc8-4c03-8871-47e8513204dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:23.492653 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd25891-efc8-4c03-8871-47e8513204dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:23.496994 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd25891-efc8-4c03-8871-47e8513204dd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:23.497341 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557721b-d77f-412b-95b1-6f003c7fde5d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:23.502839 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3544880-5103-4cf4-a1bc-b4d8dabb302d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:23.503509 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3544880-5103-4cf4-a1bc-b4d8dabb302d admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:23.503856 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3544880-5103-4cf4-a1bc-b4d8dabb302d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:23.504199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3544880-5103-4cf4-a1bc-b4d8dabb302d admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:23.505003 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3544880-5103-4cf4-a1bc-b4d8dabb302d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:23.507026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3544880-5103-4cf4-a1bc-b4d8dabb302d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:23.524506 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1257/2538] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:23.525709 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd25891-efc8-4c03-8871-47e8513204dd admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:23.544700 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1282/2539] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:44:23 2022] POST /identity/v3/projects => generated 407 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:23.548023 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3544880-5103-4cf4-a1bc-b4d8dabb302d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:23.556223 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd25891-efc8-4c03-8871-47e8513204dd admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:23.625801 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:23.640430 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3544880-5103-4cf4-a1bc-b4d8dabb302d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:23.649404 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee22c60-0b81-4489-aade-6b65f089eb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:23.650427 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee22c60-0b81-4489-aade-6b65f089eb9b admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:23.651389 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee22c60-0b81-4489-aade-6b65f089eb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:23.651809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee22c60-0b81-4489-aade-6b65f089eb9b admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:23.652900 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee22c60-0b81-4489-aade-6b65f089eb9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:23.655216 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee22c60-0b81-4489-aade-6b65f089eb9b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:23.670737 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24495feb-d715-4be2-bd0a-c66f10032da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:23.671762 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24495feb-d715-4be2-bd0a-c66f10032da9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:23.672129 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24495feb-d715-4be2-bd0a-c66f10032da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:23.672476 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24495feb-d715-4be2-bd0a-c66f10032da9 admin admin] PATH_INFO: `/v3/projects/3622e17812fd4d5a8f995e131b76522b/users/0f9b2d9c2c754215ba782e69a605c150/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:23.689738 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1283/2540] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:44:23 2022] POST /identity/v3/users => generated 304 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:23.691847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24495feb-d715-4be2-bd0a-c66f10032da9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3622e17812fd4d5a8f995e131b76522b, user_id=0f9b2d9c2c754215ba782e69a605c150, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:23.693946 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee22c60-0b81-4489-aade-6b65f089eb9b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:23.695074 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24495feb-d715-4be2-bd0a-c66f10032da9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:23.711149 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1258/2541] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:23 2022] PUT /identity/v3/projects/3622e17812fd4d5a8f995e131b76522b/users/0f9b2d9c2c754215ba782e69a605c150/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:23.722618 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808efb83-8cee-4963-87b1-6ab87f6c3f76 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:23.724042 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808efb83-8cee-4963-87b1-6ab87f6c3f76 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:23.726040 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee22c60-0b81-4489-aade-6b65f089eb9b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:23.727027 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808efb83-8cee-4963-87b1-6ab87f6c3f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:23.799942 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b94ee-5c00-47f5-9365-631916c7571f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:23.801044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b94ee-5c00-47f5-9365-631916c7571f admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:23.801500 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b94ee-5c00-47f5-9365-631916c7571f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:23.802029 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b94ee-5c00-47f5-9365-631916c7571f admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:23.802325 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-808efb83-8cee-4963-87b1-6ab87f6c3f76 None None] MFA Rules not processed for user `0f9b2d9c2c754215ba782e69a605c150`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:23.803652 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-808efb83-8cee-4963-87b1-6ab87f6c3f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:23.804118 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b94ee-5c00-47f5-9365-631916c7571f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:23.806851 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b94ee-5c00-47f5-9365-631916c7571f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:23.831544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1284/2542] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:23.835864 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b94ee-5c00-47f5-9365-631916c7571f admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:23.855401 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b94ee-5c00-47f5-9365-631916c7571f admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:23.861879 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e75d8-3ef2-4ace-a6a7-7d86db4f8ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:23.862556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e75d8-3ef2-4ace-a6a7-7d86db4f8ece admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:23.862848 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e75d8-3ef2-4ace-a6a7-7d86db4f8ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:23.863126 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e75d8-3ef2-4ace-a6a7-7d86db4f8ece admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:23.863857 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e75d8-3ef2-4ace-a6a7-7d86db4f8ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:23.865560 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e75d8-3ef2-4ace-a6a7-7d86db4f8ece admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:23.876609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1285/2543] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:44:23.881112 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e75d8-3ef2-4ace-a6a7-7d86db4f8ece admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:23.892527 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e75d8-3ef2-4ace-a6a7-7d86db4f8ece admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:23.898132 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d9f05-1e0f-4a9c-817c-50ed53a8deb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:23.899233 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d9f05-1e0f-4a9c-817c-50ed53a8deb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:23.899384 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d9f05-1e0f-4a9c-817c-50ed53a8deb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:23.899641 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d9f05-1e0f-4a9c-817c-50ed53a8deb3 admin admin] PATH_INFO: `/v3/projects/f05ef28e9bef4f188bd66f5de5d4115b/users/78475e4866444fd2a273e35d4a287052/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:23.904490 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1259/2544] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:23.908346 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808efb83-8cee-4963-87b1-6ab87f6c3f76 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:23.920620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808efb83-8cee-4963-87b1-6ab87f6c3f76 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:23.922772 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d9f05-1e0f-4a9c-817c-50ed53a8deb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f05ef28e9bef4f188bd66f5de5d4115b, user_id=78475e4866444fd2a273e35d4a287052, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:23.925306 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330db81d-3dc2-4a03-a861-28f3be0d37fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:23.925518 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d9f05-1e0f-4a9c-817c-50ed53a8deb3 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:23.925975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330db81d-3dc2-4a03-a861-28f3be0d37fb admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:23.926596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330db81d-3dc2-4a03-a861-28f3be0d37fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:23.926889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330db81d-3dc2-4a03-a861-28f3be0d37fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:23.927820 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330db81d-3dc2-4a03-a861-28f3be0d37fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:23.929871 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330db81d-3dc2-4a03-a861-28f3be0d37fb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:23.941715 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1286/2545] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:23 2022] PUT /identity/v3/projects/f05ef28e9bef4f188bd66f5de5d4115b/users/78475e4866444fd2a273e35d4a287052/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:23.952515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f75df-4a3d-4e83-88e4-7386debf9f93 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:23.953102 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f75df-4a3d-4e83-88e4-7386debf9f93 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:23.953977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f75df-4a3d-4e83-88e4-7386debf9f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:23.964874 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1260/2546] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:44:23 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:44:23.969075 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330db81d-3dc2-4a03-a861-28f3be0d37fb admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:23.989027 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-9b1f75df-4a3d-4e83-88e4-7386debf9f93 None None] MFA Rules not processed for user `78475e4866444fd2a273e35d4a287052`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:23.990626 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-9b1f75df-4a3d-4e83-88e4-7386debf9f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:24.025762 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:24.064507 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330db81d-3dc2-4a03-a861-28f3be0d37fb admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:24.070019 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8ab72-eb73-4200-ac07-6265b7948b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:24.071010 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8ab72-eb73-4200-ac07-6265b7948b0b admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:24.071297 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8ab72-eb73-4200-ac07-6265b7948b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:24.071575 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8ab72-eb73-4200-ac07-6265b7948b0b admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:24.072275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8ab72-eb73-4200-ac07-6265b7948b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:24.074351 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8ab72-eb73-4200-ac07-6265b7948b0b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:24.074897 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1287/2547] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:23 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:44:24.079773 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f75df-4a3d-4e83-88e4-7386debf9f93 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:24.092291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f75df-4a3d-4e83-88e4-7386debf9f93 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:24.099032 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc0a6b-dcc8-42be-8f0a-62d1328259be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:24.099601 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc0a6b-dcc8-42be-8f0a-62d1328259be admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:24.099890 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc0a6b-dcc8-42be-8f0a-62d1328259be admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:24.100167 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc0a6b-dcc8-42be-8f0a-62d1328259be admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:24.100933 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc0a6b-dcc8-42be-8f0a-62d1328259be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:24.102907 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1261/2548] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:44:23 2022] POST /identity/v3/users => generated 296 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:44:24.103055 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc0a6b-dcc8-42be-8f0a-62d1328259be admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:24.107520 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8ab72-eb73-4200-ac07-6265b7948b0b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:24.118667 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8ab72-eb73-4200-ac07-6265b7948b0b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:24.124021 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ab8ed-6380-4f9b-8a3a-75728eff6438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:24.124793 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ab8ed-6380-4f9b-8a3a-75728eff6438 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:24.125084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ab8ed-6380-4f9b-8a3a-75728eff6438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:24.125362 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ab8ed-6380-4f9b-8a3a-75728eff6438 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:24.126100 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ab8ed-6380-4f9b-8a3a-75728eff6438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:24.127903 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ab8ed-6380-4f9b-8a3a-75728eff6438 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:24.140721 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1262/2549] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:44:24.144982 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ab8ed-6380-4f9b-8a3a-75728eff6438 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:24.149071 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1288/2550] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:44:24 2022] POST /identity/v3/projects => generated 409 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:44:24.149939 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc0a6b-dcc8-42be-8f0a-62d1328259be admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:24.162126 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ab8ed-6380-4f9b-8a3a-75728eff6438 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:24.163897 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:24.236800 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2310254-0045-451e-a4a7-442a50a03c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:24.237813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc0a6b-dcc8-42be-8f0a-62d1328259be admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:24.238236 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2310254-0045-451e-a4a7-442a50a03c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:24.238706 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2310254-0045-451e-a4a7-442a50a03c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:24.239417 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2310254-0045-451e-a4a7-442a50a03c7b admin admin] PATH_INFO: `/v3/projects/d5d6541db6b44f56ae0504fd05cc0343/users/902312bfb3a54a278647605af2b6434c/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:24.242711 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff830a-1040-4b9b-a671-b6130a778c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:24.244778 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff830a-1040-4b9b-a671-b6130a778c12 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:24.245113 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff830a-1040-4b9b-a671-b6130a778c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:24.245395 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff830a-1040-4b9b-a671-b6130a778c12 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:24.246103 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff830a-1040-4b9b-a671-b6130a778c12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:24.248064 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff830a-1040-4b9b-a671-b6130a778c12 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:24.259344 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2310254-0045-451e-a4a7-442a50a03c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d6541db6b44f56ae0504fd05cc0343, user_id=902312bfb3a54a278647605af2b6434c, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:24.263814 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2310254-0045-451e-a4a7-442a50a03c7b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:24.280473 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1289/2551] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:44:24 2022] POST /identity/v3/users => generated 311 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:24.281332 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1263/2552] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:24 2022] PUT /identity/v3/projects/d5d6541db6b44f56ae0504fd05cc0343/users/902312bfb3a54a278647605af2b6434c/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:24.284558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff830a-1040-4b9b-a671-b6130a778c12 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:24.286176 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2310254-0045-451e-a4a7-442a50a03c7b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:24.296100 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff830a-1040-4b9b-a671-b6130a778c12 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:24.371430 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2310254-0045-451e-a4a7-442a50a03c7b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:24.371708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6995a-1faa-430d-9d93-ec98b9146b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:24.372944 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6995a-1faa-430d-9d93-ec98b9146b9a admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:24.373247 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6995a-1faa-430d-9d93-ec98b9146b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:24.373544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6995a-1faa-430d-9d93-ec98b9146b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:24.374248 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6995a-1faa-430d-9d93-ec98b9146b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:24.375855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6995a-1faa-430d-9d93-ec98b9146b9a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:24.378125 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fd877-67ed-4bda-b996-f0b84b5d76e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:24.378868 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fd877-67ed-4bda-b996-f0b84b5d76e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:24.379151 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fd877-67ed-4bda-b996-f0b84b5d76e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:24.379429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fd877-67ed-4bda-b996-f0b84b5d76e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:24.380153 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31fd877-67ed-4bda-b996-f0b84b5d76e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:24.382303 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31fd877-67ed-4bda-b996-f0b84b5d76e5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:24.389223 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1290/2553] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:44:24.392661 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6995a-1faa-430d-9d93-ec98b9146b9a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:24.396155 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1264/2554] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:24.400527 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fd877-67ed-4bda-b996-f0b84b5d76e5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:24.408474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6995a-1faa-430d-9d93-ec98b9146b9a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:24.411146 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fd877-67ed-4bda-b996-f0b84b5d76e5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:24.414178 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be441d-4514-4e17-8dbd-ead21a61f80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:24.415065 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be441d-4514-4e17-8dbd-ead21a61f80d admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:24.415347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be441d-4514-4e17-8dbd-ead21a61f80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:24.415626 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be441d-4514-4e17-8dbd-ead21a61f80d admin admin] PATH_INFO: `/v3/projects/424ddcbbb97b4d0181fbc340c340f7a3/users/9ba53344621148d1a390a9d952bd55d8/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:24.418016 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec89998-d2e3-48fd-9dd7-b5f1abed8c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:24.419103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec89998-d2e3-48fd-9dd7-b5f1abed8c58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:24.419444 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec89998-d2e3-48fd-9dd7-b5f1abed8c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:24.419727 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec89998-d2e3-48fd-9dd7-b5f1abed8c58 admin admin] PATH_INFO: `/v3/projects/d5d6541db6b44f56ae0504fd05cc0343/users/902312bfb3a54a278647605af2b6434c/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:24.421739 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec89998-d2e3-48fd-9dd7-b5f1abed8c58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d6541db6b44f56ae0504fd05cc0343, user_id=902312bfb3a54a278647605af2b6434c, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:24.424415 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec89998-d2e3-48fd-9dd7-b5f1abed8c58 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:24.432931 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be441d-4514-4e17-8dbd-ead21a61f80d admin admin] RBAC: Authorizing `identity:create_grant(project_id=424ddcbbb97b4d0181fbc340c340f7a3, user_id=9ba53344621148d1a390a9d952bd55d8, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:24.435562 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be441d-4514-4e17-8dbd-ead21a61f80d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:24.436888 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1265/2555] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:24 2022] PUT /identity/v3/projects/d5d6541db6b44f56ae0504fd05cc0343/users/902312bfb3a54a278647605af2b6434c/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:44:24.449421 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c88420-c1ae-48af-b403-8a1a2f8e2294 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:24.449768 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c88420-c1ae-48af-b403-8a1a2f8e2294 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:24.450145 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c88420-c1ae-48af-b403-8a1a2f8e2294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:24.452685 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1291/2556] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:24 2022] PUT /identity/v3/projects/424ddcbbb97b4d0181fbc340c340f7a3/users/9ba53344621148d1a390a9d952bd55d8/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:24.456268 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be441d-4514-4e17-8dbd-ead21a61f80d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:24.482053 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-04c88420-c1ae-48af-b403-8a1a2f8e2294 None None] MFA Rules not processed for user `902312bfb3a54a278647605af2b6434c`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:24.483266 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-04c88420-c1ae-48af-b403-8a1a2f8e2294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:24.491889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:24.529327 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be441d-4514-4e17-8dbd-ead21a61f80d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:24.534605 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec098769-a9b3-4366-9c02-9f0cd715f6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:24.535506 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec098769-a9b3-4366-9c02-9f0cd715f6f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:24.535677 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec098769-a9b3-4366-9c02-9f0cd715f6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:24.535953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec098769-a9b3-4366-9c02-9f0cd715f6f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:24.536795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec098769-a9b3-4366-9c02-9f0cd715f6f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:24.538322 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec098769-a9b3-4366-9c02-9f0cd715f6f3 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:24.549654 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1292/2557] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:44:24.553745 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec098769-a9b3-4366-9c02-9f0cd715f6f3 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:24.564396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec098769-a9b3-4366-9c02-9f0cd715f6f3 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:24.569469 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543e33a-82f4-47af-9315-ea104060c6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:24.569695 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1266/2558] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:24 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:44:24.570352 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543e33a-82f4-47af-9315-ea104060c6a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:24.570724 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543e33a-82f4-47af-9315-ea104060c6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:24.571061 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543e33a-82f4-47af-9315-ea104060c6a8 admin admin] PATH_INFO: `/v3/projects/424ddcbbb97b4d0181fbc340c340f7a3/users/9ba53344621148d1a390a9d952bd55d8/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:24.573082 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543e33a-82f4-47af-9315-ea104060c6a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=424ddcbbb97b4d0181fbc340c340f7a3, user_id=9ba53344621148d1a390a9d952bd55d8, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:24.576538 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543e33a-82f4-47af-9315-ea104060c6a8 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:24.581733 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:24.583137 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c88420-c1ae-48af-b403-8a1a2f8e2294 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:24.585164 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-04c88420-c1ae-48af-b403-8a1a2f8e2294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:24.599144 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1293/2559] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:24 2022] PUT /identity/v3/projects/424ddcbbb97b4d0181fbc340c340f7a3/users/9ba53344621148d1a390a9d952bd55d8/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:44:24.601783 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42e561-4f04-48bd-a943-ddf1e2450ca8 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:24.602078 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42e561-4f04-48bd-a943-ddf1e2450ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:24.602356 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42e561-4f04-48bd-a943-ddf1e2450ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:24.649623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-5d42e561-4f04-48bd-a943-ddf1e2450ca8 None None] MFA Rules not processed for user `9ba53344621148d1a390a9d952bd55d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:24.651345 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5d42e561-4f04-48bd-a943-ddf1e2450ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:24.686164 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c88420-c1ae-48af-b403-8a1a2f8e2294 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:24.755069 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1294/2560] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:24 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:44:24.756511 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42e561-4f04-48bd-a943-ddf1e2450ca8 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:24.758570 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5d42e561-4f04-48bd-a943-ddf1e2450ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:24.776287 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7cc0b-8ecd-4c82-925f-80c8cce46a40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:24.777752 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7cc0b-8ecd-4c82-925f-80c8cce46a40 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:24.778225 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7cc0b-8ecd-4c82-925f-80c8cce46a40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:24.778685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7cc0b-8ecd-4c82-925f-80c8cce46a40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:24.839112 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42e561-4f04-48bd-a943-ddf1e2450ca8 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:24.843975 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8845f8c-5744-4262-a08d-a712148ad39b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:24.845028 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8845f8c-5744-4262-a08d-a712148ad39b service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:24.845315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8845f8c-5744-4262-a08d-a712148ad39b service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:24.846095 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8845f8c-5744-4262-a08d-a712148ad39b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:24.848239 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e8845f8c-5744-4262-a08d-a712148ad39b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:24.868567 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7cc0b-8ecd-4c82-925f-80c8cce46a40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:24.871405 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7cc0b-8ecd-4c82-925f-80c8cce46a40 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:24.882974 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1267/2561] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:24 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:44:24.883981 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7cc0b-8ecd-4c82-925f-80c8cce46a40 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:24.886524 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4ba7cc0b-8ecd-4c82-925f-80c8cce46a40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:24.902794 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7cc0b-8ecd-4c82-925f-80c8cce46a40 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:24.909214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f35435-de38-4b3c-ad41-6e2e9efaa11e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:24.910053 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f35435-de38-4b3c-ad41-6e2e9efaa11e service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:24.910439 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f35435-de38-4b3c-ad41-6e2e9efaa11e service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:24.910702 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f35435-de38-4b3c-ad41-6e2e9efaa11e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:24.924125 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f35435-de38-4b3c-ad41-6e2e9efaa11e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:24.925644 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f35435-de38-4b3c-ad41-6e2e9efaa11e service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:24.930449 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:24.940634 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1268/2562] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:24 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:24.943215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f35435-de38-4b3c-ad41-6e2e9efaa11e service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:24.953863 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f35435-de38-4b3c-ad41-6e2e9efaa11e service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:24.955134 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8845f8c-5744-4262-a08d-a712148ad39b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:24.957381 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8845f8c-5744-4262-a08d-a712148ad39b service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:24.958444 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6bf9e-69e9-4025-9a77-6635e0a44b26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:24.959093 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6bf9e-69e9-4025-9a77-6635e0a44b26 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:24.959377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6bf9e-69e9-4025-9a77-6635e0a44b26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:24.959656 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6bf9e-69e9-4025-9a77-6635e0a44b26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:24.961869 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c7a6bf9e-69e9-4025-9a77-6635e0a44b26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:24.967133 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1295/2563] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:25.108028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a6bf9e-69e9-4025-9a77-6635e0a44b26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:25.115011 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a6bf9e-69e9-4025-9a77-6635e0a44b26 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:25.135052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1269/2564] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:25.259372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8845f8c-5744-4262-a08d-a712148ad39b service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:25.274820 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8845f8c-5744-4262-a08d-a712148ad39b service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:25.285689 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc67ee-8920-4dfc-ad3b-721f232eb901 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:25.286754 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc67ee-8920-4dfc-ad3b-721f232eb901 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:25.286984 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc67ee-8920-4dfc-ad3b-721f232eb901 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:25.287261 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc67ee-8920-4dfc-ad3b-721f232eb901 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:25.422395 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:25.469057 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc67ee-8920-4dfc-ad3b-721f232eb901 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:25.470621 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc67ee-8920-4dfc-ad3b-721f232eb901 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:25.485646 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1296/2565] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:25 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:27.098393 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6bf9e-69e9-4025-9a77-6635e0a44b26 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:27.100831 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c7a6bf9e-69e9-4025-9a77-6635e0a44b26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:27.247333 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6bf9e-69e9-4025-9a77-6635e0a44b26 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:27.265246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa857839-ebd9-4ba8-821c-0b36a41abfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:27.266381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa857839-ebd9-4ba8-821c-0b36a41abfeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:27.267061 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa857839-ebd9-4ba8-821c-0b36a41abfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:27.267432 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa857839-ebd9-4ba8-821c-0b36a41abfeb admin admin] PATH_INFO: `/v3/users/4e88422338024035b5c64d2788965086` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:27.268706 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa857839-ebd9-4ba8-821c-0b36a41abfeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e88422338024035b5c64d2788965086)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:27.270960 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa857839-ebd9-4ba8-821c-0b36a41abfeb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:27.358981 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa857839-ebd9-4ba8-821c-0b36a41abfeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e88422338024035b5c64d2788965086'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:27.380660 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa857839-ebd9-4ba8-821c-0b36a41abfeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e88422338024035b5c64d2788965086'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:27.381808 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa857839-ebd9-4ba8-821c-0b36a41abfeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e88422338024035b5c64d2788965086'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:27.418299 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa857839-ebd9-4ba8-821c-0b36a41abfeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e88422338024035b5c64d2788965086'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:27.433860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa857839-ebd9-4ba8-821c-0b36a41abfeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e88422338024035b5c64d2788965086'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:27.441967 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1270/2566] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:44:27 2022] DELETE /identity/v3/users/4e88422338024035b5c64d2788965086 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:27.759909 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc67ee-8920-4dfc-ad3b-721f232eb901 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:27.774453 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc67ee-8920-4dfc-ad3b-721f232eb901 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:27.832661 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880978f8-4440-4587-86b5-55c37a60eaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:27.833036 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880978f8-4440-4587-86b5-55c37a60eaec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:27.833317 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880978f8-4440-4587-86b5-55c37a60eaec admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:27.833590 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880978f8-4440-4587-86b5-55c37a60eaec admin admin] PATH_INFO: `/v3/projects/39255fa001f44b29a23006adf9c1a10d` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:27.835262 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880978f8-4440-4587-86b5-55c37a60eaec admin admin] RBAC: Authorizing `identity:delete_project(project_id=39255fa001f44b29a23006adf9c1a10d)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:27.837201 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880978f8-4440-4587-86b5-55c37a60eaec admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:27.884794 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-880978f8-4440-4587-86b5-55c37a60eaec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39255fa001f44b29a23006adf9c1a10d', 'request_id': 'req-880978f8-4440-4587-86b5-55c37a60eaec'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:27.892714 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-880978f8-4440-4587-86b5-55c37a60eaec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39255fa001f44b29a23006adf9c1a10d', 'request_id': 'req-880978f8-4440-4587-86b5-55c37a60eaec'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:27.898677 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-880978f8-4440-4587-86b5-55c37a60eaec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39255fa001f44b29a23006adf9c1a10d', 'request_id': 'req-880978f8-4440-4587-86b5-55c37a60eaec'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:27.911448 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-880978f8-4440-4587-86b5-55c37a60eaec admin admin] The token cache is being invalidate because project 39255fa001f44b29a23006adf9c1a10d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:44:27.911745 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-880978f8-4440-4587-86b5-55c37a60eaec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:27.912459 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-880978f8-4440-4587-86b5-55c37a60eaec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:27.914105 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1297/2567] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:44:27 2022] DELETE /identity/v3/projects/39255fa001f44b29a23006adf9c1a10d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:27.919051 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95337c8e-3f86-4aa8-814c-44651d178752 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:27.919341 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95337c8e-3f86-4aa8-814c-44651d178752 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:27.919619 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95337c8e-3f86-4aa8-814c-44651d178752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:27.940068 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-95337c8e-3f86-4aa8-814c-44651d178752 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:27.941579 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-95337c8e-3f86-4aa8-814c-44651d178752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:27.952761 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:28.020065 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1271/2568] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:28.029937 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13eaad-19a1-4694-9230-52e1b7ef0b15 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:28.030417 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13eaad-19a1-4694-9230-52e1b7ef0b15 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:28.030802 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13eaad-19a1-4694-9230-52e1b7ef0b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:28.049913 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ac13eaad-19a1-4694-9230-52e1b7ef0b15 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:28.051338 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ac13eaad-19a1-4694-9230-52e1b7ef0b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:28.060116 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1298/2569] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:28.064482 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95337c8e-3f86-4aa8-814c-44651d178752 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:28.075482 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95337c8e-3f86-4aa8-814c-44651d178752 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:28.081785 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec14b36-0fc8-4b27-aafc-e4f23896b970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:28.082598 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec14b36-0fc8-4b27-aafc-e4f23896b970 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:28.082980 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec14b36-0fc8-4b27-aafc-e4f23896b970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:28.083629 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec14b36-0fc8-4b27-aafc-e4f23896b970 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:28.084365 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec14b36-0fc8-4b27-aafc-e4f23896b970 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:44:28.084863 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec14b36-0fc8-4b27-aafc-e4f23896b970 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:28.086748 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec14b36-0fc8-4b27-aafc-e4f23896b970 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:28.100830 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1272/2570] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:44:28.105857 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13eaad-19a1-4694-9230-52e1b7ef0b15 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:28.114859 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13eaad-19a1-4694-9230-52e1b7ef0b15 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:28.123741 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797707f-1b9a-4559-9488-73535aab2c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:28.124444 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797707f-1b9a-4559-9488-73535aab2c59 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:28.124732 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797707f-1b9a-4559-9488-73535aab2c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:28.125014 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797707f-1b9a-4559-9488-73535aab2c59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:28.125725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797707f-1b9a-4559-9488-73535aab2c59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:28.127677 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797707f-1b9a-4559-9488-73535aab2c59 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:28.154653 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1299/2571] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:44:28 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:44:28.158778 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec14b36-0fc8-4b27-aafc-e4f23896b970 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:28.169182 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec14b36-0fc8-4b27-aafc-e4f23896b970 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:28.230734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afa1fe-07b6-4192-a954-7ec93744c533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:28.231409 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afa1fe-07b6-4192-a954-7ec93744c533 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:28.231694 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afa1fe-07b6-4192-a954-7ec93744c533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:28.231976 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afa1fe-07b6-4192-a954-7ec93744c533 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:28.232718 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afa1fe-07b6-4192-a954-7ec93744c533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:28.234648 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afa1fe-07b6-4192-a954-7ec93744c533 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:28.259059 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1273/2572] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:44:28 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:28.260319 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797707f-1b9a-4559-9488-73535aab2c59 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:28.271516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797707f-1b9a-4559-9488-73535aab2c59 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:28.276820 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0584c58-cc78-475d-945f-d7077ba847e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:28.277483 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0584c58-cc78-475d-945f-d7077ba847e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:28.277775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0584c58-cc78-475d-945f-d7077ba847e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:28.278053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0584c58-cc78-475d-945f-d7077ba847e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:28.278781 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0584c58-cc78-475d-945f-d7077ba847e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:28.280427 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0584c58-cc78-475d-945f-d7077ba847e6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:28.293803 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1300/2573] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:28.297493 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afa1fe-07b6-4192-a954-7ec93744c533 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:28.308706 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afa1fe-07b6-4192-a954-7ec93744c533 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:28.313837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9f448-72ea-4faf-a146-7cdb149a6b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:28.314622 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9f448-72ea-4faf-a146-7cdb149a6b62 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:28.314913 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9f448-72ea-4faf-a146-7cdb149a6b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:28.315194 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9f448-72ea-4faf-a146-7cdb149a6b62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:28.315938 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9f448-72ea-4faf-a146-7cdb149a6b62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:28.317685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9f448-72ea-4faf-a146-7cdb149a6b62 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:28.329780 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1274/2574] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:28.334125 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0584c58-cc78-475d-945f-d7077ba847e6 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:28.344930 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0584c58-cc78-475d-945f-d7077ba847e6 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:28.350035 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bd581-2ce6-4777-b69d-6985026ddafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:28.350972 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bd581-2ce6-4777-b69d-6985026ddafb admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:28.351253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bd581-2ce6-4777-b69d-6985026ddafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:28.351534 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bd581-2ce6-4777-b69d-6985026ddafb admin admin] PATH_INFO: `/v3/projects/62b5d156601648f9a33d4f7b302f1670/users/09cd9d728c394f5aaabf238f3eaf250a/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:28.367752 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bd581-2ce6-4777-b69d-6985026ddafb admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b5d156601648f9a33d4f7b302f1670, user_id=09cd9d728c394f5aaabf238f3eaf250a, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:28.371151 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bd581-2ce6-4777-b69d-6985026ddafb admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:28.379635 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:28.387127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1301/2575] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:28 2022] PUT /identity/v3/projects/62b5d156601648f9a33d4f7b302f1670/users/09cd9d728c394f5aaabf238f3eaf250a/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:28.397761 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660eadb-b86e-4585-a5fd-38b236037d79 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:28.398061 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660eadb-b86e-4585-a5fd-38b236037d79 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:28.398350 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660eadb-b86e-4585-a5fd-38b236037d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:28.425031 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f660eadb-b86e-4585-a5fd-38b236037d79 None None] MFA Rules not processed for user `09cd9d728c394f5aaabf238f3eaf250a`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:28.426234 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f660eadb-b86e-4585-a5fd-38b236037d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:28.491006 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1275/2576] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:28.502294 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bd581-2ce6-4777-b69d-6985026ddafb admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:28.504016 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f49bd581-2ce6-4777-b69d-6985026ddafb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:28.576126 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bd581-2ce6-4777-b69d-6985026ddafb admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:28.581974 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596eb93-2c79-445a-a8ab-a272bc73adcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:28.582610 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596eb93-2c79-445a-a8ab-a272bc73adcb service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:28.582895 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596eb93-2c79-445a-a8ab-a272bc73adcb service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:28.583172 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596eb93-2c79-445a-a8ab-a272bc73adcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:28.591180 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596eb93-2c79-445a-a8ab-a272bc73adcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:28.592821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596eb93-2c79-445a-a8ab-a272bc73adcb service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:28.601450 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1302/2577] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:30.540013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660eadb-b86e-4585-a5fd-38b236037d79 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:30.541514 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f660eadb-b86e-4585-a5fd-38b236037d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:30.555437 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:30.612830 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660eadb-b86e-4585-a5fd-38b236037d79 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:30.618006 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a2682-88d4-48f4-b69d-3078d3d7fc39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24410ef5e78042c79c5b4a0d78b56258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:30.618653 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a2682-88d4-48f4-b69d-3078d3d7fc39 service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:30.618943 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a2682-88d4-48f4-b69d-3078d3d7fc39 service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:30.619236 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a2682-88d4-48f4-b69d-3078d3d7fc39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:30.621064 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c51a2682-88d4-48f4-b69d-3078d3d7fc39 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:30.632319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a2682-88d4-48f4-b69d-3078d3d7fc39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:30.633937 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a2682-88d4-48f4-b69d-3078d3d7fc39 service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:30.643739 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1276/2578] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:31.938037 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596eb93-2c79-445a-a8ab-a272bc73adcb service nova] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:31.939870 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a596eb93-2c79-445a-a8ab-a272bc73adcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:32.005240 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596eb93-2c79-445a-a8ab-a272bc73adcb service nova] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:32.009785 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03567845-bedc-410b-882d-28207d354284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:32.010689 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03567845-bedc-410b-882d-28207d354284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:32.010975 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03567845-bedc-410b-882d-28207d354284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:32.011252 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03567845-bedc-410b-882d-28207d354284 admin admin] PATH_INFO: `/v3/users/04573d548e3048f79cff9437a0cfd9f2` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:32.012480 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03567845-bedc-410b-882d-28207d354284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04573d548e3048f79cff9437a0cfd9f2)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:32.014395 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03567845-bedc-410b-882d-28207d354284 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:32.060380 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-03567845-bedc-410b-882d-28207d354284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04573d548e3048f79cff9437a0cfd9f2'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:32.067052 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-03567845-bedc-410b-882d-28207d354284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04573d548e3048f79cff9437a0cfd9f2'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:32.067708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-03567845-bedc-410b-882d-28207d354284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04573d548e3048f79cff9437a0cfd9f2'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:32.079680 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-03567845-bedc-410b-882d-28207d354284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04573d548e3048f79cff9437a0cfd9f2'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:32.086183 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-03567845-bedc-410b-882d-28207d354284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04573d548e3048f79cff9437a0cfd9f2'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:32.092523 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1303/2579] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:44:31 2022] DELETE /identity/v3/users/04573d548e3048f79cff9437a0cfd9f2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:32.096967 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbaa5fe-50a9-4e51-ac9f-993653b44d1b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:32.097500 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbaa5fe-50a9-4e51-ac9f-993653b44d1b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:32.097500 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbaa5fe-50a9-4e51-ac9f-993653b44d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:32.116117 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-efbaa5fe-50a9-4e51-ac9f-993653b44d1b None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:32.117334 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-efbaa5fe-50a9-4e51-ac9f-993653b44d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:32.179342 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1277/2580] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:32.189464 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03567845-bedc-410b-882d-28207d354284 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:32.190892 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-03567845-bedc-410b-882d-28207d354284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:32.196480 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:32.268967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03567845-bedc-410b-882d-28207d354284 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:32.277056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f11a4d-1309-4c34-9ac1-fc7fcdb69ed0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:32.277735 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f11a4d-1309-4c34-9ac1-fc7fcdb69ed0 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:32.278022 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f11a4d-1309-4c34-9ac1-fc7fcdb69ed0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:32.278306 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f11a4d-1309-4c34-9ac1-fc7fcdb69ed0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:32.289553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f11a4d-1309-4c34-9ac1-fc7fcdb69ed0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:32.291177 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f11a4d-1309-4c34-9ac1-fc7fcdb69ed0 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:32.307543 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1304/2581] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:32.585367 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbaa5fe-50a9-4e51-ac9f-993653b44d1b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:32.587298 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-efbaa5fe-50a9-4e51-ac9f-993653b44d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:32.600828 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbaa5fe-50a9-4e51-ac9f-993653b44d1b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:32.608521 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cca530-613c-41e1-bb83-bc767aeb020f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:32.609492 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cca530-613c-41e1-bb83-bc767aeb020f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:32.609891 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cca530-613c-41e1-bb83-bc767aeb020f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:32.610247 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cca530-613c-41e1-bb83-bc767aeb020f admin admin] PATH_INFO: `/v3/projects/73f7af6b497c49c38a44eb779f95d600` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:32.615415 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cca530-613c-41e1-bb83-bc767aeb020f admin admin] RBAC: Authorizing `identity:delete_project(project_id=73f7af6b497c49c38a44eb779f95d600)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:32.617399 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cca530-613c-41e1-bb83-bc767aeb020f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:32.673251 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-64cca530-613c-41e1-bb83-bc767aeb020f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73f7af6b497c49c38a44eb779f95d600', 'request_id': 'req-64cca530-613c-41e1-bb83-bc767aeb020f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:32.679248 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-64cca530-613c-41e1-bb83-bc767aeb020f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73f7af6b497c49c38a44eb779f95d600', 'request_id': 'req-64cca530-613c-41e1-bb83-bc767aeb020f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:32.688056 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-64cca530-613c-41e1-bb83-bc767aeb020f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73f7af6b497c49c38a44eb779f95d600', 'request_id': 'req-64cca530-613c-41e1-bb83-bc767aeb020f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:32.701461 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-64cca530-613c-41e1-bb83-bc767aeb020f admin admin] The token cache is being invalidate because project 73f7af6b497c49c38a44eb779f95d600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:44:32.702010 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-64cca530-613c-41e1-bb83-bc767aeb020f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:32.702683 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-64cca530-613c-41e1-bb83-bc767aeb020f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:32.704280 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1278/2582] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:44:32 2022] DELETE /identity/v3/projects/73f7af6b497c49c38a44eb779f95d600 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:32.708237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f11a4d-1309-4c34-9ac1-fc7fcdb69ed0 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:32.718362 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f11a4d-1309-4c34-9ac1-fc7fcdb69ed0 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:32.773874 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8aa56-6fc3-43b5-b3d9-8a8e6319ba53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:32.774726 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8aa56-6fc3-43b5-b3d9-8a8e6319ba53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:32.775007 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8aa56-6fc3-43b5-b3d9-8a8e6319ba53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:32.775281 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8aa56-6fc3-43b5-b3d9-8a8e6319ba53 admin admin] PATH_INFO: `/v3/users/0f9b2d9c2c754215ba782e69a605c150` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:32.777156 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8aa56-6fc3-43b5-b3d9-8a8e6319ba53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f9b2d9c2c754215ba782e69a605c150)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:32.779080 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8aa56-6fc3-43b5-b3d9-8a8e6319ba53 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:32.822759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-09a8aa56-6fc3-43b5-b3d9-8a8e6319ba53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f9b2d9c2c754215ba782e69a605c150'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:32.830488 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-09a8aa56-6fc3-43b5-b3d9-8a8e6319ba53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f9b2d9c2c754215ba782e69a605c150'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:32.831311 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-09a8aa56-6fc3-43b5-b3d9-8a8e6319ba53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f9b2d9c2c754215ba782e69a605c150'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:32.842900 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-09a8aa56-6fc3-43b5-b3d9-8a8e6319ba53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f9b2d9c2c754215ba782e69a605c150'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:32.849961 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-09a8aa56-6fc3-43b5-b3d9-8a8e6319ba53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f9b2d9c2c754215ba782e69a605c150'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:32.858082 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1305/2583] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:44:32 2022] DELETE /identity/v3/users/0f9b2d9c2c754215ba782e69a605c150 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:33.122460 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cca530-613c-41e1-bb83-bc767aeb020f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:33.124003 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-64cca530-613c-41e1-bb83-bc767aeb020f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:33.141882 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cca530-613c-41e1-bb83-bc767aeb020f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:33.167738 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:33.206766 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46446c1d-98de-4ed0-a21c-b11521cbfbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:33.207653 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46446c1d-98de-4ed0-a21c-b11521cbfbeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:33.208068 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46446c1d-98de-4ed0-a21c-b11521cbfbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:33.208386 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46446c1d-98de-4ed0-a21c-b11521cbfbeb admin admin] PATH_INFO: `/v3/projects/3622e17812fd4d5a8f995e131b76522b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:33.209573 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46446c1d-98de-4ed0-a21c-b11521cbfbeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3622e17812fd4d5a8f995e131b76522b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:33.211473 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46446c1d-98de-4ed0-a21c-b11521cbfbeb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:33.256422 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-46446c1d-98de-4ed0-a21c-b11521cbfbeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3622e17812fd4d5a8f995e131b76522b', 'request_id': 'req-46446c1d-98de-4ed0-a21c-b11521cbfbeb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:33.261787 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-46446c1d-98de-4ed0-a21c-b11521cbfbeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3622e17812fd4d5a8f995e131b76522b', 'request_id': 'req-46446c1d-98de-4ed0-a21c-b11521cbfbeb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:33.268749 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-46446c1d-98de-4ed0-a21c-b11521cbfbeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3622e17812fd4d5a8f995e131b76522b', 'request_id': 'req-46446c1d-98de-4ed0-a21c-b11521cbfbeb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:33.279386 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-46446c1d-98de-4ed0-a21c-b11521cbfbeb admin admin] The token cache is being invalidate because project 3622e17812fd4d5a8f995e131b76522b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:44:33.279675 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-46446c1d-98de-4ed0-a21c-b11521cbfbeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:33.280324 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-46446c1d-98de-4ed0-a21c-b11521cbfbeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:33.281840 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1279/2584] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:44:33 2022] DELETE /identity/v3/projects/3622e17812fd4d5a8f995e131b76522b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:33.285744 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8aa56-6fc3-43b5-b3d9-8a8e6319ba53 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:33.287153 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-09a8aa56-6fc3-43b5-b3d9-8a8e6319ba53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:33.300190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8aa56-6fc3-43b5-b3d9-8a8e6319ba53 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:33.321186 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:33.366681 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c661a9-f915-48c9-9893-c799206f75c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:33.367583 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c661a9-f915-48c9-9893-c799206f75c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:33.367872 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c661a9-f915-48c9-9893-c799206f75c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:33.368148 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c661a9-f915-48c9-9893-c799206f75c2 admin admin] PATH_INFO: `/v3/users/902312bfb3a54a278647605af2b6434c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:33.369374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c661a9-f915-48c9-9893-c799206f75c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=902312bfb3a54a278647605af2b6434c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:33.371974 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c661a9-f915-48c9-9893-c799206f75c2 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:33.422490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-23c661a9-f915-48c9-9893-c799206f75c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '902312bfb3a54a278647605af2b6434c'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:33.429438 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-23c661a9-f915-48c9-9893-c799206f75c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '902312bfb3a54a278647605af2b6434c'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:33.430123 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-23c661a9-f915-48c9-9893-c799206f75c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '902312bfb3a54a278647605af2b6434c'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:33.445458 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-23c661a9-f915-48c9-9893-c799206f75c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '902312bfb3a54a278647605af2b6434c'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:33.458950 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-23c661a9-f915-48c9-9893-c799206f75c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '902312bfb3a54a278647605af2b6434c'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:33.465172 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1306/2585] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:44:33 2022] DELETE /identity/v3/users/902312bfb3a54a278647605af2b6434c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:33.732722 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46446c1d-98de-4ed0-a21c-b11521cbfbeb admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:33.734199 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-46446c1d-98de-4ed0-a21c-b11521cbfbeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:33.746985 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46446c1d-98de-4ed0-a21c-b11521cbfbeb admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:33.803816 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcbd81-c869-4d54-be54-ce9127c7dfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:33.804702 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcbd81-c869-4d54-be54-ce9127c7dfb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:33.804985 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcbd81-c869-4d54-be54-ce9127c7dfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:33.805258 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcbd81-c869-4d54-be54-ce9127c7dfb1 admin admin] PATH_INFO: `/v3/projects/d5d6541db6b44f56ae0504fd05cc0343` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:33.806478 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dcbd81-c869-4d54-be54-ce9127c7dfb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5d6541db6b44f56ae0504fd05cc0343)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:33.808477 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dcbd81-c869-4d54-be54-ce9127c7dfb1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:33.855797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d2dcbd81-c869-4d54-be54-ce9127c7dfb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5d6541db6b44f56ae0504fd05cc0343', 'request_id': 'req-d2dcbd81-c869-4d54-be54-ce9127c7dfb1'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:33.860280 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:33.861548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d2dcbd81-c869-4d54-be54-ce9127c7dfb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5d6541db6b44f56ae0504fd05cc0343', 'request_id': 'req-d2dcbd81-c869-4d54-be54-ce9127c7dfb1'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:33.869585 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d2dcbd81-c869-4d54-be54-ce9127c7dfb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5d6541db6b44f56ae0504fd05cc0343', 'request_id': 'req-d2dcbd81-c869-4d54-be54-ce9127c7dfb1'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:33.880767 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d2dcbd81-c869-4d54-be54-ce9127c7dfb1 admin admin] The token cache is being invalidate because project d5d6541db6b44f56ae0504fd05cc0343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:44:33.881058 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d2dcbd81-c869-4d54-be54-ce9127c7dfb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:33.881686 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d2dcbd81-c869-4d54-be54-ce9127c7dfb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:33.883234 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1280/2586] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:44:33 2022] DELETE /identity/v3/projects/d5d6541db6b44f56ae0504fd05cc0343 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:33.889672 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fe8ad-1c82-425e-9df8-e513ba9d1b48 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:33.889967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fe8ad-1c82-425e-9df8-e513ba9d1b48 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:33.890248 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fe8ad-1c82-425e-9df8-e513ba9d1b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:33.909512 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e07fe8ad-1c82-425e-9df8-e513ba9d1b48 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:33.910720 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e07fe8ad-1c82-425e-9df8-e513ba9d1b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:33.971207 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1307/2587] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:44:33.979280 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f2ee4-e8a3-4cf7-a322-03870b29b875 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:33.979567 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f2ee4-e8a3-4cf7-a322-03870b29b875 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:33.979841 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f2ee4-e8a3-4cf7-a322-03870b29b875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:33.998906 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3f9f2ee4-e8a3-4cf7-a322-03870b29b875 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:34.000095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3f9f2ee4-e8a3-4cf7-a322-03870b29b875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:34.008227 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1281/2588] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:34.012898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fe8ad-1c82-425e-9df8-e513ba9d1b48 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:34.022711 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fe8ad-1c82-425e-9df8-e513ba9d1b48 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:34.027974 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd95de-1d8c-4d5e-925a-86b4095b6ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:34.028652 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd95de-1d8c-4d5e-925a-86b4095b6ccd admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:34.028941 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd95de-1d8c-4d5e-925a-86b4095b6ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:34.029221 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd95de-1d8c-4d5e-925a-86b4095b6ccd admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:34.029976 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd95de-1d8c-4d5e-925a-86b4095b6ccd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:44:34.030288 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd95de-1d8c-4d5e-925a-86b4095b6ccd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:34.031918 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd95de-1d8c-4d5e-925a-86b4095b6ccd admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:34.043433 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1308/2589] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:44:34.047757 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f2ee4-e8a3-4cf7-a322-03870b29b875 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:34.056935 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f2ee4-e8a3-4cf7-a322-03870b29b875 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:34.061738 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd4d77-fbe7-42df-93fb-e7d249a88d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:34.062697 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd4d77-fbe7-42df-93fb-e7d249a88d83 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:34.062697 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd4d77-fbe7-42df-93fb-e7d249a88d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:34.062899 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd4d77-fbe7-42df-93fb-e7d249a88d83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:34.063607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd4d77-fbe7-42df-93fb-e7d249a88d83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:34.065570 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd4d77-fbe7-42df-93fb-e7d249a88d83 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:34.095118 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1282/2590] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:44:34 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:44:34.096334 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd95de-1d8c-4d5e-925a-86b4095b6ccd admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:34.106354 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd95de-1d8c-4d5e-925a-86b4095b6ccd admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:34.137505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:34.170688 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f690bfa-53e9-4ee1-b286-8061e50a19ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:34.171367 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f690bfa-53e9-4ee1-b286-8061e50a19ce admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:34.171657 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f690bfa-53e9-4ee1-b286-8061e50a19ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:34.171968 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f690bfa-53e9-4ee1-b286-8061e50a19ce admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:34.172702 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f690bfa-53e9-4ee1-b286-8061e50a19ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:34.174671 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f690bfa-53e9-4ee1-b286-8061e50a19ce admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:34.195268 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1309/2591] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:44:34 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:34.199966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd4d77-fbe7-42df-93fb-e7d249a88d83 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:34.210541 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd4d77-fbe7-42df-93fb-e7d249a88d83 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:34.215707 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725670b-4692-4af8-9a19-a514a7cb5575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:34.216402 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725670b-4692-4af8-9a19-a514a7cb5575 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:34.216692 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725670b-4692-4af8-9a19-a514a7cb5575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:34.216976 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725670b-4692-4af8-9a19-a514a7cb5575 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:34.217694 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725670b-4692-4af8-9a19-a514a7cb5575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:34.219300 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725670b-4692-4af8-9a19-a514a7cb5575 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:34.229794 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1283/2592] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:34.233750 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f690bfa-53e9-4ee1-b286-8061e50a19ce admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:34.243530 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f690bfa-53e9-4ee1-b286-8061e50a19ce admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:34.248112 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540ecea-4e02-486f-822e-c0a9503995b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:34.248792 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540ecea-4e02-486f-822e-c0a9503995b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:34.249077 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540ecea-4e02-486f-822e-c0a9503995b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:34.249348 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540ecea-4e02-486f-822e-c0a9503995b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:34.250068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8540ecea-4e02-486f-822e-c0a9503995b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:34.251638 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8540ecea-4e02-486f-822e-c0a9503995b2 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:34.262120 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1310/2593] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:34.266262 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725670b-4692-4af8-9a19-a514a7cb5575 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:34.276963 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725670b-4692-4af8-9a19-a514a7cb5575 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:34.281802 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3235d-96cb-454a-aabc-6150cee9599d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:34.282651 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3235d-96cb-454a-aabc-6150cee9599d admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:34.282928 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3235d-96cb-454a-aabc-6150cee9599d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:34.283198 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3235d-96cb-454a-aabc-6150cee9599d admin admin] PATH_INFO: `/v3/projects/50b8f674367c4d8bac926db99099da5f/users/e17d78545203486280ac21fdd3ecbcfb/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:34.297390 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3235d-96cb-454a-aabc-6150cee9599d admin admin] RBAC: Authorizing `identity:create_grant(project_id=50b8f674367c4d8bac926db99099da5f, user_id=e17d78545203486280ac21fdd3ecbcfb, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:34.300009 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3235d-96cb-454a-aabc-6150cee9599d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:34.314387 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1284/2594] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:34 2022] PUT /identity/v3/projects/50b8f674367c4d8bac926db99099da5f/users/e17d78545203486280ac21fdd3ecbcfb/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:44:34.327225 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148714b-64b7-4b2e-b95a-ad5f9408b086 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:34.327720 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148714b-64b7-4b2e-b95a-ad5f9408b086 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:34.327841 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148714b-64b7-4b2e-b95a-ad5f9408b086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:34.353250 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-3148714b-64b7-4b2e-b95a-ad5f9408b086 None None] MFA Rules not processed for user `e17d78545203486280ac21fdd3ecbcfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:34.354463 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-3148714b-64b7-4b2e-b95a-ad5f9408b086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:34.417692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1311/2595] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:34.422067 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3235d-96cb-454a-aabc-6150cee9599d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:34.483813 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3235d-96cb-454a-aabc-6150cee9599d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:34.488612 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cac805-e368-46ac-b854-5f01b7afde86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:34.489269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cac805-e368-46ac-b854-5f01b7afde86 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:34.489548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cac805-e368-46ac-b854-5f01b7afde86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:34.489821 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cac805-e368-46ac-b854-5f01b7afde86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:34.490519 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cac805-e368-46ac-b854-5f01b7afde86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:34.492559 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cac805-e368-46ac-b854-5f01b7afde86 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:34.519538 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1285/2596] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:44:34 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:34.525217 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148714b-64b7-4b2e-b95a-ad5f9408b086 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:34.535836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148714b-64b7-4b2e-b95a-ad5f9408b086 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:34.598485 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8d226-ae2e-4731-b271-1c7cfb9d2aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:34.599153 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8d226-ae2e-4731-b271-1c7cfb9d2aae admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:34.599441 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8d226-ae2e-4731-b271-1c7cfb9d2aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:34.599719 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8d226-ae2e-4731-b271-1c7cfb9d2aae admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:34.600450 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8d226-ae2e-4731-b271-1c7cfb9d2aae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:34.602358 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8d226-ae2e-4731-b271-1c7cfb9d2aae admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:34.625708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1312/2597] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:44:34 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:34.629901 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cac805-e368-46ac-b854-5f01b7afde86 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:34.640965 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cac805-e368-46ac-b854-5f01b7afde86 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:34.645665 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e396256-ca0c-4743-8a71-4f8409f8934c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:34.646364 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e396256-ca0c-4743-8a71-4f8409f8934c admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:34.646650 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e396256-ca0c-4743-8a71-4f8409f8934c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:34.646928 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e396256-ca0c-4743-8a71-4f8409f8934c admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:34.647706 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e396256-ca0c-4743-8a71-4f8409f8934c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:34.649369 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e396256-ca0c-4743-8a71-4f8409f8934c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:34.664250 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1286/2598] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:34.665179 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8d226-ae2e-4731-b271-1c7cfb9d2aae admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:34.675783 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8d226-ae2e-4731-b271-1c7cfb9d2aae admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:34.680609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56c5f2-6017-432c-a583-a39b66a595c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:34.681488 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56c5f2-6017-432c-a583-a39b66a595c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:34.681770 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56c5f2-6017-432c-a583-a39b66a595c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:34.682070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56c5f2-6017-432c-a583-a39b66a595c9 admin admin] PATH_INFO: `/v3/projects/5f782d7dbc7a4ec580aac0879e8ebc99/users/9783f192d2fc4750a587640c83d96c79/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:34.698056 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56c5f2-6017-432c-a583-a39b66a595c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f782d7dbc7a4ec580aac0879e8ebc99, user_id=9783f192d2fc4750a587640c83d96c79, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:34.700756 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56c5f2-6017-432c-a583-a39b66a595c9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:34.715840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1313/2599] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:34 2022] PUT /identity/v3/projects/5f782d7dbc7a4ec580aac0879e8ebc99/users/9783f192d2fc4750a587640c83d96c79/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:44:34.719721 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e396256-ca0c-4743-8a71-4f8409f8934c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:34.730246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e396256-ca0c-4743-8a71-4f8409f8934c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:34.782269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:34.789983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea9ea5-8f1f-4b2d-95f2-1a2b71968391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:34.791091 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea9ea5-8f1f-4b2d-95f2-1a2b71968391 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:34.792805 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea9ea5-8f1f-4b2d-95f2-1a2b71968391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:34.793375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea9ea5-8f1f-4b2d-95f2-1a2b71968391 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:34.794222 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea9ea5-8f1f-4b2d-95f2-1a2b71968391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:34.796465 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea9ea5-8f1f-4b2d-95f2-1a2b71968391 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:34.806733 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1287/2600] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:34.811577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56c5f2-6017-432c-a583-a39b66a595c9 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:34.818414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:34.823266 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56c5f2-6017-432c-a583-a39b66a595c9 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:34.829859 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e84bf-9cab-41fb-8175-edc2fdb93b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:34.830744 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e84bf-9cab-41fb-8175-edc2fdb93b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:34.831093 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e84bf-9cab-41fb-8175-edc2fdb93b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:34.831328 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e84bf-9cab-41fb-8175-edc2fdb93b91 admin admin] PATH_INFO: `/v3/projects/5f782d7dbc7a4ec580aac0879e8ebc99/users/9783f192d2fc4750a587640c83d96c79/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:34.833438 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e84bf-9cab-41fb-8175-edc2fdb93b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f782d7dbc7a4ec580aac0879e8ebc99, user_id=9783f192d2fc4750a587640c83d96c79, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:34.836358 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e84bf-9cab-41fb-8175-edc2fdb93b91 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:34.847234 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1314/2601] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:34 2022] PUT /identity/v3/projects/5f782d7dbc7a4ec580aac0879e8ebc99/users/9783f192d2fc4750a587640c83d96c79/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:34.858000 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037718cc-90c3-4be4-95ab-a6bd987e3bb7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:34.858317 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037718cc-90c3-4be4-95ab-a6bd987e3bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:34.858595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037718cc-90c3-4be4-95ab-a6bd987e3bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:34.887251 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-037718cc-90c3-4be4-95ab-a6bd987e3bb7 None None] MFA Rules not processed for user `9783f192d2fc4750a587640c83d96c79`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:34.888506 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-037718cc-90c3-4be4-95ab-a6bd987e3bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:34.959520 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1288/2602] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:34 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:34.970975 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e84bf-9cab-41fb-8175-edc2fdb93b91 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:34.972756 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f49e84bf-9cab-41fb-8175-edc2fdb93b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:35.034073 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e84bf-9cab-41fb-8175-edc2fdb93b91 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:35.037730 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a6645-5d8b-4150-8c9e-8feb48292e80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:35.038370 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a6645-5d8b-4150-8c9e-8feb48292e80 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:35.038655 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a6645-5d8b-4150-8c9e-8feb48292e80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:35.038933 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a6645-5d8b-4150-8c9e-8feb48292e80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:35.048357 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a6645-5d8b-4150-8c9e-8feb48292e80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:35.049781 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a6645-5d8b-4150-8c9e-8feb48292e80 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:35.059002 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1315/2603] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:34 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:44:35.135651 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037718cc-90c3-4be4-95ab-a6bd987e3bb7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:35.145316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037718cc-90c3-4be4-95ab-a6bd987e3bb7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:35.148927 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3beaf-3430-4b1e-b7f3-ce6aa6b17245 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:35.149561 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3beaf-3430-4b1e-b7f3-ce6aa6b17245 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:35.149846 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3beaf-3430-4b1e-b7f3-ce6aa6b17245 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:35.150123 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3beaf-3430-4b1e-b7f3-ce6aa6b17245 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:35.206087 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3beaf-3430-4b1e-b7f3-ce6aa6b17245 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:35.207537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3beaf-3430-4b1e-b7f3-ce6aa6b17245 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:35.216973 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1289/2604] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:35 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:38.746781 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a6645-5d8b-4150-8c9e-8feb48292e80 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:38.748258 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-610a6645-5d8b-4150-8c9e-8feb48292e80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:38.812159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a6645-5d8b-4150-8c9e-8feb48292e80 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:38.816713 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf6121-4003-4b55-9509-68aeae8fe9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:38.817571 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf6121-4003-4b55-9509-68aeae8fe9af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:38.817855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf6121-4003-4b55-9509-68aeae8fe9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:38.818131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf6121-4003-4b55-9509-68aeae8fe9af admin admin] PATH_INFO: `/v3/users/78475e4866444fd2a273e35d4a287052` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:38.819326 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf6121-4003-4b55-9509-68aeae8fe9af admin admin] RBAC: Authorizing `identity:delete_user(user_id=78475e4866444fd2a273e35d4a287052)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:38.821277 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf6121-4003-4b55-9509-68aeae8fe9af admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:38.866630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c2bf6121-4003-4b55-9509-68aeae8fe9af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78475e4866444fd2a273e35d4a287052'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:38.874789 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c2bf6121-4003-4b55-9509-68aeae8fe9af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78475e4866444fd2a273e35d4a287052'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:38.875457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c2bf6121-4003-4b55-9509-68aeae8fe9af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78475e4866444fd2a273e35d4a287052'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:38.887490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c2bf6121-4003-4b55-9509-68aeae8fe9af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78475e4866444fd2a273e35d4a287052'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:38.894867 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-c2bf6121-4003-4b55-9509-68aeae8fe9af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78475e4866444fd2a273e35d4a287052'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:38.901138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1316/2605] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:44:38 2022] DELETE /identity/v3/users/78475e4866444fd2a273e35d4a287052 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:38.905658 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856c503-0833-491f-9bce-894c7d753ed4 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:38.906109 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856c503-0833-491f-9bce-894c7d753ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:38.906216 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856c503-0833-491f-9bce-894c7d753ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:38.923597 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c856c503-0833-491f-9bce-894c7d753ed4 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:38.924827 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c856c503-0833-491f-9bce-894c7d753ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:39.006093 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1290/2606] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:44:39.020725 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf6121-4003-4b55-9509-68aeae8fe9af admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:39.029673 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c2bf6121-4003-4b55-9509-68aeae8fe9af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:39.048693 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:39.140786 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf6121-4003-4b55-9509-68aeae8fe9af admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:39.144510 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d67fb8-52ac-432f-aab0-a86714eb4dcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:39.145443 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d67fb8-52ac-432f-aab0-a86714eb4dcb service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:39.145741 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d67fb8-52ac-432f-aab0-a86714eb4dcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:39.146308 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d67fb8-52ac-432f-aab0-a86714eb4dcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:39.164138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d67fb8-52ac-432f-aab0-a86714eb4dcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:39.164138 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d67fb8-52ac-432f-aab0-a86714eb4dcb service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:39.172521 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1317/2607] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:39.321501 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856c503-0833-491f-9bce-894c7d753ed4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:39.322490 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d67fb8-52ac-432f-aab0-a86714eb4dcb service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:39.323102 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c856c503-0833-491f-9bce-894c7d753ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:39.324789 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f3d67fb8-52ac-432f-aab0-a86714eb4dcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:39.342918 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d67fb8-52ac-432f-aab0-a86714eb4dcb service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:39.348000 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb94de3-14b9-46b4-a4ae-13bd3d9e6382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:39.349857 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb94de3-14b9-46b4-a4ae-13bd3d9e6382 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:39.350366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb94de3-14b9-46b4-a4ae-13bd3d9e6382 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:39.350922 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb94de3-14b9-46b4-a4ae-13bd3d9e6382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:39.352595 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856c503-0833-491f-9bce-894c7d753ed4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:39.353519 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ddb94de3-14b9-46b4-a4ae-13bd3d9e6382 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:39.373450 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e77ed-b71f-449f-bcf1-5c2ea1f7b7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:39.374353 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e77ed-b71f-449f-bcf1-5c2ea1f7b7f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:39.374694 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e77ed-b71f-449f-bcf1-5c2ea1f7b7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:39.374896 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e77ed-b71f-449f-bcf1-5c2ea1f7b7f0 admin admin] PATH_INFO: `/v3/users/09cd9d728c394f5aaabf238f3eaf250a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:39.375043 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb94de3-14b9-46b4-a4ae-13bd3d9e6382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:39.379105 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb94de3-14b9-46b4-a4ae-13bd3d9e6382 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:39.379307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e77ed-b71f-449f-bcf1-5c2ea1f7b7f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09cd9d728c394f5aaabf238f3eaf250a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:39.382644 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e77ed-b71f-449f-bcf1-5c2ea1f7b7f0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:39.400237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1318/2608] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:44:39.414223 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:39.519329 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-782e77ed-b71f-449f-bcf1-5c2ea1f7b7f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09cd9d728c394f5aaabf238f3eaf250a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:39.528617 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-782e77ed-b71f-449f-bcf1-5c2ea1f7b7f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09cd9d728c394f5aaabf238f3eaf250a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:39.529751 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-782e77ed-b71f-449f-bcf1-5c2ea1f7b7f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09cd9d728c394f5aaabf238f3eaf250a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:39.546629 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-782e77ed-b71f-449f-bcf1-5c2ea1f7b7f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09cd9d728c394f5aaabf238f3eaf250a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:39.555210 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-782e77ed-b71f-449f-bcf1-5c2ea1f7b7f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09cd9d728c394f5aaabf238f3eaf250a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:39.562887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1291/2609] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:44:39 2022] DELETE /identity/v3/users/09cd9d728c394f5aaabf238f3eaf250a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:39.568323 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebdccb-ebf9-4956-95f8-8cbc17441ed6 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:39.568735 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebdccb-ebf9-4956-95f8-8cbc17441ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:39.568935 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebdccb-ebf9-4956-95f8-8cbc17441ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:39.593946 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-61ebdccb-ebf9-4956-95f8-8cbc17441ed6 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:39.595338 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-61ebdccb-ebf9-4956-95f8-8cbc17441ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:39.676792 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1319/2610] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:44:39.687403 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e77ed-b71f-449f-bcf1-5c2ea1f7b7f0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:39.688865 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-782e77ed-b71f-449f-bcf1-5c2ea1f7b7f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:39.768687 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e77ed-b71f-449f-bcf1-5c2ea1f7b7f0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:39.778598 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebdccb-ebf9-4956-95f8-8cbc17441ed6 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:39.781925 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b041628-bb2e-46e5-99c7-bba6c84b702f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:39.783459 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b041628-bb2e-46e5-99c7-bba6c84b702f service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:39.783961 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b041628-bb2e-46e5-99c7-bba6c84b702f service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:39.784611 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b041628-bb2e-46e5-99c7-bba6c84b702f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:39.785599 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-61ebdccb-ebf9-4956-95f8-8cbc17441ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:39.803330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b041628-bb2e-46e5-99c7-bba6c84b702f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:39.804026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebdccb-ebf9-4956-95f8-8cbc17441ed6 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:39.805935 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b041628-bb2e-46e5-99c7-bba6c84b702f service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:39.809620 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e05ea0-7ecc-42d9-8e25-6ead0fc3a855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:39.810698 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e05ea0-7ecc-42d9-8e25-6ead0fc3a855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:39.810985 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e05ea0-7ecc-42d9-8e25-6ead0fc3a855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:39.811301 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e05ea0-7ecc-42d9-8e25-6ead0fc3a855 admin admin] PATH_INFO: `/v3/projects/f05ef28e9bef4f188bd66f5de5d4115b` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:39.812586 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e05ea0-7ecc-42d9-8e25-6ead0fc3a855 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f05ef28e9bef4f188bd66f5de5d4115b)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:39.814681 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e05ea0-7ecc-42d9-8e25-6ead0fc3a855 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:39.833911 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1292/2611] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:39.878892 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-50e05ea0-7ecc-42d9-8e25-6ead0fc3a855 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f05ef28e9bef4f188bd66f5de5d4115b', 'request_id': 'req-50e05ea0-7ecc-42d9-8e25-6ead0fc3a855'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:39.889356 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-50e05ea0-7ecc-42d9-8e25-6ead0fc3a855 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f05ef28e9bef4f188bd66f5de5d4115b', 'request_id': 'req-50e05ea0-7ecc-42d9-8e25-6ead0fc3a855'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:39.900657 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-50e05ea0-7ecc-42d9-8e25-6ead0fc3a855 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f05ef28e9bef4f188bd66f5de5d4115b', 'request_id': 'req-50e05ea0-7ecc-42d9-8e25-6ead0fc3a855'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:39.915424 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-50e05ea0-7ecc-42d9-8e25-6ead0fc3a855 admin admin] The token cache is being invalidate because project f05ef28e9bef4f188bd66f5de5d4115b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:44:39.915812 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-50e05ea0-7ecc-42d9-8e25-6ead0fc3a855 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:39.917346 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-50e05ea0-7ecc-42d9-8e25-6ead0fc3a855 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:39.919920 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1320/2612] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:44:39 2022] DELETE /identity/v3/projects/f05ef28e9bef4f188bd66f5de5d4115b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:44:39.927101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b041628-bb2e-46e5-99c7-bba6c84b702f service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:39.945862 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b041628-bb2e-46e5-99c7-bba6c84b702f service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:40.031217 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789c800-07aa-4c8a-9a2b-dacd8a674fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:40.032632 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789c800-07aa-4c8a-9a2b-dacd8a674fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:40.032972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789c800-07aa-4c8a-9a2b-dacd8a674fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:40.033804 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789c800-07aa-4c8a-9a2b-dacd8a674fff admin admin] PATH_INFO: `/v3/users/9ba53344621148d1a390a9d952bd55d8` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:40.035268 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0789c800-07aa-4c8a-9a2b-dacd8a674fff admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ba53344621148d1a390a9d952bd55d8)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:40.037833 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0789c800-07aa-4c8a-9a2b-dacd8a674fff admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:40.094792 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:40.119590 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0789c800-07aa-4c8a-9a2b-dacd8a674fff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ba53344621148d1a390a9d952bd55d8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:40.128820 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0789c800-07aa-4c8a-9a2b-dacd8a674fff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ba53344621148d1a390a9d952bd55d8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:40.129623 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0789c800-07aa-4c8a-9a2b-dacd8a674fff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ba53344621148d1a390a9d952bd55d8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:40.146030 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0789c800-07aa-4c8a-9a2b-dacd8a674fff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ba53344621148d1a390a9d952bd55d8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:40.159852 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0789c800-07aa-4c8a-9a2b-dacd8a674fff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ba53344621148d1a390a9d952bd55d8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:40.173714 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1293/2613] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:44:39 2022] DELETE /identity/v3/users/9ba53344621148d1a390a9d952bd55d8 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:40.217781 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e05ea0-7ecc-42d9-8e25-6ead0fc3a855 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:40.228271 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-50e05ea0-7ecc-42d9-8e25-6ead0fc3a855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:40.279230 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e05ea0-7ecc-42d9-8e25-6ead0fc3a855 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:40.349937 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:40.393606 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90417ae-0f02-4f11-870d-45e91bfd8fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:40.394910 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90417ae-0f02-4f11-870d-45e91bfd8fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:40.395580 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90417ae-0f02-4f11-870d-45e91bfd8fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:40.395932 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90417ae-0f02-4f11-870d-45e91bfd8fd9 admin admin] PATH_INFO: `/v3/projects/62b5d156601648f9a33d4f7b302f1670` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:40.398264 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90417ae-0f02-4f11-870d-45e91bfd8fd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62b5d156601648f9a33d4f7b302f1670)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:40.402865 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90417ae-0f02-4f11-870d-45e91bfd8fd9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:40.464827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b90417ae-0f02-4f11-870d-45e91bfd8fd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62b5d156601648f9a33d4f7b302f1670', 'request_id': 'req-b90417ae-0f02-4f11-870d-45e91bfd8fd9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:40.474727 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b90417ae-0f02-4f11-870d-45e91bfd8fd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62b5d156601648f9a33d4f7b302f1670', 'request_id': 'req-b90417ae-0f02-4f11-870d-45e91bfd8fd9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:40.481430 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b90417ae-0f02-4f11-870d-45e91bfd8fd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62b5d156601648f9a33d4f7b302f1670', 'request_id': 'req-b90417ae-0f02-4f11-870d-45e91bfd8fd9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:40.493399 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b90417ae-0f02-4f11-870d-45e91bfd8fd9 admin admin] The token cache is being invalidate because project 62b5d156601648f9a33d4f7b302f1670 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:44:40.493819 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b90417ae-0f02-4f11-870d-45e91bfd8fd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:40.496127 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b90417ae-0f02-4f11-870d-45e91bfd8fd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:40.498172 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1321/2614] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:44:40 2022] DELETE /identity/v3/projects/62b5d156601648f9a33d4f7b302f1670 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:44:40.503241 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ba81b-3e0d-4fee-80f3-a5e2b36cabb8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:40.503533 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ba81b-3e0d-4fee-80f3-a5e2b36cabb8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:40.503809 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ba81b-3e0d-4fee-80f3-a5e2b36cabb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:40.526382 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-912ba81b-3e0d-4fee-80f3-a5e2b36cabb8 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:40.526664 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-912ba81b-3e0d-4fee-80f3-a5e2b36cabb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:40.527386 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90417ae-0f02-4f11-870d-45e91bfd8fd9 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:40.528838 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b90417ae-0f02-4f11-870d-45e91bfd8fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:40.601615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1294/2615] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:40.608815 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90417ae-0f02-4f11-870d-45e91bfd8fd9 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:40.612247 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fc0c7-a33e-431d-bd47-537f20021b78 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:40.612606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fc0c7-a33e-431d-bd47-537f20021b78 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:40.613478 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fc0c7-a33e-431d-bd47-537f20021b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:40.613967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b44421-9136-433e-9176-269c8d5c47e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:40.614837 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b44421-9136-433e-9176-269c8d5c47e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:40.615145 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b44421-9136-433e-9176-269c8d5c47e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:40.615399 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b44421-9136-433e-9176-269c8d5c47e6 admin admin] PATH_INFO: `/v3/projects/424ddcbbb97b4d0181fbc340c340f7a3` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:40.617204 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b44421-9136-433e-9176-269c8d5c47e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=424ddcbbb97b4d0181fbc340c340f7a3)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:40.619223 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b44421-9136-433e-9176-269c8d5c47e6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:40.634136 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d88fc0c7-a33e-431d-bd47-537f20021b78 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:40.635259 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d88fc0c7-a33e-431d-bd47-537f20021b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:40.646829 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1295/2616] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:44:40.651941 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fc0c7-a33e-431d-bd47-537f20021b78 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:40.664271 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fc0c7-a33e-431d-bd47-537f20021b78 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:40.677010 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b6b44421-9136-433e-9176-269c8d5c47e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '424ddcbbb97b4d0181fbc340c340f7a3', 'request_id': 'req-b6b44421-9136-433e-9176-269c8d5c47e6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:40.690479 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b6b44421-9136-433e-9176-269c8d5c47e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '424ddcbbb97b4d0181fbc340c340f7a3', 'request_id': 'req-b6b44421-9136-433e-9176-269c8d5c47e6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:40.694234 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:40.702778 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b6b44421-9136-433e-9176-269c8d5c47e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '424ddcbbb97b4d0181fbc340c340f7a3', 'request_id': 'req-b6b44421-9136-433e-9176-269c8d5c47e6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:40.722578 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b6b44421-9136-433e-9176-269c8d5c47e6 admin admin] The token cache is being invalidate because project 424ddcbbb97b4d0181fbc340c340f7a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:44:40.723001 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b6b44421-9136-433e-9176-269c8d5c47e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:40.723883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b6b44421-9136-433e-9176-269c8d5c47e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:40.726476 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1322/2617] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:44:40 2022] DELETE /identity/v3/projects/424ddcbbb97b4d0181fbc340c340f7a3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:44:40.733228 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1ce0a-8750-408b-ad61-67b0b6d3b0b0 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:40.733961 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1ce0a-8750-408b-ad61-67b0b6d3b0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:40.734483 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1ce0a-8750-408b-ad61-67b0b6d3b0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:40.758113 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-95d1ce0a-8750-408b-ad61-67b0b6d3b0b0 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:40.760106 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-95d1ce0a-8750-408b-ad61-67b0b6d3b0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:40.797966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b20f7e-1cb2-4272-8771-ba2c6024e90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:40.798658 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b20f7e-1cb2-4272-8771-ba2c6024e90d admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:40.798949 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b20f7e-1cb2-4272-8771-ba2c6024e90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:40.799229 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b20f7e-1cb2-4272-8771-ba2c6024e90d admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:40.800710 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b20f7e-1cb2-4272-8771-ba2c6024e90d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:44:40.801030 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b20f7e-1cb2-4272-8771-ba2c6024e90d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:40.802837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b20f7e-1cb2-4272-8771-ba2c6024e90d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:40.824125 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1296/2618] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:44:40.829057 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b20f7e-1cb2-4272-8771-ba2c6024e90d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:40.837104 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-64b20f7e-1cb2-4272-8771-ba2c6024e90d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:40.846343 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1323/2619] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:40.853189 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b20f7e-1cb2-4272-8771-ba2c6024e90d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:40.855396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8ab95-c81a-446f-99c5-c2a14c50573d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:40.855773 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8ab95-c81a-446f-99c5-c2a14c50573d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:40.856132 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8ab95-c81a-446f-99c5-c2a14c50573d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:40.860784 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac5b48-96a7-43a4-8918-3df35e81e771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:40.861614 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac5b48-96a7-43a4-8918-3df35e81e771 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:40.861997 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac5b48-96a7-43a4-8918-3df35e81e771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:40.862288 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac5b48-96a7-43a4-8918-3df35e81e771 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:40.862988 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac5b48-96a7-43a4-8918-3df35e81e771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:40.864976 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac5b48-96a7-43a4-8918-3df35e81e771 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:40.877038 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c8b8ab95-c81a-446f-99c5-c2a14c50573d None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:40.878614 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c8b8ab95-c81a-446f-99c5-c2a14c50573d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:40.889646 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1324/2620] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:40.894268 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8ab95-c81a-446f-99c5-c2a14c50573d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:40.896606 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1297/2621] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:44:40 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:40.900119 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac5b48-96a7-43a4-8918-3df35e81e771 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:40.908671 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8ab95-c81a-446f-99c5-c2a14c50573d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:40.921294 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:40.975565 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac5b48-96a7-43a4-8918-3df35e81e771 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:40.981124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74043d7e-892a-476a-bd9b-0c80fde88650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:40.981305 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bcc6c-96f1-4fa4-9f53-2fef41fe2e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:40.981802 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74043d7e-892a-476a-bd9b-0c80fde88650 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:40.981919 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bcc6c-96f1-4fa4-9f53-2fef41fe2e95 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:40.982083 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74043d7e-892a-476a-bd9b-0c80fde88650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:40.982207 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bcc6c-96f1-4fa4-9f53-2fef41fe2e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:40.982365 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74043d7e-892a-476a-bd9b-0c80fde88650 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:40.982480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bcc6c-96f1-4fa4-9f53-2fef41fe2e95 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:40.983102 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74043d7e-892a-476a-bd9b-0c80fde88650 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:44:40.983210 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bcc6c-96f1-4fa4-9f53-2fef41fe2e95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:40.983415 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74043d7e-892a-476a-bd9b-0c80fde88650 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:40.985153 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74043d7e-892a-476a-bd9b-0c80fde88650 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:40.985280 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bcc6c-96f1-4fa4-9f53-2fef41fe2e95 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:40.999962 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1325/2622] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:44:41.004870 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74043d7e-892a-476a-bd9b-0c80fde88650 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:41.015705 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74043d7e-892a-476a-bd9b-0c80fde88650 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:41.018413 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1298/2623] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:44:40 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:41.022354 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bcc6c-96f1-4fa4-9f53-2fef41fe2e95 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:41.025060 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca722de8-e72d-4b3b-85a4-373f6f4f76ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:41.025738 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca722de8-e72d-4b3b-85a4-373f6f4f76ac admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:41.026032 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca722de8-e72d-4b3b-85a4-373f6f4f76ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:41.026309 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca722de8-e72d-4b3b-85a4-373f6f4f76ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:41.027656 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca722de8-e72d-4b3b-85a4-373f6f4f76ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:41.029634 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca722de8-e72d-4b3b-85a4-373f6f4f76ac admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:41.034690 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bcc6c-96f1-4fa4-9f53-2fef41fe2e95 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:41.039576 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864175bf-c256-4e5a-a9b2-ef5331636f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:41.040568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864175bf-c256-4e5a-a9b2-ef5331636f2d admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:41.040964 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864175bf-c256-4e5a-a9b2-ef5331636f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:41.041363 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864175bf-c256-4e5a-a9b2-ef5331636f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:41.042832 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864175bf-c256-4e5a-a9b2-ef5331636f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:41.044672 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864175bf-c256-4e5a-a9b2-ef5331636f2d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:41.057693 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1299/2624] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:41.061840 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864175bf-c256-4e5a-a9b2-ef5331636f2d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:41.063485 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1326/2625] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:44:41 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:44:41.064364 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca722de8-e72d-4b3b-85a4-373f6f4f76ac admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:41.073468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864175bf-c256-4e5a-a9b2-ef5331636f2d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:41.121842 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:41.134516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca722de8-e72d-4b3b-85a4-373f6f4f76ac admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:41.140093 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970cdd55-ccac-48b4-a158-060e9a456a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:41.140724 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cdd55-ccac-48b4-a158-060e9a456a29 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:41.141088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cdd55-ccac-48b4-a158-060e9a456a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:41.141366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cdd55-ccac-48b4-a158-060e9a456a29 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:41.141978 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970cdd55-ccac-48b4-a158-060e9a456a29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:41.143899 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970cdd55-ccac-48b4-a158-060e9a456a29 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:41.146338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3248118-3f46-44a7-934d-a283490b73a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:41.147018 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3248118-3f46-44a7-934d-a283490b73a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:41.147450 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3248118-3f46-44a7-934d-a283490b73a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:41.147791 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3248118-3f46-44a7-934d-a283490b73a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:41.148564 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3248118-3f46-44a7-934d-a283490b73a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:41.150253 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3248118-3f46-44a7-934d-a283490b73a7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:41.166524 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1300/2626] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:41.166872 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1327/2627] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:44:41 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:41.171010 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970cdd55-ccac-48b4-a158-060e9a456a29 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:41.172144 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3248118-3f46-44a7-934d-a283490b73a7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:41.182778 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970cdd55-ccac-48b4-a158-060e9a456a29 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:41.183829 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3248118-3f46-44a7-934d-a283490b73a7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:41.187991 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaef7c5-23c7-47bc-9b71-f7fd087d8125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:41.188779 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaef7c5-23c7-47bc-9b71-f7fd087d8125 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:41.188910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35b7fe-502d-40e5-bd53-6f69d76773cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:41.189176 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaef7c5-23c7-47bc-9b71-f7fd087d8125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:41.189533 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaef7c5-23c7-47bc-9b71-f7fd087d8125 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:41.189639 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35b7fe-502d-40e5-bd53-6f69d76773cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:41.189970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35b7fe-502d-40e5-bd53-6f69d76773cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:41.190370 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35b7fe-502d-40e5-bd53-6f69d76773cd admin admin] PATH_INFO: `/v3/projects/1f2885a4b1e84242b849739d37a8a730/users/cd13e07ba22947f0af413f87499a9218/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:41.190653 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaef7c5-23c7-47bc-9b71-f7fd087d8125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:41.192396 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaef7c5-23c7-47bc-9b71-f7fd087d8125 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:41.204768 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1328/2628] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:41.208747 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaef7c5-23c7-47bc-9b71-f7fd087d8125 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:41.218460 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35b7fe-502d-40e5-bd53-6f69d76773cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f2885a4b1e84242b849739d37a8a730, user_id=cd13e07ba22947f0af413f87499a9218, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:41.219977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaef7c5-23c7-47bc-9b71-f7fd087d8125 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:41.226252 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58feca82-1595-45dc-87a2-434f562c6a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:41.226482 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35b7fe-502d-40e5-bd53-6f69d76773cd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:41.227154 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58feca82-1595-45dc-87a2-434f562c6a75 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:41.227508 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58feca82-1595-45dc-87a2-434f562c6a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:41.227889 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58feca82-1595-45dc-87a2-434f562c6a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:41.228741 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58feca82-1595-45dc-87a2-434f562c6a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:41.231229 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58feca82-1595-45dc-87a2-434f562c6a75 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:41.245069 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1301/2629] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:41 2022] PUT /identity/v3/projects/1f2885a4b1e84242b849739d37a8a730/users/cd13e07ba22947f0af413f87499a9218/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:41.246379 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1329/2630] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:41.250127 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35b7fe-502d-40e5-bd53-6f69d76773cd admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:41.255580 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c37bc4-582a-4d8a-be57-2f5ae2560c43 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:41.255942 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c37bc4-582a-4d8a-be57-2f5ae2560c43 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:41.256382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c37bc4-582a-4d8a-be57-2f5ae2560c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:41.289940 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c3c37bc4-582a-4d8a-be57-2f5ae2560c43 None None] MFA Rules not processed for user `cd13e07ba22947f0af413f87499a9218`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:41.291215 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c3c37bc4-582a-4d8a-be57-2f5ae2560c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:41.345897 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35b7fe-502d-40e5-bd53-6f69d76773cd admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:41.373992 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a35781-7885-44c5-bf82-859b183c919d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:41.374919 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a35781-7885-44c5-bf82-859b183c919d admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:41.375208 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a35781-7885-44c5-bf82-859b183c919d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:41.375490 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a35781-7885-44c5-bf82-859b183c919d admin admin] PATH_INFO: `/v3/projects/384dafbd57864dd2b83fde323ced8893/users/40af2516a2e04d31b088a544e486a65d/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:41.377813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1330/2631] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:44:41.382483 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c37bc4-582a-4d8a-be57-2f5ae2560c43 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:41.398238 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c37bc4-582a-4d8a-be57-2f5ae2560c43 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:41.404749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f141ec9-f3de-4946-a700-860312caf0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:41.405635 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f141ec9-f3de-4946-a700-860312caf0a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:41.405762 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:41.406941 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f141ec9-f3de-4946-a700-860312caf0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:41.407436 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f141ec9-f3de-4946-a700-860312caf0a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:41.408503 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f141ec9-f3de-4946-a700-860312caf0a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:41.410669 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f141ec9-f3de-4946-a700-860312caf0a4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:41.421044 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a35781-7885-44c5-bf82-859b183c919d admin admin] RBAC: Authorizing `identity:create_grant(project_id=384dafbd57864dd2b83fde323ced8893, user_id=40af2516a2e04d31b088a544e486a65d, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:41.432101 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a35781-7885-44c5-bf82-859b183c919d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:41.456106 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1302/2632] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:41 2022] PUT /identity/v3/projects/384dafbd57864dd2b83fde323ced8893/users/40af2516a2e04d31b088a544e486a65d/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:41.467385 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f04b58-133b-47b9-b47c-402f7b426d66 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:41.467686 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f04b58-133b-47b9-b47c-402f7b426d66 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:41.467964 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f04b58-133b-47b9-b47c-402f7b426d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:41.476915 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1331/2633] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:44:41 2022] POST /identity/v3/projects => generated 369 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:41.478629 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f141ec9-f3de-4946-a700-860312caf0a4 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:41.506654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-36f04b58-133b-47b9-b47c-402f7b426d66 None None] MFA Rules not processed for user `40af2516a2e04d31b088a544e486a65d`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:41.508443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-36f04b58-133b-47b9-b47c-402f7b426d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:41.563117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f141ec9-f3de-4946-a700-860312caf0a4 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:41.576495 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492bc78-3363-431b-bf32-adfe52979bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:41.577728 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492bc78-3363-431b-bf32-adfe52979bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:41.578079 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492bc78-3363-431b-bf32-adfe52979bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:41.578420 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492bc78-3363-431b-bf32-adfe52979bd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:41.579104 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492bc78-3363-431b-bf32-adfe52979bd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:41.581084 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492bc78-3363-431b-bf32-adfe52979bd0 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:41.598503 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1303/2634] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:41.612588 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1332/2635] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:44:41 2022] POST /identity/v3/users => generated 291 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:44:41.614277 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492bc78-3363-431b-bf32-adfe52979bd0 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:41.614922 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f04b58-133b-47b9-b47c-402f7b426d66 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:41.617026 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-36f04b58-133b-47b9-b47c-402f7b426d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:41.626249 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492bc78-3363-431b-bf32-adfe52979bd0 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:41.631917 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080b256-9c3b-49e5-a368-5c88b80634e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:41.633062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080b256-9c3b-49e5-a368-5c88b80634e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:41.633797 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080b256-9c3b-49e5-a368-5c88b80634e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:41.634317 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080b256-9c3b-49e5-a368-5c88b80634e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:41.635366 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080b256-9c3b-49e5-a368-5c88b80634e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:41.637867 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080b256-9c3b-49e5-a368-5c88b80634e8 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:41.650704 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1333/2636] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:41.655976 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080b256-9c3b-49e5-a368-5c88b80634e8 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:41.668319 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080b256-9c3b-49e5-a368-5c88b80634e8 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:41.673811 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc6a96-2af6-4e52-a259-32bb275f84da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:41.674941 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc6a96-2af6-4e52-a259-32bb275f84da admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:41.675226 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc6a96-2af6-4e52-a259-32bb275f84da admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:41.675767 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc6a96-2af6-4e52-a259-32bb275f84da admin admin] PATH_INFO: `/v3/projects/44b42df195c64c3cbb87ed57b3c013c4/users/db99a39ad79c4e4dadd018bc0c9e585a/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:41.678649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:41.696258 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc6a96-2af6-4e52-a259-32bb275f84da admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b42df195c64c3cbb87ed57b3c013c4, user_id=db99a39ad79c4e4dadd018bc0c9e585a, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:41.700381 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc6a96-2af6-4e52-a259-32bb275f84da admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:41.705513 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f04b58-133b-47b9-b47c-402f7b426d66 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:41.711167 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b13adc-ffad-454b-8c84-7eda3b3c5ca2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:41.711845 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b13adc-ffad-454b-8c84-7eda3b3c5ca2 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:41.712134 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b13adc-ffad-454b-8c84-7eda3b3c5ca2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:41.712449 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b13adc-ffad-454b-8c84-7eda3b3c5ca2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:41.723610 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b13adc-ffad-454b-8c84-7eda3b3c5ca2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:41.723836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1334/2637] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:41 2022] PUT /identity/v3/projects/44b42df195c64c3cbb87ed57b3c013c4/users/db99a39ad79c4e4dadd018bc0c9e585a/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:41.726085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b13adc-ffad-454b-8c84-7eda3b3c5ca2 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:41.727623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc6a96-2af6-4e52-a259-32bb275f84da admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:41.742443 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1304/2638] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:41.763492 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b13adc-ffad-454b-8c84-7eda3b3c5ca2 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:41.776859 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b13adc-ffad-454b-8c84-7eda3b3c5ca2 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:41.813836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc6a96-2af6-4e52-a259-32bb275f84da admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:41.818860 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c9db6-52f1-4600-8e7c-ea6384241db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:41.819613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c9db6-52f1-4600-8e7c-ea6384241db9 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:41.819910 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c9db6-52f1-4600-8e7c-ea6384241db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:41.820325 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c9db6-52f1-4600-8e7c-ea6384241db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:41.821295 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c9db6-52f1-4600-8e7c-ea6384241db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:41.824674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c9db6-52f1-4600-8e7c-ea6384241db9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:41.835038 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1335/2639] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:44:41.839135 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c9db6-52f1-4600-8e7c-ea6384241db9 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:41.860549 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c9db6-52f1-4600-8e7c-ea6384241db9 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:41.862973 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215f825-f38f-477b-a221-5fa75f928d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:41.864049 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215f825-f38f-477b-a221-5fa75f928d33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:41.864444 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215f825-f38f-477b-a221-5fa75f928d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:41.864728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215f825-f38f-477b-a221-5fa75f928d33 admin admin] PATH_INFO: `/v3/users/40af2516a2e04d31b088a544e486a65d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:41.866267 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215f825-f38f-477b-a221-5fa75f928d33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40af2516a2e04d31b088a544e486a65d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:41.867205 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3592b-df8a-4df2-bf62-55aa41bffbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:41.868429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215f825-f38f-477b-a221-5fa75f928d33 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:41.868614 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3592b-df8a-4df2-bf62-55aa41bffbab admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:41.869048 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3592b-df8a-4df2-bf62-55aa41bffbab admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:41.869480 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3592b-df8a-4df2-bf62-55aa41bffbab admin admin] PATH_INFO: `/v3/projects/44b42df195c64c3cbb87ed57b3c013c4/users/db99a39ad79c4e4dadd018bc0c9e585a/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:41.872730 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c3592b-df8a-4df2-bf62-55aa41bffbab admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b42df195c64c3cbb87ed57b3c013c4, user_id=db99a39ad79c4e4dadd018bc0c9e585a, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:41.875834 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c3592b-df8a-4df2-bf62-55aa41bffbab admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:41.892386 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1336/2640] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:41 2022] PUT /identity/v3/projects/44b42df195c64c3cbb87ed57b3c013c4/users/db99a39ad79c4e4dadd018bc0c9e585a/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:41.895966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:41.900550 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d39468-9f15-4b41-84e0-43339f62163d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:41.900936 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d39468-9f15-4b41-84e0-43339f62163d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:41.901340 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d39468-9f15-4b41-84e0-43339f62163d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:41.950559 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-69d39468-9f15-4b41-84e0-43339f62163d None None] MFA Rules not processed for user `db99a39ad79c4e4dadd018bc0c9e585a`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:41.952509 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-69d39468-9f15-4b41-84e0-43339f62163d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:41.960006 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8215f825-f38f-477b-a221-5fa75f928d33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40af2516a2e04d31b088a544e486a65d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:41.968810 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8215f825-f38f-477b-a221-5fa75f928d33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40af2516a2e04d31b088a544e486a65d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:41.970465 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8215f825-f38f-477b-a221-5fa75f928d33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40af2516a2e04d31b088a544e486a65d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:41.988873 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8215f825-f38f-477b-a221-5fa75f928d33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40af2516a2e04d31b088a544e486a65d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:41.999408 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8215f825-f38f-477b-a221-5fa75f928d33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40af2516a2e04d31b088a544e486a65d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:42.007783 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1305/2641] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:44:41 2022] DELETE /identity/v3/users/40af2516a2e04d31b088a544e486a65d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:44:42.014866 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68946d9b-bb4f-4afd-8d4f-5fdc6b035fd0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:42.015171 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68946d9b-bb4f-4afd-8d4f-5fdc6b035fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:42.015444 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68946d9b-bb4f-4afd-8d4f-5fdc6b035fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:42.037031 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-68946d9b-bb4f-4afd-8d4f-5fdc6b035fd0 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:42.038785 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-68946d9b-bb4f-4afd-8d4f-5fdc6b035fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:42.047481 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1337/2642] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:41 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:44:42.060088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d39468-9f15-4b41-84e0-43339f62163d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:42.062569 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-69d39468-9f15-4b41-84e0-43339f62163d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:42.107286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1306/2643] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:42.119485 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68946d9b-bb4f-4afd-8d4f-5fdc6b035fd0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:42.121605 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-68946d9b-bb4f-4afd-8d4f-5fdc6b035fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:42.131149 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d39468-9f15-4b41-84e0-43339f62163d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:42.135750 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:42.187250 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68946d9b-bb4f-4afd-8d4f-5fdc6b035fd0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:42.191347 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93418bf-7319-4929-9fd7-f206ca66b879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:42.192008 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93418bf-7319-4929-9fd7-f206ca66b879 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:42.192460 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93418bf-7319-4929-9fd7-f206ca66b879 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:42.192743 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93418bf-7319-4929-9fd7-f206ca66b879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:42.196418 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492ab56-68c2-472b-8b56-39527cf45a9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:42.196698 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492ab56-68c2-472b-8b56-39527cf45a9c service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:42.197087 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492ab56-68c2-472b-8b56-39527cf45a9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:42.197371 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492ab56-68c2-472b-8b56-39527cf45a9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:42.203812 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93418bf-7319-4929-9fd7-f206ca66b879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:42.205875 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93418bf-7319-4929-9fd7-f206ca66b879 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:42.217120 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1307/2644] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:44:42.273095 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492ab56-68c2-472b-8b56-39527cf45a9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:42.274802 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492ab56-68c2-472b-8b56-39527cf45a9c service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:42.285984 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1338/2645] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:42 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:44:42.382510 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93418bf-7319-4929-9fd7-f206ca66b879 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:42.392716 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93418bf-7319-4929-9fd7-f206ca66b879 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:42.396692 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f08fb-0023-4140-83af-2172571d2c6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:42.397517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f08fb-0023-4140-83af-2172571d2c6c service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:42.397806 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f08fb-0023-4140-83af-2172571d2c6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:42.398090 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f08fb-0023-4140-83af-2172571d2c6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:42.399914 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-443f08fb-0023-4140-83af-2172571d2c6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:42.474797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:42.500015 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f08fb-0023-4140-83af-2172571d2c6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:42.501758 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f08fb-0023-4140-83af-2172571d2c6c service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:42.512687 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1308/2646] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:42.594359 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014ba59-e7a9-4a96-8efa-0b5cdacff25d None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:42.594581 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014ba59-e7a9-4a96-8efa-0b5cdacff25d None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:42.594875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014ba59-e7a9-4a96-8efa-0b5cdacff25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:42.631818 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-2014ba59-e7a9-4a96-8efa-0b5cdacff25d None None] MFA Rules not processed for user `4c181d9000214ce78c5acb11ac6f6f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:42.634941 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2014ba59-e7a9-4a96-8efa-0b5cdacff25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:42.773214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f08fb-0023-4140-83af-2172571d2c6c service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:42.774839 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-443f08fb-0023-4140-83af-2172571d2c6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:42.807432 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f08fb-0023-4140-83af-2172571d2c6c service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:42.828552 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab62fb-fc04-41f6-a096-98aaadddbba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:42.829694 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab62fb-fc04-41f6-a096-98aaadddbba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:42.830295 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab62fb-fc04-41f6-a096-98aaadddbba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:42.831487 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab62fb-fc04-41f6-a096-98aaadddbba8 admin admin] PATH_INFO: `/v3/users/e17d78545203486280ac21fdd3ecbcfb` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:42.833202 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab62fb-fc04-41f6-a096-98aaadddbba8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e17d78545203486280ac21fdd3ecbcfb)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:42.838365 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab62fb-fc04-41f6-a096-98aaadddbba8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:42.843084 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1339/2647] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:44:42.843084 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014ba59-e7a9-4a96-8efa-0b5cdacff25d None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:42.849282 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-2014ba59-e7a9-4a96-8efa-0b5cdacff25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:42.866968 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014ba59-e7a9-4a96-8efa-0b5cdacff25d None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:42.876680 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af7b41-dc90-4668-9828-5532e9e7c59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:42.878702 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af7b41-dc90-4668-9828-5532e9e7c59e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:42.879149 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af7b41-dc90-4668-9828-5532e9e7c59e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:42.879616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af7b41-dc90-4668-9828-5532e9e7c59e admin admin] PATH_INFO: `/v3/projects/384dafbd57864dd2b83fde323ced8893` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:42.881273 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af7b41-dc90-4668-9828-5532e9e7c59e admin admin] RBAC: Authorizing `identity:delete_project(project_id=384dafbd57864dd2b83fde323ced8893)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:42.883335 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af7b41-dc90-4668-9828-5532e9e7c59e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:42.952385 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-78ab62fb-fc04-41f6-a096-98aaadddbba8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e17d78545203486280ac21fdd3ecbcfb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:42.962892 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-78ab62fb-fc04-41f6-a096-98aaadddbba8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e17d78545203486280ac21fdd3ecbcfb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:42.963915 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-78ab62fb-fc04-41f6-a096-98aaadddbba8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e17d78545203486280ac21fdd3ecbcfb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:42.992957 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-78ab62fb-fc04-41f6-a096-98aaadddbba8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e17d78545203486280ac21fdd3ecbcfb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:42.999687 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-60af7b41-dc90-4668-9828-5532e9e7c59e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '384dafbd57864dd2b83fde323ced8893', 'request_id': 'req-60af7b41-dc90-4668-9828-5532e9e7c59e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:43.022216 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-78ab62fb-fc04-41f6-a096-98aaadddbba8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e17d78545203486280ac21fdd3ecbcfb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:43.029779 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-60af7b41-dc90-4668-9828-5532e9e7c59e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '384dafbd57864dd2b83fde323ced8893', 'request_id': 'req-60af7b41-dc90-4668-9828-5532e9e7c59e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:43.031451 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:43.035640 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1309/2648] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:44:42 2022] DELETE /identity/v3/users/e17d78545203486280ac21fdd3ecbcfb => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:44:43.040015 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-60af7b41-dc90-4668-9828-5532e9e7c59e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '384dafbd57864dd2b83fde323ced8893', 'request_id': 'req-60af7b41-dc90-4668-9828-5532e9e7c59e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:43.040905 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d382e6-ea72-4bd8-ac82-60f9a3893b9f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:43.041547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d382e6-ea72-4bd8-ac82-60f9a3893b9f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:43.042074 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d382e6-ea72-4bd8-ac82-60f9a3893b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:43.063191 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-60af7b41-dc90-4668-9828-5532e9e7c59e admin admin] The token cache is being invalidate because project 384dafbd57864dd2b83fde323ced8893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:44:43.063480 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-60af7b41-dc90-4668-9828-5532e9e7c59e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:43.064769 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-60af7b41-dc90-4668-9828-5532e9e7c59e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:43.067594 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1340/2649] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:44:42 2022] DELETE /identity/v3/projects/384dafbd57864dd2b83fde323ced8893 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:43.071229 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e5d382e6-ea72-4bd8-ac82-60f9a3893b9f None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:43.072001 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba5012-19ff-4221-918d-d8fca1f73d80 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:43.072310 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba5012-19ff-4221-918d-d8fca1f73d80 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:43.072609 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba5012-19ff-4221-918d-d8fca1f73d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:43.074517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e5d382e6-ea72-4bd8-ac82-60f9a3893b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:43.110270 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-13ba5012-19ff-4221-918d-d8fca1f73d80 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:43.114373 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-13ba5012-19ff-4221-918d-d8fca1f73d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:43.221683 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1310/2650] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:43.272677 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d382e6-ea72-4bd8-ac82-60f9a3893b9f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:43.274627 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1341/2651] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:44:43.274774 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e5d382e6-ea72-4bd8-ac82-60f9a3893b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:43.282280 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10914fac-01ad-42b3-b2ff-27ef7a5f2aca None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:43.282761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10914fac-01ad-42b3-b2ff-27ef7a5f2aca None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:43.283394 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10914fac-01ad-42b3-b2ff-27ef7a5f2aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:43.311249 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-10914fac-01ad-42b3-b2ff-27ef7a5f2aca None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:43.312505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-10914fac-01ad-42b3-b2ff-27ef7a5f2aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:43.321298 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1342/2652] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:44:43.331083 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10914fac-01ad-42b3-b2ff-27ef7a5f2aca None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:43.345990 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10914fac-01ad-42b3-b2ff-27ef7a5f2aca None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:43.352352 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca273a-032a-48f5-88ae-4e18a32c8c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:43.353070 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca273a-032a-48f5-88ae-4e18a32c8c55 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:43.353357 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca273a-032a-48f5-88ae-4e18a32c8c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:43.353691 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca273a-032a-48f5-88ae-4e18a32c8c55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:43.354434 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca273a-032a-48f5-88ae-4e18a32c8c55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:44:43.354761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca273a-032a-48f5-88ae-4e18a32c8c55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:43.356455 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca273a-032a-48f5-88ae-4e18a32c8c55 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:43.367144 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d382e6-ea72-4bd8-ac82-60f9a3893b9f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:43.369836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1343/2653] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:44:43.372274 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa244d3-102c-4710-b6a2-706be3b129d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:43.373090 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa244d3-102c-4710-b6a2-706be3b129d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:43.373575 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa244d3-102c-4710-b6a2-706be3b129d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:43.374003 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa244d3-102c-4710-b6a2-706be3b129d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:43.374967 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca273a-032a-48f5-88ae-4e18a32c8c55 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:43.387233 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca273a-032a-48f5-88ae-4e18a32c8c55 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:43.392784 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa244d3-102c-4710-b6a2-706be3b129d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:43.393656 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b369dbc-f757-4fe8-ac72-6d3983d49387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:43.394543 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b369dbc-f757-4fe8-ac72-6d3983d49387 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:43.394893 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b369dbc-f757-4fe8-ac72-6d3983d49387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:43.395410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b369dbc-f757-4fe8-ac72-6d3983d49387 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:43.396213 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa244d3-102c-4710-b6a2-706be3b129d8 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:43.396537 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b369dbc-f757-4fe8-ac72-6d3983d49387 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:43.398746 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b369dbc-f757-4fe8-ac72-6d3983d49387 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:43.402494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:43.411692 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1311/2654] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:44:43.433238 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1344/2655] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:44:43 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:43.437357 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa244d3-102c-4710-b6a2-706be3b129d8 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:43.447330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa244d3-102c-4710-b6a2-706be3b129d8 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:43.526568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da4fee-49c8-4683-88e3-3eb442fa0e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:43.527254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da4fee-49c8-4683-88e3-3eb442fa0e06 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:43.527534 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da4fee-49c8-4683-88e3-3eb442fa0e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:43.527808 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da4fee-49c8-4683-88e3-3eb442fa0e06 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:43.529184 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da4fee-49c8-4683-88e3-3eb442fa0e06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:43.532694 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da4fee-49c8-4683-88e3-3eb442fa0e06 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:43.557147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1312/2656] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:44:43 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:43.561259 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b369dbc-f757-4fe8-ac72-6d3983d49387 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:43.572336 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b369dbc-f757-4fe8-ac72-6d3983d49387 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:43.578377 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfc016-fb9b-443c-8079-40c3cd79433e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:43.579110 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfc016-fb9b-443c-8079-40c3cd79433e admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:43.579455 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfc016-fb9b-443c-8079-40c3cd79433e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:43.579795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfc016-fb9b-443c-8079-40c3cd79433e admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:43.580687 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfc016-fb9b-443c-8079-40c3cd79433e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:43.582521 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfc016-fb9b-443c-8079-40c3cd79433e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:43.593272 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1345/2657] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:44:43.597575 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da4fee-49c8-4683-88e3-3eb442fa0e06 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:43.609111 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da4fee-49c8-4683-88e3-3eb442fa0e06 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:43.613957 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c249cc-8148-413b-b934-3c522e28adaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:43.614621 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c249cc-8148-413b-b934-3c522e28adaa admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:43.614908 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c249cc-8148-413b-b934-3c522e28adaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:43.615189 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c249cc-8148-413b-b934-3c522e28adaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:43.616271 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c249cc-8148-413b-b934-3c522e28adaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:43.617607 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c249cc-8148-413b-b934-3c522e28adaa admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:43.628953 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1313/2658] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:43.633272 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfc016-fb9b-443c-8079-40c3cd79433e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:43.643555 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfc016-fb9b-443c-8079-40c3cd79433e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:43.648685 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e7a26-187b-4860-8ea5-a3b554467ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:43.649655 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e7a26-187b-4860-8ea5-a3b554467ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:43.650068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e7a26-187b-4860-8ea5-a3b554467ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:43.650356 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e7a26-187b-4860-8ea5-a3b554467ba4 admin admin] PATH_INFO: `/v3/projects/2a96236f56c6446eb7b186ebff8c7b0b/users/671f2bd8e2044bfc9e1accb80ffe57c1/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:43.701237 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e7a26-187b-4860-8ea5-a3b554467ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a96236f56c6446eb7b186ebff8c7b0b, user_id=671f2bd8e2044bfc9e1accb80ffe57c1, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:43.705122 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e7a26-187b-4860-8ea5-a3b554467ba4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:43.726507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1346/2659] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:43 2022] PUT /identity/v3/projects/2a96236f56c6446eb7b186ebff8c7b0b/users/671f2bd8e2044bfc9e1accb80ffe57c1/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:43.738085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb380798-9c5d-4d57-9df3-2181ba08f9b3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:43.738717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb380798-9c5d-4d57-9df3-2181ba08f9b3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:43.739229 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb380798-9c5d-4d57-9df3-2181ba08f9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:43.775461 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-fb380798-9c5d-4d57-9df3-2181ba08f9b3 None None] MFA Rules not processed for user `671f2bd8e2044bfc9e1accb80ffe57c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:43.777121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fb380798-9c5d-4d57-9df3-2181ba08f9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:43.892008 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1314/2660] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:44:43.896461 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e7a26-187b-4860-8ea5-a3b554467ba4 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:44.015215 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e7a26-187b-4860-8ea5-a3b554467ba4 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:44.027929 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb380798-9c5d-4d57-9df3-2181ba08f9b3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:44.030020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d3558-538b-4292-bc00-9173c185e19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:44.030329 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fb380798-9c5d-4d57-9df3-2181ba08f9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:44.030947 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d3558-538b-4292-bc00-9173c185e19e admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:44.031894 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d3558-538b-4292-bc00-9173c185e19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:44.032572 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d3558-538b-4292-bc00-9173c185e19e admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:44.033838 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d3558-538b-4292-bc00-9173c185e19e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:44.036149 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d3558-538b-4292-bc00-9173c185e19e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:44.051240 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb380798-9c5d-4d57-9df3-2181ba08f9b3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:44.059544 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2aedc-cf64-4278-95a3-1b2b8ece1803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:44.060998 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2aedc-cf64-4278-95a3-1b2b8ece1803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:44.066387 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2aedc-cf64-4278-95a3-1b2b8ece1803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:44.066608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:44.067030 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2aedc-cf64-4278-95a3-1b2b8ece1803 admin admin] PATH_INFO: `/v3/projects/50b8f674367c4d8bac926db99099da5f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:44.070027 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2aedc-cf64-4278-95a3-1b2b8ece1803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50b8f674367c4d8bac926db99099da5f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:44.073940 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2aedc-cf64-4278-95a3-1b2b8ece1803 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:44.098287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1347/2661] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:44:43 2022] POST /identity/v3/projects => generated 375 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:44.102024 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d3558-538b-4292-bc00-9173c185e19e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:44.156735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1bc2aedc-cf64-4278-95a3-1b2b8ece1803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50b8f674367c4d8bac926db99099da5f', 'request_id': 'req-1bc2aedc-cf64-4278-95a3-1b2b8ece1803'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:44.167113 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1bc2aedc-cf64-4278-95a3-1b2b8ece1803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50b8f674367c4d8bac926db99099da5f', 'request_id': 'req-1bc2aedc-cf64-4278-95a3-1b2b8ece1803'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:44.177427 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:44.185603 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1bc2aedc-cf64-4278-95a3-1b2b8ece1803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50b8f674367c4d8bac926db99099da5f', 'request_id': 'req-1bc2aedc-cf64-4278-95a3-1b2b8ece1803'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:44.186456 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d3558-538b-4292-bc00-9173c185e19e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:44.212153 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1bc2aedc-cf64-4278-95a3-1b2b8ece1803 admin admin] The token cache is being invalidate because project 50b8f674367c4d8bac926db99099da5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:44:44.212473 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1bc2aedc-cf64-4278-95a3-1b2b8ece1803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:44.213169 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1bc2aedc-cf64-4278-95a3-1b2b8ece1803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:44.215978 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1315/2662] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:44:44 2022] DELETE /identity/v3/projects/50b8f674367c4d8bac926db99099da5f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:44.225575 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2aedc-cf64-4278-95a3-1b2b8ece1803 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:44.229469 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1bc2aedc-cf64-4278-95a3-1b2b8ece1803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:44.261488 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b766e2-567e-4a32-b50a-5317aa764ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:44.262368 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b766e2-567e-4a32-b50a-5317aa764ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:44.262819 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b766e2-567e-4a32-b50a-5317aa764ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:44.263259 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b766e2-567e-4a32-b50a-5317aa764ee1 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:44.264245 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b766e2-567e-4a32-b50a-5317aa764ee1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:44.266621 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b766e2-567e-4a32-b50a-5317aa764ee1 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:44.333171 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2aedc-cf64-4278-95a3-1b2b8ece1803 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:44.334889 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1348/2663] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:44:44 2022] POST /identity/v3/users => generated 294 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:44.343094 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eaedf8-87dd-43d3-985d-7295209a6f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:44.344184 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eaedf8-87dd-43d3-985d-7295209a6f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:44.344618 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eaedf8-87dd-43d3-985d-7295209a6f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:44.345027 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eaedf8-87dd-43d3-985d-7295209a6f27 admin admin] PATH_INFO: `/v3/users/9783f192d2fc4750a587640c83d96c79` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:44.346476 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eaedf8-87dd-43d3-985d-7295209a6f27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9783f192d2fc4750a587640c83d96c79)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:44.348923 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eaedf8-87dd-43d3-985d-7295209a6f27 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:44.351602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b766e2-567e-4a32-b50a-5317aa764ee1 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:44.355167 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-45b766e2-567e-4a32-b50a-5317aa764ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:44.382785 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b766e2-567e-4a32-b50a-5317aa764ee1 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:44.389889 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebdfb7-0e96-4ddb-a13d-9ecddfb9ec4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:44.390650 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebdfb7-0e96-4ddb-a13d-9ecddfb9ec4d admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:44.390940 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebdfb7-0e96-4ddb-a13d-9ecddfb9ec4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:44.391271 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebdfb7-0e96-4ddb-a13d-9ecddfb9ec4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:44.392264 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebdfb7-0e96-4ddb-a13d-9ecddfb9ec4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:44.394451 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebdfb7-0e96-4ddb-a13d-9ecddfb9ec4d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:44.421332 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-52eaedf8-87dd-43d3-985d-7295209a6f27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9783f192d2fc4750a587640c83d96c79'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:44.434164 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1349/2664] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:44.435622 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-52eaedf8-87dd-43d3-985d-7295209a6f27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9783f192d2fc4750a587640c83d96c79'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:44.435996 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebdfb7-0e96-4ddb-a13d-9ecddfb9ec4d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:44.437351 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-52eaedf8-87dd-43d3-985d-7295209a6f27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9783f192d2fc4750a587640c83d96c79'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:44.450199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebdfb7-0e96-4ddb-a13d-9ecddfb9ec4d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:44.456928 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ede283-291b-4339-b1f5-b49ee455881b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:44.457895 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ede283-291b-4339-b1f5-b49ee455881b admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:44.458181 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ede283-291b-4339-b1f5-b49ee455881b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:44.458524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ede283-291b-4339-b1f5-b49ee455881b admin admin] PATH_INFO: `/v3/projects/8a20a78c220e4e928585140b63914a9b/users/a994af5179f64209a6552a42db07a9a1/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:44.471338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-52eaedf8-87dd-43d3-985d-7295209a6f27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9783f192d2fc4750a587640c83d96c79'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:44.477497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ede283-291b-4339-b1f5-b49ee455881b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a20a78c220e4e928585140b63914a9b, user_id=a994af5179f64209a6552a42db07a9a1, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:44.480761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ede283-291b-4339-b1f5-b49ee455881b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:44.482384 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-52eaedf8-87dd-43d3-985d-7295209a6f27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9783f192d2fc4750a587640c83d96c79'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:44.491150 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1316/2665] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:44:44 2022] DELETE /identity/v3/users/9783f192d2fc4750a587640c83d96c79 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:44.500493 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1350/2666] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:44 2022] PUT /identity/v3/projects/8a20a78c220e4e928585140b63914a9b/users/a994af5179f64209a6552a42db07a9a1/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:44.502263 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eaedf8-87dd-43d3-985d-7295209a6f27 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:44.503929 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-52eaedf8-87dd-43d3-985d-7295209a6f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:44.601090 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eaedf8-87dd-43d3-985d-7295209a6f27 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:44.616317 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:44.696604 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b17b70-498b-4033-804f-f8c99f0c0a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:44.696837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b17b70-498b-4033-804f-f8c99f0c0a22 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:44.697256 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b17b70-498b-4033-804f-f8c99f0c0a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:44.697698 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b17b70-498b-4033-804f-f8c99f0c0a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:44.699128 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b17b70-498b-4033-804f-f8c99f0c0a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:44.701818 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b17b70-498b-4033-804f-f8c99f0c0a22 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:44.716080 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1317/2667] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:44.720101 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ede283-291b-4339-b1f5-b49ee455881b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:44.737088 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ede283-291b-4339-b1f5-b49ee455881b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:44.755492 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd34fb-6dab-4353-9af1-147d057a188e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:44.756429 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd34fb-6dab-4353-9af1-147d057a188e admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:44.756716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd34fb-6dab-4353-9af1-147d057a188e admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:44.756993 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd34fb-6dab-4353-9af1-147d057a188e admin admin] PATH_INFO: `/v3/projects/8a20a78c220e4e928585140b63914a9b/users/a994af5179f64209a6552a42db07a9a1/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:44.759537 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd34fb-6dab-4353-9af1-147d057a188e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a20a78c220e4e928585140b63914a9b, user_id=a994af5179f64209a6552a42db07a9a1, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:44.762333 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd34fb-6dab-4353-9af1-147d057a188e admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:44.779169 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1351/2668] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:44 2022] PUT /identity/v3/projects/8a20a78c220e4e928585140b63914a9b/users/a994af5179f64209a6552a42db07a9a1/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:44.789906 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232464b-5c39-42f2-813d-9dcc77dd9b00 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:44.790510 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232464b-5c39-42f2-813d-9dcc77dd9b00 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:44.790685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232464b-5c39-42f2-813d-9dcc77dd9b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:44.847472 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd34fb-6dab-4353-9af1-147d057a188e admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:44.849687 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-56dd34fb-6dab-4353-9af1-147d057a188e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:44.873827 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0232464b-5c39-42f2-813d-9dcc77dd9b00 None None] MFA Rules not processed for user `a994af5179f64209a6552a42db07a9a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:44.875199 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0232464b-5c39-42f2-813d-9dcc77dd9b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:44.955253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:44.981015 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1318/2669] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:44 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:44.994079 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232464b-5c39-42f2-813d-9dcc77dd9b00 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:44.994888 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd34fb-6dab-4353-9af1-147d057a188e admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:44.998416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0232464b-5c39-42f2-813d-9dcc77dd9b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:45.018103 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af5f15-4a53-4478-b512-499d99f468d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:45.019054 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af5f15-4a53-4478-b512-499d99f468d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:45.019342 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af5f15-4a53-4478-b512-499d99f468d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:45.019616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af5f15-4a53-4478-b512-499d99f468d6 admin admin] PATH_INFO: `/v3/projects/5f782d7dbc7a4ec580aac0879e8ebc99` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:45.020947 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af5f15-4a53-4478-b512-499d99f468d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f782d7dbc7a4ec580aac0879e8ebc99)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:45.022946 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af5f15-4a53-4478-b512-499d99f468d6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:45.114028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232464b-5c39-42f2-813d-9dcc77dd9b00 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:45.137809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-47af5f15-4a53-4478-b512-499d99f468d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f782d7dbc7a4ec580aac0879e8ebc99', 'request_id': 'req-47af5f15-4a53-4478-b512-499d99f468d6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:45.170848 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-47af5f15-4a53-4478-b512-499d99f468d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f782d7dbc7a4ec580aac0879e8ebc99', 'request_id': 'req-47af5f15-4a53-4478-b512-499d99f468d6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:45.185902 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-47af5f15-4a53-4478-b512-499d99f468d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f782d7dbc7a4ec580aac0879e8ebc99', 'request_id': 'req-47af5f15-4a53-4478-b512-499d99f468d6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:45.192256 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdeff6c-256b-4246-b564-def4b808c3b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:45.193021 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdeff6c-256b-4246-b564-def4b808c3b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:45.193310 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdeff6c-256b-4246-b564-def4b808c3b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:45.193591 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdeff6c-256b-4246-b564-def4b808c3b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:45.195620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-efdeff6c-256b-4246-b564-def4b808c3b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:45.204482 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:45.214911 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-47af5f15-4a53-4478-b512-499d99f468d6 admin admin] The token cache is being invalidate because project 5f782d7dbc7a4ec580aac0879e8ebc99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:44:45.215203 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-47af5f15-4a53-4478-b512-499d99f468d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:45.220763 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-47af5f15-4a53-4478-b512-499d99f468d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:45.222754 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1352/2670] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:44:44 2022] DELETE /identity/v3/projects/5f782d7dbc7a4ec580aac0879e8ebc99 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:45.228521 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ea4c5-59ea-4693-a7b1-742dd3683f48 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:45.228811 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ea4c5-59ea-4693-a7b1-742dd3683f48 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:45.229159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ea4c5-59ea-4693-a7b1-742dd3683f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:45.257994 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-d48ea4c5-59ea-4693-a7b1-742dd3683f48 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:45.259231 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d48ea4c5-59ea-4693-a7b1-742dd3683f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:45.319003 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdeff6c-256b-4246-b564-def4b808c3b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:45.320933 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdeff6c-256b-4246-b564-def4b808c3b0 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:45.335898 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1319/2671] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:44:45.351208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1353/2672] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:45.359253 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23edd266-ebb2-470d-860f-b327202e6947 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:45.360396 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23edd266-ebb2-470d-860f-b327202e6947 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:45.360725 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23edd266-ebb2-470d-860f-b327202e6947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:45.385244 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-23edd266-ebb2-470d-860f-b327202e6947 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:45.387194 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-23edd266-ebb2-470d-860f-b327202e6947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:45.403830 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1320/2673] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:45.408148 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ea4c5-59ea-4693-a7b1-742dd3683f48 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:45.422691 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ea4c5-59ea-4693-a7b1-742dd3683f48 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:45.428595 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211bf76-ece5-4848-8e5d-80df780a9818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:45.429441 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211bf76-ece5-4848-8e5d-80df780a9818 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:45.429852 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211bf76-ece5-4848-8e5d-80df780a9818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:45.430374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211bf76-ece5-4848-8e5d-80df780a9818 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:45.431224 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211bf76-ece5-4848-8e5d-80df780a9818 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:44:45.431635 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211bf76-ece5-4848-8e5d-80df780a9818 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:45.434681 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211bf76-ece5-4848-8e5d-80df780a9818 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:45.454346 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1354/2674] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:44:45.459363 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23edd266-ebb2-470d-860f-b327202e6947 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:45.474876 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23edd266-ebb2-470d-860f-b327202e6947 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:45.484010 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552156e5-d489-4aca-b71a-06936052b153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:45.484734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552156e5-d489-4aca-b71a-06936052b153 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:45.485652 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552156e5-d489-4aca-b71a-06936052b153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:45.485943 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552156e5-d489-4aca-b71a-06936052b153 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:45.486659 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552156e5-d489-4aca-b71a-06936052b153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:45.489544 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552156e5-d489-4aca-b71a-06936052b153 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:45.543512 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1321/2675] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:44:45 2022] POST /identity/v3/projects => generated 387 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:45.548634 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211bf76-ece5-4848-8e5d-80df780a9818 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:45.563097 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211bf76-ece5-4848-8e5d-80df780a9818 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:45.662008 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d0bd7-91b1-486c-8982-a000f0f5653a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:45.662712 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d0bd7-91b1-486c-8982-a000f0f5653a admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:45.664128 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d0bd7-91b1-486c-8982-a000f0f5653a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:45.664538 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d0bd7-91b1-486c-8982-a000f0f5653a admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:45.665891 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d0bd7-91b1-486c-8982-a000f0f5653a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:45.668775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d0bd7-91b1-486c-8982-a000f0f5653a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:45.677501 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:45.703909 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1355/2676] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:44:45 2022] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:45.708208 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552156e5-d489-4aca-b71a-06936052b153 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:45.740321 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552156e5-d489-4aca-b71a-06936052b153 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:45.759025 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37929217-cc50-4201-a1b2-c0118debc2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:45.759723 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37929217-cc50-4201-a1b2-c0118debc2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:45.760014 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37929217-cc50-4201-a1b2-c0118debc2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:45.760397 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37929217-cc50-4201-a1b2-c0118debc2b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:45.761121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37929217-cc50-4201-a1b2-c0118debc2b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:45.769694 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37929217-cc50-4201-a1b2-c0118debc2b3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:45.796019 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1322/2677] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:45.800858 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d0bd7-91b1-486c-8982-a000f0f5653a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:45.821435 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d0bd7-91b1-486c-8982-a000f0f5653a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:45.832741 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a1a32-b9ff-486b-8da1-d6f1ef833be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:45.838554 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a1a32-b9ff-486b-8da1-d6f1ef833be9 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:45.839557 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a1a32-b9ff-486b-8da1-d6f1ef833be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:45.839760 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a1a32-b9ff-486b-8da1-d6f1ef833be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:45.840873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a1a32-b9ff-486b-8da1-d6f1ef833be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:45.842670 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a1a32-b9ff-486b-8da1-d6f1ef833be9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:45.880810 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1356/2678] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:45.882325 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37929217-cc50-4201-a1b2-c0118debc2b3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:45.899594 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37929217-cc50-4201-a1b2-c0118debc2b3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:45.913568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1101b8-0518-425c-b49d-2488a6fc9504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:45.917654 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1101b8-0518-425c-b49d-2488a6fc9504 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:45.918398 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1101b8-0518-425c-b49d-2488a6fc9504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:45.919670 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1101b8-0518-425c-b49d-2488a6fc9504 admin admin] PATH_INFO: `/v3/projects/0a79737128a24c60a988af2bc219754b/users/8fdeaf6cea57405f9bfdf143db46a339/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:45.944115 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1101b8-0518-425c-b49d-2488a6fc9504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a79737128a24c60a988af2bc219754b, user_id=8fdeaf6cea57405f9bfdf143db46a339, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:45.953365 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1101b8-0518-425c-b49d-2488a6fc9504 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:45.989035 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1323/2679] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:45 2022] PUT /identity/v3/projects/0a79737128a24c60a988af2bc219754b/users/8fdeaf6cea57405f9bfdf143db46a339/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:44:46.055219 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c6c20-251c-4aac-aac8-0a346a38aa77 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:46.055796 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c6c20-251c-4aac-aac8-0a346a38aa77 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:46.055796 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c6c20-251c-4aac-aac8-0a346a38aa77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:46.105246 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-5c0c6c20-251c-4aac-aac8-0a346a38aa77 None None] MFA Rules not processed for user `8fdeaf6cea57405f9bfdf143db46a339`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:46.106517 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-5c0c6c20-251c-4aac-aac8-0a346a38aa77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:46.204633 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1357/2680] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:46.206984 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1101b8-0518-425c-b49d-2488a6fc9504 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:46.311289 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1101b8-0518-425c-b49d-2488a6fc9504 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:46.319521 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940d8ba-2726-446e-93be-33f6b58bbc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:46.320787 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940d8ba-2726-446e-93be-33f6b58bbc3b admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:46.321086 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940d8ba-2726-446e-93be-33f6b58bbc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:46.321379 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940d8ba-2726-446e-93be-33f6b58bbc3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:46.322399 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940d8ba-2726-446e-93be-33f6b58bbc3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:46.325675 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940d8ba-2726-446e-93be-33f6b58bbc3b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:46.364557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1324/2681] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:44:46 2022] POST /identity/v3/projects => generated 387 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:46.368521 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c6c20-251c-4aac-aac8-0a346a38aa77 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:46.381364 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c6c20-251c-4aac-aac8-0a346a38aa77 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:46.466344 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f120909-5098-45a9-a54b-3762681572b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:46.467133 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f120909-5098-45a9-a54b-3762681572b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:46.467321 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f120909-5098-45a9-a54b-3762681572b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:46.467596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f120909-5098-45a9-a54b-3762681572b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:46.468653 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f120909-5098-45a9-a54b-3762681572b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:46.472539 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f120909-5098-45a9-a54b-3762681572b4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:46.503298 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1358/2682] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:44:46 2022] POST /identity/v3/users => generated 300 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:46.504886 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940d8ba-2726-446e-93be-33f6b58bbc3b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:46.515411 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940d8ba-2726-446e-93be-33f6b58bbc3b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:46.520238 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f804965-d768-4e61-8ebc-5bda89d4fa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:46.520933 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f804965-d768-4e61-8ebc-5bda89d4fa4f admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:46.521211 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f804965-d768-4e61-8ebc-5bda89d4fa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:46.521491 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f804965-d768-4e61-8ebc-5bda89d4fa4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:46.522215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f804965-d768-4e61-8ebc-5bda89d4fa4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:46.523824 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f804965-d768-4e61-8ebc-5bda89d4fa4f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:46.536252 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1325/2683] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:46.541006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f120909-5098-45a9-a54b-3762681572b4 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:46.553346 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f120909-5098-45a9-a54b-3762681572b4 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:46.558096 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c9f69-0aee-42db-9123-5e0a60bfe77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:46.558977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c9f69-0aee-42db-9123-5e0a60bfe77b admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:46.559260 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c9f69-0aee-42db-9123-5e0a60bfe77b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:46.559534 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c9f69-0aee-42db-9123-5e0a60bfe77b admin admin] PATH_INFO: `/v3/projects/53472afbd5944ee8b4a678fcbbfd418d/users/65472c1e7cfb480fb65eb1372640450e/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:46.575802 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c9f69-0aee-42db-9123-5e0a60bfe77b admin admin] RBAC: Authorizing `identity:create_grant(project_id=53472afbd5944ee8b4a678fcbbfd418d, user_id=65472c1e7cfb480fb65eb1372640450e, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:46.580038 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c9f69-0aee-42db-9123-5e0a60bfe77b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:46.597953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1359/2684] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:46 2022] PUT /identity/v3/projects/53472afbd5944ee8b4a678fcbbfd418d/users/65472c1e7cfb480fb65eb1372640450e/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:44:46.602125 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f804965-d768-4e61-8ebc-5bda89d4fa4f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:46.614214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f804965-d768-4e61-8ebc-5bda89d4fa4f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:46.630902 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:46.681494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c25f3e-03d3-4629-981f-782135ad4236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:46.682242 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c25f3e-03d3-4629-981f-782135ad4236 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:46.682588 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c25f3e-03d3-4629-981f-782135ad4236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:46.682874 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c25f3e-03d3-4629-981f-782135ad4236 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:46.683610 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c25f3e-03d3-4629-981f-782135ad4236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:46.685363 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c25f3e-03d3-4629-981f-782135ad4236 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:46.699412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1326/2685] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:46.703747 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c9f69-0aee-42db-9123-5e0a60bfe77b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:46.715766 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c9f69-0aee-42db-9123-5e0a60bfe77b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:46.720876 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc13b90-1639-4e5e-875c-0ccc42a1ab02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:46.721771 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc13b90-1639-4e5e-875c-0ccc42a1ab02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:46.722066 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc13b90-1639-4e5e-875c-0ccc42a1ab02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:46.722348 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc13b90-1639-4e5e-875c-0ccc42a1ab02 admin admin] PATH_INFO: `/v3/projects/53472afbd5944ee8b4a678fcbbfd418d/users/65472c1e7cfb480fb65eb1372640450e/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:46.724428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc13b90-1639-4e5e-875c-0ccc42a1ab02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53472afbd5944ee8b4a678fcbbfd418d, user_id=65472c1e7cfb480fb65eb1372640450e, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:46.727557 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc13b90-1639-4e5e-875c-0ccc42a1ab02 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:46.739345 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1360/2686] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:46 2022] PUT /identity/v3/projects/53472afbd5944ee8b4a678fcbbfd418d/users/65472c1e7cfb480fb65eb1372640450e/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:46.750293 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed872d1-ded1-447a-9eb8-c09441099ace None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:46.750720 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed872d1-ded1-447a-9eb8-c09441099ace None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:46.751073 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed872d1-ded1-447a-9eb8-c09441099ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:46.777780 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9ed872d1-ded1-447a-9eb8-c09441099ace None None] MFA Rules not processed for user `65472c1e7cfb480fb65eb1372640450e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:46.779112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9ed872d1-ded1-447a-9eb8-c09441099ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:46.847188 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1327/2687] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:46.859286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc13b90-1639-4e5e-875c-0ccc42a1ab02 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:46.861025 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7bc13b90-1639-4e5e-875c-0ccc42a1ab02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:46.888895 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:46.949352 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc13b90-1639-4e5e-875c-0ccc42a1ab02 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:46.953773 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5e3b0-e8bf-4a31-a0ce-a23c85f90be3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:46.954558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5e3b0-e8bf-4a31-a0ce-a23c85f90be3 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:46.954683 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5e3b0-e8bf-4a31-a0ce-a23c85f90be3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:46.954963 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5e3b0-e8bf-4a31-a0ce-a23c85f90be3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:46.966131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5e3b0-e8bf-4a31-a0ce-a23c85f90be3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:46.967525 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5e3b0-e8bf-4a31-a0ce-a23c85f90be3 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:46.978509 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1361/2688] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:47.730322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed872d1-ded1-447a-9eb8-c09441099ace None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:47.797751 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed872d1-ded1-447a-9eb8-c09441099ace None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:47.802765 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a1604-6479-4478-b851-0813a0cf0902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:47.804010 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a1604-6479-4478-b851-0813a0cf0902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:47.804010 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a1604-6479-4478-b851-0813a0cf0902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:47.804437 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a1604-6479-4478-b851-0813a0cf0902 admin admin] PATH_INFO: `/v3/users/8fdeaf6cea57405f9bfdf143db46a339` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:47.805900 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a1604-6479-4478-b851-0813a0cf0902 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fdeaf6cea57405f9bfdf143db46a339)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:47.808636 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a1604-6479-4478-b851-0813a0cf0902 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:47.864898 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:47.872585 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-532a1604-6479-4478-b851-0813a0cf0902 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fdeaf6cea57405f9bfdf143db46a339'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:47.890317 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-532a1604-6479-4478-b851-0813a0cf0902 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fdeaf6cea57405f9bfdf143db46a339'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:47.890797 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5e3b0-e8bf-4a31-a0ce-a23c85f90be3 service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:47.891298 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-532a1604-6479-4478-b851-0813a0cf0902 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fdeaf6cea57405f9bfdf143db46a339'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:47.892675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e2c5e3b0-e8bf-4a31-a0ce-a23c85f90be3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:47.909508 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5e3b0-e8bf-4a31-a0ce-a23c85f90be3 service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:47.911388 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-532a1604-6479-4478-b851-0813a0cf0902 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fdeaf6cea57405f9bfdf143db46a339'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:47.914213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936ad23-103c-42d4-ad96-89c13ecbf1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:47.915076 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936ad23-103c-42d4-ad96-89c13ecbf1cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:47.915363 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936ad23-103c-42d4-ad96-89c13ecbf1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:47.915643 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936ad23-103c-42d4-ad96-89c13ecbf1cc admin admin] PATH_INFO: `/v3/users/02eb6e337f9a4bf5992b8668a6f0fa3a` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:47.917000 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936ad23-103c-42d4-ad96-89c13ecbf1cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=02eb6e337f9a4bf5992b8668a6f0fa3a)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:47.919107 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936ad23-103c-42d4-ad96-89c13ecbf1cc admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:47.920367 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-532a1604-6479-4478-b851-0813a0cf0902 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fdeaf6cea57405f9bfdf143db46a339'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:47.927368 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1328/2689] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:44:47 2022] DELETE /identity/v3/users/8fdeaf6cea57405f9bfdf143db46a339 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:47.932096 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a72c30-0de6-42c5-b11e-0075e5decb4f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:47.932992 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a72c30-0de6-42c5-b11e-0075e5decb4f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:47.933285 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a72c30-0de6-42c5-b11e-0075e5decb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:47.953577 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e9a72c30-0de6-42c5-b11e-0075e5decb4f None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:47.955463 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e9a72c30-0de6-42c5-b11e-0075e5decb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:47.973806 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b936ad23-103c-42d4-ad96-89c13ecbf1cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02eb6e337f9a4bf5992b8668a6f0fa3a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:47.981257 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b936ad23-103c-42d4-ad96-89c13ecbf1cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02eb6e337f9a4bf5992b8668a6f0fa3a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:47.981933 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b936ad23-103c-42d4-ad96-89c13ecbf1cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02eb6e337f9a4bf5992b8668a6f0fa3a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:47.994381 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b936ad23-103c-42d4-ad96-89c13ecbf1cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02eb6e337f9a4bf5992b8668a6f0fa3a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:48.005032 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b936ad23-103c-42d4-ad96-89c13ecbf1cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02eb6e337f9a4bf5992b8668a6f0fa3a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:48.017722 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1362/2690] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:44:47 2022] DELETE /identity/v3/users/02eb6e337f9a4bf5992b8668a6f0fa3a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:48.020014 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1329/2691] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:44:48.030287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936ad23-103c-42d4-ad96-89c13ecbf1cc admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:48.031644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b936ad23-103c-42d4-ad96-89c13ecbf1cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:48.095190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936ad23-103c-42d4-ad96-89c13ecbf1cc admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:48.098942 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdc039-8959-472a-ac50-8d781e100802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:48.099591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdc039-8959-472a-ac50-8d781e100802 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:48.099877 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdc039-8959-472a-ac50-8d781e100802 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:48.100153 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdc039-8959-472a-ac50-8d781e100802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:48.159362 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:48.176612 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bdc039-8959-472a-ac50-8d781e100802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:48.178525 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bdc039-8959-472a-ac50-8d781e100802 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:48.190619 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1363/2692] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:48.231233 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a72c30-0de6-42c5-b11e-0075e5decb4f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:48.232889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e9a72c30-0de6-42c5-b11e-0075e5decb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:48.245785 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a72c30-0de6-42c5-b11e-0075e5decb4f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:48.250692 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840a032-43a3-4ac7-9897-ddc4c3d15ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:48.251594 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840a032-43a3-4ac7-9897-ddc4c3d15ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:48.252103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840a032-43a3-4ac7-9897-ddc4c3d15ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:48.252418 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840a032-43a3-4ac7-9897-ddc4c3d15ff7 admin admin] PATH_INFO: `/v3/projects/ba31334d858a4e698ac0f8fc2e846895` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:48.253634 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840a032-43a3-4ac7-9897-ddc4c3d15ff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba31334d858a4e698ac0f8fc2e846895)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:48.255551 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840a032-43a3-4ac7-9897-ddc4c3d15ff7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:48.307535 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1840a032-43a3-4ac7-9897-ddc4c3d15ff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba31334d858a4e698ac0f8fc2e846895', 'request_id': 'req-1840a032-43a3-4ac7-9897-ddc4c3d15ff7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:48.313728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1840a032-43a3-4ac7-9897-ddc4c3d15ff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba31334d858a4e698ac0f8fc2e846895', 'request_id': 'req-1840a032-43a3-4ac7-9897-ddc4c3d15ff7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:48.322030 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1840a032-43a3-4ac7-9897-ddc4c3d15ff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba31334d858a4e698ac0f8fc2e846895', 'request_id': 'req-1840a032-43a3-4ac7-9897-ddc4c3d15ff7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:48.335374 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1840a032-43a3-4ac7-9897-ddc4c3d15ff7 admin admin] The token cache is being invalidate because project ba31334d858a4e698ac0f8fc2e846895 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:44:48.335665 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1840a032-43a3-4ac7-9897-ddc4c3d15ff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:48.336314 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1840a032-43a3-4ac7-9897-ddc4c3d15ff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:48.337887 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1330/2693] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:44:48 2022] DELETE /identity/v3/projects/ba31334d858a4e698ac0f8fc2e846895 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:44:48.341822 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdc039-8959-472a-ac50-8d781e100802 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:48.351744 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdc039-8959-472a-ac50-8d781e100802 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:48.414306 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce8c0b-22aa-4d42-9eee-eb7234e6d2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:48.415183 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce8c0b-22aa-4d42-9eee-eb7234e6d2d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:48.415469 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce8c0b-22aa-4d42-9eee-eb7234e6d2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:48.415746 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce8c0b-22aa-4d42-9eee-eb7234e6d2d3 admin admin] PATH_INFO: `/v3/users/cdb81e45304e40ea88a703204b1a1868` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:48.417525 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce8c0b-22aa-4d42-9eee-eb7234e6d2d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdb81e45304e40ea88a703204b1a1868)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:48.419487 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce8c0b-22aa-4d42-9eee-eb7234e6d2d3 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:48.472580 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-71ce8c0b-22aa-4d42-9eee-eb7234e6d2d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdb81e45304e40ea88a703204b1a1868'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:48.481583 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-71ce8c0b-22aa-4d42-9eee-eb7234e6d2d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdb81e45304e40ea88a703204b1a1868'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:48.482564 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-71ce8c0b-22aa-4d42-9eee-eb7234e6d2d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdb81e45304e40ea88a703204b1a1868'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:48.496045 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-71ce8c0b-22aa-4d42-9eee-eb7234e6d2d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdb81e45304e40ea88a703204b1a1868'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:48.498920 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840a032-43a3-4ac7-9897-ddc4c3d15ff7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:48.500525 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1840a032-43a3-4ac7-9897-ddc4c3d15ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:48.508798 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-71ce8c0b-22aa-4d42-9eee-eb7234e6d2d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdb81e45304e40ea88a703204b1a1868'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:48.515129 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840a032-43a3-4ac7-9897-ddc4c3d15ff7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:48.517654 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1364/2694] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:44:48 2022] DELETE /identity/v3/users/cdb81e45304e40ea88a703204b1a1868 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:48.570492 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:48.598762 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d33247-690c-4d41-a2f4-9f5d504987c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:48.599656 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d33247-690c-4d41-a2f4-9f5d504987c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:48.600477 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d33247-690c-4d41-a2f4-9f5d504987c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:48.600761 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d33247-690c-4d41-a2f4-9f5d504987c7 admin admin] PATH_INFO: `/v3/projects/0a79737128a24c60a988af2bc219754b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:48.602141 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d33247-690c-4d41-a2f4-9f5d504987c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a79737128a24c60a988af2bc219754b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:48.605250 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d33247-690c-4d41-a2f4-9f5d504987c7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:48.658922 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-77d33247-690c-4d41-a2f4-9f5d504987c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a79737128a24c60a988af2bc219754b', 'request_id': 'req-77d33247-690c-4d41-a2f4-9f5d504987c7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:48.669321 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-77d33247-690c-4d41-a2f4-9f5d504987c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a79737128a24c60a988af2bc219754b', 'request_id': 'req-77d33247-690c-4d41-a2f4-9f5d504987c7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:48.677018 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-77d33247-690c-4d41-a2f4-9f5d504987c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a79737128a24c60a988af2bc219754b', 'request_id': 'req-77d33247-690c-4d41-a2f4-9f5d504987c7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:48.689244 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-77d33247-690c-4d41-a2f4-9f5d504987c7 admin admin] The token cache is being invalidate because project 0a79737128a24c60a988af2bc219754b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:44:48.689533 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-77d33247-690c-4d41-a2f4-9f5d504987c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:48.690232 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-77d33247-690c-4d41-a2f4-9f5d504987c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:48.691857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1331/2695] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:44:48 2022] DELETE /identity/v3/projects/0a79737128a24c60a988af2bc219754b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:44:48.696040 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce8c0b-22aa-4d42-9eee-eb7234e6d2d3 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:48.697573 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-71ce8c0b-22aa-4d42-9eee-eb7234e6d2d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:48.708494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d33247-690c-4d41-a2f4-9f5d504987c7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:48.709998 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-77d33247-690c-4d41-a2f4-9f5d504987c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:48.716563 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce8c0b-22aa-4d42-9eee-eb7234e6d2d3 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:48.793313 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d821c-b767-47ba-afba-19a6c1cf96f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:48.794197 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d821c-b767-47ba-afba-19a6c1cf96f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:48.794484 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d821c-b767-47ba-afba-19a6c1cf96f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:48.794762 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d821c-b767-47ba-afba-19a6c1cf96f9 admin admin] PATH_INFO: `/v3/users/65472c1e7cfb480fb65eb1372640450e` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:48.795968 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d821c-b767-47ba-afba-19a6c1cf96f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65472c1e7cfb480fb65eb1372640450e)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:48.797952 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d821c-b767-47ba-afba-19a6c1cf96f9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:48.801951 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d33247-690c-4d41-a2f4-9f5d504987c7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:48.802973 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:48.808279 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a5563-5643-414f-854e-a023e6dd6ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:48.809404 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a5563-5643-414f-854e-a023e6dd6ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:48.809684 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a5563-5643-414f-854e-a023e6dd6ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:48.809954 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a5563-5643-414f-854e-a023e6dd6ca2 admin admin] PATH_INFO: `/v3/projects/4327d1680b0546eebd912ded09fe4396` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:48.812329 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a5563-5643-414f-854e-a023e6dd6ca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4327d1680b0546eebd912ded09fe4396)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:48.813115 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a5563-5643-414f-854e-a023e6dd6ca2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:48.858001 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d83d821c-b767-47ba-afba-19a6c1cf96f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65472c1e7cfb480fb65eb1372640450e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:48.864745 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d83d821c-b767-47ba-afba-19a6c1cf96f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65472c1e7cfb480fb65eb1372640450e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:48.865414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d83d821c-b767-47ba-afba-19a6c1cf96f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65472c1e7cfb480fb65eb1372640450e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:48.865712 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8e9a5563-5643-414f-854e-a023e6dd6ca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4327d1680b0546eebd912ded09fe4396', 'request_id': 'req-8e9a5563-5643-414f-854e-a023e6dd6ca2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:48.871095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8e9a5563-5643-414f-854e-a023e6dd6ca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4327d1680b0546eebd912ded09fe4396', 'request_id': 'req-8e9a5563-5643-414f-854e-a023e6dd6ca2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:48.877083 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d83d821c-b767-47ba-afba-19a6c1cf96f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65472c1e7cfb480fb65eb1372640450e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:48.878528 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8e9a5563-5643-414f-854e-a023e6dd6ca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4327d1680b0546eebd912ded09fe4396', 'request_id': 'req-8e9a5563-5643-414f-854e-a023e6dd6ca2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:48.884724 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-d83d821c-b767-47ba-afba-19a6c1cf96f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65472c1e7cfb480fb65eb1372640450e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:48.890180 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8e9a5563-5643-414f-854e-a023e6dd6ca2 admin admin] The token cache is being invalidate because project 4327d1680b0546eebd912ded09fe4396 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:44:48.890468 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8e9a5563-5643-414f-854e-a023e6dd6ca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:48.891103 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8e9a5563-5643-414f-854e-a023e6dd6ca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:48.891259 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1365/2696] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:44:48 2022] DELETE /identity/v3/users/65472c1e7cfb480fb65eb1372640450e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:48.894824 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1332/2697] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:44:48 2022] DELETE /identity/v3/projects/4327d1680b0546eebd912ded09fe4396 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:44:48.897496 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a548f6-7d6f-4e13-a616-ba4d8254678f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:48.897900 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a548f6-7d6f-4e13-a616-ba4d8254678f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:48.898257 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a548f6-7d6f-4e13-a616-ba4d8254678f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:48.916694 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-29a548f6-7d6f-4e13-a616-ba4d8254678f None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:48.917946 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-29a548f6-7d6f-4e13-a616-ba4d8254678f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:48.989382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1366/2698] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:44:48.998115 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad83d8-dc34-43ae-8151-547c90750c4f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:48.998407 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad83d8-dc34-43ae-8151-547c90750c4f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:48.998689 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad83d8-dc34-43ae-8151-547c90750c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:49.005527 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:49.033246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9bad83d8-dc34-43ae-8151-547c90750c4f None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:49.034683 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9bad83d8-dc34-43ae-8151-547c90750c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:49.048633 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1333/2699] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:49.051139 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a548f6-7d6f-4e13-a616-ba4d8254678f None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:49.062117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a548f6-7d6f-4e13-a616-ba4d8254678f None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:49.067977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8e1e4-10c3-4ce6-ba61-392835352d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:49.068829 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8e1e4-10c3-4ce6-ba61-392835352d30 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:49.069188 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8e1e4-10c3-4ce6-ba61-392835352d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:49.069539 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8e1e4-10c3-4ce6-ba61-392835352d30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:49.070467 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8e1e4-10c3-4ce6-ba61-392835352d30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:44:49.070856 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8e1e4-10c3-4ce6-ba61-392835352d30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:49.072590 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8e1e4-10c3-4ce6-ba61-392835352d30 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:49.087461 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1367/2700] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:44:49.092509 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad83d8-dc34-43ae-8151-547c90750c4f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:49.103964 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad83d8-dc34-43ae-8151-547c90750c4f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:49.109415 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b946de5-5e76-4296-ad14-9b2183a58fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:49.110082 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b946de5-5e76-4296-ad14-9b2183a58fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:49.110439 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b946de5-5e76-4296-ad14-9b2183a58fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:49.110698 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b946de5-5e76-4296-ad14-9b2183a58fc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:49.111457 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b946de5-5e76-4296-ad14-9b2183a58fc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:49.113485 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b946de5-5e76-4296-ad14-9b2183a58fc5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:49.144695 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1334/2701] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:44:49 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:49.146263 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8e1e4-10c3-4ce6-ba61-392835352d30 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:49.162715 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8e1e4-10c3-4ce6-ba61-392835352d30 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:49.192172 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b946de5-5e76-4296-ad14-9b2183a58fc5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:49.193974 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8b946de5-5e76-4296-ad14-9b2183a58fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:49.272118 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cf884-a441-41cf-a36a-01c09a356054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:49.272921 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cf884-a441-41cf-a36a-01c09a356054 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:49.273285 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cf884-a441-41cf-a36a-01c09a356054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:49.273675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cf884-a441-41cf-a36a-01c09a356054 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:49.274655 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cf884-a441-41cf-a36a-01c09a356054 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:49.275297 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b946de5-5e76-4296-ad14-9b2183a58fc5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:49.276904 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cf884-a441-41cf-a36a-01c09a356054 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:49.281312 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06898a3-0415-477a-b2db-41eb73e59381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:49.282506 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06898a3-0415-477a-b2db-41eb73e59381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:49.282791 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06898a3-0415-477a-b2db-41eb73e59381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:49.283072 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06898a3-0415-477a-b2db-41eb73e59381 admin admin] PATH_INFO: `/v3/projects/53472afbd5944ee8b4a678fcbbfd418d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:49.284325 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06898a3-0415-477a-b2db-41eb73e59381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53472afbd5944ee8b4a678fcbbfd418d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:49.286799 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06898a3-0415-477a-b2db-41eb73e59381 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:49.295445 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:49.305700 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1368/2702] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:44:49 2022] POST /identity/v3/users => generated 290 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:44:49.308274 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cf884-a441-41cf-a36a-01c09a356054 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:49.320771 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cf884-a441-41cf-a36a-01c09a356054 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:49.327388 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cfdd0c-119c-476f-bab1-d9b12e178fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:49.328133 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfdd0c-119c-476f-bab1-d9b12e178fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:49.328775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfdd0c-119c-476f-bab1-d9b12e178fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:49.329131 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfdd0c-119c-476f-bab1-d9b12e178fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:49.330167 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cfdd0c-119c-476f-bab1-d9b12e178fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:49.332061 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cfdd0c-119c-476f-bab1-d9b12e178fb9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:49.348390 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1369/2703] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:44:49.349423 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cfdd0c-119c-476f-bab1-d9b12e178fb9 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:49.352191 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f06898a3-0415-477a-b2db-41eb73e59381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53472afbd5944ee8b4a678fcbbfd418d', 'request_id': 'req-f06898a3-0415-477a-b2db-41eb73e59381'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:49.359261 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f06898a3-0415-477a-b2db-41eb73e59381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53472afbd5944ee8b4a678fcbbfd418d', 'request_id': 'req-f06898a3-0415-477a-b2db-41eb73e59381'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:49.360879 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cfdd0c-119c-476f-bab1-d9b12e178fb9 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:49.368214 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f06898a3-0415-477a-b2db-41eb73e59381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53472afbd5944ee8b4a678fcbbfd418d', 'request_id': 'req-f06898a3-0415-477a-b2db-41eb73e59381'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:49.382583 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f06898a3-0415-477a-b2db-41eb73e59381 admin admin] The token cache is being invalidate because project 53472afbd5944ee8b4a678fcbbfd418d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:44:49.383116 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f06898a3-0415-477a-b2db-41eb73e59381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:49.383792 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f06898a3-0415-477a-b2db-41eb73e59381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:49.386798 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1335/2704] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:44:49 2022] DELETE /identity/v3/projects/53472afbd5944ee8b4a678fcbbfd418d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:49.438761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501cc72-5b8b-4244-9dfb-aa37b49f9cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:49.439669 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501cc72-5b8b-4244-9dfb-aa37b49f9cfe admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:49.439955 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501cc72-5b8b-4244-9dfb-aa37b49f9cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:49.440236 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501cc72-5b8b-4244-9dfb-aa37b49f9cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:49.441069 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501cc72-5b8b-4244-9dfb-aa37b49f9cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:49.443005 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501cc72-5b8b-4244-9dfb-aa37b49f9cfe admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:49.458749 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1370/2705] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:49.459742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06898a3-0415-477a-b2db-41eb73e59381 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:49.465614 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f06898a3-0415-477a-b2db-41eb73e59381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:49.482811 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06898a3-0415-477a-b2db-41eb73e59381 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:49.490144 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c05b8-aa47-4176-8d55-61e04eb85f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:49.491441 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c05b8-aa47-4176-8d55-61e04eb85f84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:49.491805 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c05b8-aa47-4176-8d55-61e04eb85f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:49.492170 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c05b8-aa47-4176-8d55-61e04eb85f84 admin admin] PATH_INFO: `/v3/projects/25b312790b9644bb8fbe30d2ab637db0/users/64d281c3f8e447aaacb073ed0f8c7a35/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:49.524017 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c05b8-aa47-4176-8d55-61e04eb85f84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b312790b9644bb8fbe30d2ab637db0, user_id=64d281c3f8e447aaacb073ed0f8c7a35, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:49.528560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c05b8-aa47-4176-8d55-61e04eb85f84 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:49.546482 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1336/2706] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:49 2022] PUT /identity/v3/projects/25b312790b9644bb8fbe30d2ab637db0/users/64d281c3f8e447aaacb073ed0f8c7a35/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:49.551470 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d385b-3a0d-4a8d-95a0-b7284b544729 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:49.551767 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d385b-3a0d-4a8d-95a0-b7284b544729 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:49.552053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d385b-3a0d-4a8d-95a0-b7284b544729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:49.574526 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-ee9d385b-3a0d-4a8d-95a0-b7284b544729 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:49.575921 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ee9d385b-3a0d-4a8d-95a0-b7284b544729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:49.653798 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1371/2707] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:49.663325 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c05b8-aa47-4176-8d55-61e04eb85f84 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:49.665166 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-722c05b8-aa47-4176-8d55-61e04eb85f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:49.729489 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:49.745919 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c05b8-aa47-4176-8d55-61e04eb85f84 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:49.750091 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c456a2d-a441-47c7-9ed2-1b8df47f99b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:49.750860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c456a2d-a441-47c7-9ed2-1b8df47f99b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:49.751146 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c456a2d-a441-47c7-9ed2-1b8df47f99b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:49.751425 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c456a2d-a441-47c7-9ed2-1b8df47f99b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:49.762619 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c456a2d-a441-47c7-9ed2-1b8df47f99b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:49.764122 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c456a2d-a441-47c7-9ed2-1b8df47f99b2 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:49.775081 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1337/2708] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:50.325269 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d385b-3a0d-4a8d-95a0-b7284b544729 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:50.326951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ee9d385b-3a0d-4a8d-95a0-b7284b544729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:50.340023 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d385b-3a0d-4a8d-95a0-b7284b544729 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:50.344706 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73685358-a720-43a3-b673-1d2c9d910fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:50.345584 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73685358-a720-43a3-b673-1d2c9d910fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:50.345870 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73685358-a720-43a3-b673-1d2c9d910fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:50.346150 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73685358-a720-43a3-b673-1d2c9d910fc3 admin admin] PATH_INFO: `/v3/users/671f2bd8e2044bfc9e1accb80ffe57c1` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:50.347345 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73685358-a720-43a3-b673-1d2c9d910fc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=671f2bd8e2044bfc9e1accb80ffe57c1)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:50.349347 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73685358-a720-43a3-b673-1d2c9d910fc3 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:50.405659 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-73685358-a720-43a3-b673-1d2c9d910fc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '671f2bd8e2044bfc9e1accb80ffe57c1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:50.414129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-73685358-a720-43a3-b673-1d2c9d910fc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '671f2bd8e2044bfc9e1accb80ffe57c1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:50.416545 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-73685358-a720-43a3-b673-1d2c9d910fc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '671f2bd8e2044bfc9e1accb80ffe57c1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:50.433699 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-73685358-a720-43a3-b673-1d2c9d910fc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '671f2bd8e2044bfc9e1accb80ffe57c1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:50.442970 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-73685358-a720-43a3-b673-1d2c9d910fc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '671f2bd8e2044bfc9e1accb80ffe57c1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:50.445032 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:50.458387 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1372/2709] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:44:50 2022] DELETE /identity/v3/users/671f2bd8e2044bfc9e1accb80ffe57c1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:50.460599 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01156bc6-e864-41e5-857e-e13171b594b7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:50.461012 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01156bc6-e864-41e5-857e-e13171b594b7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:50.461175 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01156bc6-e864-41e5-857e-e13171b594b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:50.490613 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-01156bc6-e864-41e5-857e-e13171b594b7 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:50.492509 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-01156bc6-e864-41e5-857e-e13171b594b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:50.585805 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1338/2710] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:44:50.593643 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73685358-a720-43a3-b673-1d2c9d910fc3 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:50.595940 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-73685358-a720-43a3-b673-1d2c9d910fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:50.669705 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73685358-a720-43a3-b673-1d2c9d910fc3 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:50.675578 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60cc775-05ac-414e-8c5f-cc45a4cf9a13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:50.676520 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cc775-05ac-414e-8c5f-cc45a4cf9a13 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:50.677050 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cc775-05ac-414e-8c5f-cc45a4cf9a13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:50.677567 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cc775-05ac-414e-8c5f-cc45a4cf9a13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:50.689551 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60cc775-05ac-414e-8c5f-cc45a4cf9a13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:50.691087 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60cc775-05ac-414e-8c5f-cc45a4cf9a13 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:50.705520 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1373/2711] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:51.101897 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01156bc6-e864-41e5-857e-e13171b594b7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:51.105794 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-01156bc6-e864-41e5-857e-e13171b594b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:51.124790 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01156bc6-e864-41e5-857e-e13171b594b7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:51.131233 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd46a5-066d-4d6a-97dd-a8438143aea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:51.132358 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd46a5-066d-4d6a-97dd-a8438143aea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:51.132650 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd46a5-066d-4d6a-97dd-a8438143aea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:51.132997 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd46a5-066d-4d6a-97dd-a8438143aea8 admin admin] PATH_INFO: `/v3/projects/2a96236f56c6446eb7b186ebff8c7b0b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:51.134233 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd46a5-066d-4d6a-97dd-a8438143aea8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a96236f56c6446eb7b186ebff8c7b0b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:51.139476 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd46a5-066d-4d6a-97dd-a8438143aea8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:51.205853 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8cdd46a5-066d-4d6a-97dd-a8438143aea8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a96236f56c6446eb7b186ebff8c7b0b', 'request_id': 'req-8cdd46a5-066d-4d6a-97dd-a8438143aea8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:51.213547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8cdd46a5-066d-4d6a-97dd-a8438143aea8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a96236f56c6446eb7b186ebff8c7b0b', 'request_id': 'req-8cdd46a5-066d-4d6a-97dd-a8438143aea8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:51.222728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8cdd46a5-066d-4d6a-97dd-a8438143aea8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a96236f56c6446eb7b186ebff8c7b0b', 'request_id': 'req-8cdd46a5-066d-4d6a-97dd-a8438143aea8'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:51.237352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8cdd46a5-066d-4d6a-97dd-a8438143aea8 admin admin] The token cache is being invalidate because project 2a96236f56c6446eb7b186ebff8c7b0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:44:51.237777 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8cdd46a5-066d-4d6a-97dd-a8438143aea8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:51.238592 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8cdd46a5-066d-4d6a-97dd-a8438143aea8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:51.240637 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1339/2712] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:44:51 2022] DELETE /identity/v3/projects/2a96236f56c6446eb7b186ebff8c7b0b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:51.244159 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60cc775-05ac-414e-8c5f-cc45a4cf9a13 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:51.254846 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60cc775-05ac-414e-8c5f-cc45a4cf9a13 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:51.327555 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07871a9-c431-4f01-9a6b-751e0a1073d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:51.328465 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07871a9-c431-4f01-9a6b-751e0a1073d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:51.328987 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07871a9-c431-4f01-9a6b-751e0a1073d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:51.329271 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07871a9-c431-4f01-9a6b-751e0a1073d8 admin admin] PATH_INFO: `/v3/users/a994af5179f64209a6552a42db07a9a1` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:51.330516 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07871a9-c431-4f01-9a6b-751e0a1073d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a994af5179f64209a6552a42db07a9a1)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:51.332544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07871a9-c431-4f01-9a6b-751e0a1073d8 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:51.387273 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f07871a9-c431-4f01-9a6b-751e0a1073d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a994af5179f64209a6552a42db07a9a1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:51.396372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f07871a9-c431-4f01-9a6b-751e0a1073d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a994af5179f64209a6552a42db07a9a1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:51.397659 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f07871a9-c431-4f01-9a6b-751e0a1073d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a994af5179f64209a6552a42db07a9a1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:51.413718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f07871a9-c431-4f01-9a6b-751e0a1073d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a994af5179f64209a6552a42db07a9a1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:51.423275 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-f07871a9-c431-4f01-9a6b-751e0a1073d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a994af5179f64209a6552a42db07a9a1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:51.430328 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1374/2713] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:44:51 2022] DELETE /identity/v3/users/a994af5179f64209a6552a42db07a9a1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:52.143921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd46a5-066d-4d6a-97dd-a8438143aea8 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:52.145434 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8cdd46a5-066d-4d6a-97dd-a8438143aea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:52.162509 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd46a5-066d-4d6a-97dd-a8438143aea8 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:52.266882 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae07328-2b9e-4f4d-a631-ef433b5be712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:52.267777 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae07328-2b9e-4f4d-a631-ef433b5be712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:52.268061 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae07328-2b9e-4f4d-a631-ef433b5be712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:52.268386 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae07328-2b9e-4f4d-a631-ef433b5be712 admin admin] PATH_INFO: `/v3/projects/8a20a78c220e4e928585140b63914a9b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:52.269707 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae07328-2b9e-4f4d-a631-ef433b5be712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a20a78c220e4e928585140b63914a9b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:52.271968 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae07328-2b9e-4f4d-a631-ef433b5be712 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:52.281918 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:52.340552 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9ae07328-2b9e-4f4d-a631-ef433b5be712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a20a78c220e4e928585140b63914a9b', 'request_id': 'req-9ae07328-2b9e-4f4d-a631-ef433b5be712'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:52.347418 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9ae07328-2b9e-4f4d-a631-ef433b5be712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a20a78c220e4e928585140b63914a9b', 'request_id': 'req-9ae07328-2b9e-4f4d-a631-ef433b5be712'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:52.359598 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9ae07328-2b9e-4f4d-a631-ef433b5be712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a20a78c220e4e928585140b63914a9b', 'request_id': 'req-9ae07328-2b9e-4f4d-a631-ef433b5be712'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:52.376477 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9ae07328-2b9e-4f4d-a631-ef433b5be712 admin admin] The token cache is being invalidate because project 8a20a78c220e4e928585140b63914a9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:44:52.376796 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9ae07328-2b9e-4f4d-a631-ef433b5be712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:52.377453 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9ae07328-2b9e-4f4d-a631-ef433b5be712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:44:52.383221 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1340/2714] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:44:52 2022] DELETE /identity/v3/projects/8a20a78c220e4e928585140b63914a9b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:52.395486 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d52e4b-be62-4a43-a9f5-6822af475121 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:52.395486 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d52e4b-be62-4a43-a9f5-6822af475121 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:52.395486 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d52e4b-be62-4a43-a9f5-6822af475121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:52.419827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-72d52e4b-be62-4a43-a9f5-6822af475121 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:52.421084 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-72d52e4b-be62-4a43-a9f5-6822af475121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:52.453990 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:52.544834 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1375/2715] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:52.547046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3520241-843a-4227-806c-d9185c051a43 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:52.547557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3520241-843a-4227-806c-d9185c051a43 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:52.548238 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3520241-843a-4227-806c-d9185c051a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:52.569050 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c3520241-843a-4227-806c-d9185c051a43 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:52.570246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c3520241-843a-4227-806c-d9185c051a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:52.583937 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1341/2716] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:52.586245 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d52e4b-be62-4a43-a9f5-6822af475121 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:52.598908 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d52e4b-be62-4a43-a9f5-6822af475121 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:52.606469 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f2714-32f6-41fe-9f7e-9963d062f48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:52.607558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f2714-32f6-41fe-9f7e-9963d062f48a admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:52.608059 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f2714-32f6-41fe-9f7e-9963d062f48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:52.608623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f2714-32f6-41fe-9f7e-9963d062f48a admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:52.609578 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f2714-32f6-41fe-9f7e-9963d062f48a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:44:52.610128 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f2714-32f6-41fe-9f7e-9963d062f48a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:52.612448 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f2714-32f6-41fe-9f7e-9963d062f48a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:52.647045 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1376/2717] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:44:52.651404 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3520241-843a-4227-806c-d9185c051a43 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:52.663518 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3520241-843a-4227-806c-d9185c051a43 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:52.680429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d4a23-9e98-4d0a-847a-220319359e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:52.682948 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d4a23-9e98-4d0a-847a-220319359e39 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:52.683298 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d4a23-9e98-4d0a-847a-220319359e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:52.683647 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d4a23-9e98-4d0a-847a-220319359e39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:52.684527 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d4a23-9e98-4d0a-847a-220319359e39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:52.687133 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d4a23-9e98-4d0a-847a-220319359e39 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:52.772125 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1342/2718] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:44:52 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:52.774644 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f2714-32f6-41fe-9f7e-9963d062f48a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:52.788257 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f2714-32f6-41fe-9f7e-9963d062f48a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:52.889938 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c06a2c-c5c0-49c5-9c11-fa93b81d4e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:52.891122 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c06a2c-c5c0-49c5-9c11-fa93b81d4e06 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:52.891613 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c06a2c-c5c0-49c5-9c11-fa93b81d4e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:52.892098 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c06a2c-c5c0-49c5-9c11-fa93b81d4e06 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:52.893046 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c06a2c-c5c0-49c5-9c11-fa93b81d4e06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:52.897377 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c06a2c-c5c0-49c5-9c11-fa93b81d4e06 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:52.928414 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1377/2719] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:44:52 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:52.928948 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d4a23-9e98-4d0a-847a-220319359e39 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:52.956829 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d4a23-9e98-4d0a-847a-220319359e39 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:52.962999 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551ed75-7832-4db0-b3c6-7c32cae97ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:52.963866 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551ed75-7832-4db0-b3c6-7c32cae97ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:52.964028 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551ed75-7832-4db0-b3c6-7c32cae97ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:52.964496 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551ed75-7832-4db0-b3c6-7c32cae97ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:52.965084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551ed75-7832-4db0-b3c6-7c32cae97ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:52.966699 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551ed75-7832-4db0-b3c6-7c32cae97ba6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:52.980075 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1343/2720] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:52.984199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c06a2c-c5c0-49c5-9c11-fa93b81d4e06 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:52.995409 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c06a2c-c5c0-49c5-9c11-fa93b81d4e06 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:53.000619 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54308fb9-2c88-4b03-a7e2-0ceef85973d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:53.001511 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54308fb9-2c88-4b03-a7e2-0ceef85973d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:53.002014 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54308fb9-2c88-4b03-a7e2-0ceef85973d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:53.002503 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54308fb9-2c88-4b03-a7e2-0ceef85973d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:53.003691 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54308fb9-2c88-4b03-a7e2-0ceef85973d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:53.005522 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54308fb9-2c88-4b03-a7e2-0ceef85973d1 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:53.027778 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1378/2721] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:44:53.032037 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551ed75-7832-4db0-b3c6-7c32cae97ba6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:53.043026 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551ed75-7832-4db0-b3c6-7c32cae97ba6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:53.049107 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7c672-601b-4249-8870-79bfcb3dc412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:53.049999 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7c672-601b-4249-8870-79bfcb3dc412 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:53.050288 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7c672-601b-4249-8870-79bfcb3dc412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:53.050563 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7c672-601b-4249-8870-79bfcb3dc412 admin admin] PATH_INFO: `/v3/projects/e8a67904fa9147a69be9f6ba96dc2bf4/users/ba8b7003195843b9a6d5d67e1a083f82/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:53.070062 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7c672-601b-4249-8870-79bfcb3dc412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8a67904fa9147a69be9f6ba96dc2bf4, user_id=ba8b7003195843b9a6d5d67e1a083f82, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:53.073008 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7c672-601b-4249-8870-79bfcb3dc412 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:53.087874 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1344/2722] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:53 2022] PUT /identity/v3/projects/e8a67904fa9147a69be9f6ba96dc2bf4/users/ba8b7003195843b9a6d5d67e1a083f82/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:53.098872 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46c188-b54c-41bd-8726-ad7caa6c5706 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:53.099339 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46c188-b54c-41bd-8726-ad7caa6c5706 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:53.099752 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46c188-b54c-41bd-8726-ad7caa6c5706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:53.130969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-fb46c188-b54c-41bd-8726-ad7caa6c5706 None None] MFA Rules not processed for user `ba8b7003195843b9a6d5d67e1a083f82`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:53.132389 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fb46c188-b54c-41bd-8726-ad7caa6c5706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:53.208340 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1379/2723] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:53.210261 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7c672-601b-4249-8870-79bfcb3dc412 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:53.284200 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7c672-601b-4249-8870-79bfcb3dc412 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:53.289256 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1cc9d-e86c-4184-9482-85ae5be30ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:53.290024 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1cc9d-e86c-4184-9482-85ae5be30ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:53.290553 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1cc9d-e86c-4184-9482-85ae5be30ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:53.290948 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1cc9d-e86c-4184-9482-85ae5be30ce6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:53.292543 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1cc9d-e86c-4184-9482-85ae5be30ce6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:53.294426 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1cc9d-e86c-4184-9482-85ae5be30ce6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:53.324761 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1345/2724] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:44:53 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:53.327625 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46c188-b54c-41bd-8726-ad7caa6c5706 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:53.340068 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46c188-b54c-41bd-8726-ad7caa6c5706 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:53.360774 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:53.411775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f43c2-e352-4638-aabc-42e3719dc090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:53.412565 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f43c2-e352-4638-aabc-42e3719dc090 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:53.412904 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f43c2-e352-4638-aabc-42e3719dc090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:53.413246 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f43c2-e352-4638-aabc-42e3719dc090 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:53.414016 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f43c2-e352-4638-aabc-42e3719dc090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:53.416012 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f43c2-e352-4638-aabc-42e3719dc090 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:53.441637 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1380/2725] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:44:53 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:53.445895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1cc9d-e86c-4184-9482-85ae5be30ce6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:53.458211 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1cc9d-e86c-4184-9482-85ae5be30ce6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:53.464052 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d483f-0c4f-4037-9184-171e71a9360f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:53.465297 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d483f-0c4f-4037-9184-171e71a9360f admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:53.465643 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d483f-0c4f-4037-9184-171e71a9360f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:53.465928 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d483f-0c4f-4037-9184-171e71a9360f admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:53.466687 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d483f-0c4f-4037-9184-171e71a9360f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:53.468348 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d483f-0c4f-4037-9184-171e71a9360f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:53.483055 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1346/2726] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:44:53.487015 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f43c2-e352-4638-aabc-42e3719dc090 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:53.499063 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f43c2-e352-4638-aabc-42e3719dc090 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:53.504404 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c0393-cfab-4a5d-8a06-bc943e773b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:53.505271 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c0393-cfab-4a5d-8a06-bc943e773b03 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:53.505907 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c0393-cfab-4a5d-8a06-bc943e773b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:53.506345 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c0393-cfab-4a5d-8a06-bc943e773b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:53.507252 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c0393-cfab-4a5d-8a06-bc943e773b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:53.509058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c0393-cfab-4a5d-8a06-bc943e773b03 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:53.521675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1381/2727] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:53.525580 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d483f-0c4f-4037-9184-171e71a9360f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:53.538188 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d483f-0c4f-4037-9184-171e71a9360f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:53.544829 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8a2e3-d546-4999-95e1-9ceeecb20580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:53.545942 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8a2e3-d546-4999-95e1-9ceeecb20580 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:53.546336 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8a2e3-d546-4999-95e1-9ceeecb20580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:53.546734 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8a2e3-d546-4999-95e1-9ceeecb20580 admin admin] PATH_INFO: `/v3/projects/c8ee31d75ee04b82b054d0ce81cce575/users/fa1de3548d0e4cb88b8f0f5fb0e18a9d/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:53.550793 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:53.572948 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8a2e3-d546-4999-95e1-9ceeecb20580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8ee31d75ee04b82b054d0ce81cce575, user_id=fa1de3548d0e4cb88b8f0f5fb0e18a9d, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:53.575841 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8a2e3-d546-4999-95e1-9ceeecb20580 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:53.591442 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1347/2728] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:53 2022] PUT /identity/v3/projects/c8ee31d75ee04b82b054d0ce81cce575/users/fa1de3548d0e4cb88b8f0f5fb0e18a9d/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:53.601779 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2760f74-f177-40ce-9b57-846420d81738 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:53.602137 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2760f74-f177-40ce-9b57-846420d81738 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:53.602487 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2760f74-f177-40ce-9b57-846420d81738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:53.631251 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c2760f74-f177-40ce-9b57-846420d81738 None None] MFA Rules not processed for user `fa1de3548d0e4cb88b8f0f5fb0e18a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:53.632719 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c2760f74-f177-40ce-9b57-846420d81738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:53.709067 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1382/2729] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:53.713364 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8a2e3-d546-4999-95e1-9ceeecb20580 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:53.791112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8a2e3-d546-4999-95e1-9ceeecb20580 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:53.796716 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327a485-497e-443a-93fe-f80cc5b12830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:53.797960 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327a485-497e-443a-93fe-f80cc5b12830 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:53.798313 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327a485-497e-443a-93fe-f80cc5b12830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:53.798723 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327a485-497e-443a-93fe-f80cc5b12830 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:53.799422 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327a485-497e-443a-93fe-f80cc5b12830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:53.801659 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327a485-497e-443a-93fe-f80cc5b12830 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:53.841768 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1348/2730] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:44:53 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:53.845630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2760f74-f177-40ce-9b57-846420d81738 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:53.861535 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2760f74-f177-40ce-9b57-846420d81738 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:54.003602 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8899d-61ec-4443-ac44-03c8b971ac6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:54.004514 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8899d-61ec-4443-ac44-03c8b971ac6f admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:54.005789 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8899d-61ec-4443-ac44-03c8b971ac6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:54.007319 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8899d-61ec-4443-ac44-03c8b971ac6f admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:54.011791 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b8899d-61ec-4443-ac44-03c8b971ac6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:54.014504 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b8899d-61ec-4443-ac44-03c8b971ac6f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:54.055129 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1383/2731] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:44:53 2022] POST /identity/v3/users => generated 299 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:54.058788 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327a485-497e-443a-93fe-f80cc5b12830 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:54.071185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327a485-497e-443a-93fe-f80cc5b12830 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:54.078924 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c9b39-5d79-45fe-a943-f2c753d73752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:54.079706 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c9b39-5d79-45fe-a943-f2c753d73752 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:54.080000 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c9b39-5d79-45fe-a943-f2c753d73752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:54.080274 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c9b39-5d79-45fe-a943-f2c753d73752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:54.081998 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c9b39-5d79-45fe-a943-f2c753d73752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:54.083709 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c9b39-5d79-45fe-a943-f2c753d73752 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:54.099321 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1349/2732] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:44:54.100915 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8899d-61ec-4443-ac44-03c8b971ac6f admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:54.113216 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8899d-61ec-4443-ac44-03c8b971ac6f admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:54.119736 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1849b-4421-4b7a-a226-3f473e997c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:54.121211 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1849b-4421-4b7a-a226-3f473e997c91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:54.121697 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1849b-4421-4b7a-a226-3f473e997c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:54.121992 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1849b-4421-4b7a-a226-3f473e997c91 admin admin] PATH_INFO: `/v3/projects/608a706696ca4c4884fee1a203766fc0/users/59e80d55dc834e61a139d59570b9df92/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:54.138208 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:54.146054 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1849b-4421-4b7a-a226-3f473e997c91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=608a706696ca4c4884fee1a203766fc0, user_id=59e80d55dc834e61a139d59570b9df92, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:54.148814 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1849b-4421-4b7a-a226-3f473e997c91 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:54.172382 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1384/2733] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:54 2022] PUT /identity/v3/projects/608a706696ca4c4884fee1a203766fc0/users/59e80d55dc834e61a139d59570b9df92/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:54.173459 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c9b39-5d79-45fe-a943-f2c753d73752 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:54.191312 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c9b39-5d79-45fe-a943-f2c753d73752 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:54.290416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba798b6-4c9c-4e8d-b41a-3dd27162bd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:54.292327 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba798b6-4c9c-4e8d-b41a-3dd27162bd08 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:54.292632 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba798b6-4c9c-4e8d-b41a-3dd27162bd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:54.292927 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba798b6-4c9c-4e8d-b41a-3dd27162bd08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:54.293649 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba798b6-4c9c-4e8d-b41a-3dd27162bd08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:54.295772 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba798b6-4c9c-4e8d-b41a-3dd27162bd08 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:54.310131 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1350/2734] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:54.314667 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1849b-4421-4b7a-a226-3f473e997c91 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:54.325919 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1849b-4421-4b7a-a226-3f473e997c91 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:54.331840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42dae4-82aa-4807-9ad0-d8b3467b433d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:54.333244 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42dae4-82aa-4807-9ad0-d8b3467b433d admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:54.333529 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42dae4-82aa-4807-9ad0-d8b3467b433d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:54.333809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42dae4-82aa-4807-9ad0-d8b3467b433d admin admin] PATH_INFO: `/v3/projects/608a706696ca4c4884fee1a203766fc0/users/59e80d55dc834e61a139d59570b9df92/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:54.336153 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42dae4-82aa-4807-9ad0-d8b3467b433d admin admin] RBAC: Authorizing `identity:create_grant(project_id=608a706696ca4c4884fee1a203766fc0, user_id=59e80d55dc834e61a139d59570b9df92, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:54.343652 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42dae4-82aa-4807-9ad0-d8b3467b433d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:54.365868 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1385/2735] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:54 2022] PUT /identity/v3/projects/608a706696ca4c4884fee1a203766fc0/users/59e80d55dc834e61a139d59570b9df92/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:54.367579 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37347bd6-9df8-4091-a06f-f51810f1df5f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:54.367877 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37347bd6-9df8-4091-a06f-f51810f1df5f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:54.368194 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37347bd6-9df8-4091-a06f-f51810f1df5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:54.400819 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-37347bd6-9df8-4091-a06f-f51810f1df5f None None] MFA Rules not processed for user `59e80d55dc834e61a139d59570b9df92`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:54.402256 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-37347bd6-9df8-4091-a06f-f51810f1df5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:54.454145 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:54.494509 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1351/2736] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:54.505053 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42dae4-82aa-4807-9ad0-d8b3467b433d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:54.507429 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bb42dae4-82aa-4807-9ad0-d8b3467b433d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:54.575718 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42dae4-82aa-4807-9ad0-d8b3467b433d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:54.581682 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f6804-9d73-4025-8164-e874bd90b1ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:54.582361 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f6804-9d73-4025-8164-e874bd90b1ac service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:54.582653 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f6804-9d73-4025-8164-e874bd90b1ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:54.583539 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f6804-9d73-4025-8164-e874bd90b1ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:54.657827 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f6804-9d73-4025-8164-e874bd90b1ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:54.659478 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f6804-9d73-4025-8164-e874bd90b1ac service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:54.671973 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1386/2737] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:55.146762 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57667208-5c2c-4b64-b915-c8c78ad2cfaf None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:55.147277 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57667208-5c2c-4b64-b915-c8c78ad2cfaf None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:55.147722 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57667208-5c2c-4b64-b915-c8c78ad2cfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:55.200674 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-57667208-5c2c-4b64-b915-c8c78ad2cfaf None None] MFA Rules not processed for user `64d281c3f8e447aaacb073ed0f8c7a35`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:55.203567 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-57667208-5c2c-4b64-b915-c8c78ad2cfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:55.325275 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1352/2738] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:44:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:55.329958 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f6804-9d73-4025-8164-e874bd90b1ac service cinder] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:55.335092 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-742f6804-9d73-4025-8164-e874bd90b1ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:55.433673 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f6804-9d73-4025-8164-e874bd90b1ac service cinder] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:55.439977 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7140701-a19c-4503-96f3-bce36b0ffef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:55.440931 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7140701-a19c-4503-96f3-bce36b0ffef7 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:55.441963 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7140701-a19c-4503-96f3-bce36b0ffef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:55.442258 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7140701-a19c-4503-96f3-bce36b0ffef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:55.443336 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7140701-a19c-4503-96f3-bce36b0ffef7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:55.445155 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7140701-a19c-4503-96f3-bce36b0ffef7 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:55.478693 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1387/2739] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:44:55 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:55.485437 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57667208-5c2c-4b64-b915-c8c78ad2cfaf None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:55.499562 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57667208-5c2c-4b64-b915-c8c78ad2cfaf None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:55.609551 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c6a14-1777-49da-90e2-f021612b6f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:55.610839 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c6a14-1777-49da-90e2-f021612b6f90 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:55.611899 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c6a14-1777-49da-90e2-f021612b6f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:55.612327 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c6a14-1777-49da-90e2-f021612b6f90 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:55.618276 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c6a14-1777-49da-90e2-f021612b6f90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:55.622206 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c6a14-1777-49da-90e2-f021612b6f90 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:55.648363 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1353/2740] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:44:55 2022] POST /identity/v3/users => generated 295 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:44:55.652627 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7140701-a19c-4503-96f3-bce36b0ffef7 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:55.665629 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7140701-a19c-4503-96f3-bce36b0ffef7 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:55.671731 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f358f92-be49-4a7b-a40e-daaf452565b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:55.672458 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f358f92-be49-4a7b-a40e-daaf452565b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:55.672744 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f358f92-be49-4a7b-a40e-daaf452565b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:55.673027 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f358f92-be49-4a7b-a40e-daaf452565b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:55.673800 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f358f92-be49-4a7b-a40e-daaf452565b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:55.675437 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f358f92-be49-4a7b-a40e-daaf452565b6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:55.689061 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1388/2741] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:44:55.693343 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c6a14-1777-49da-90e2-f021612b6f90 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:55.708322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c6a14-1777-49da-90e2-f021612b6f90 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:55.716755 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610802e9-2ebc-471e-82ce-568ac6c1fa35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:55.717674 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610802e9-2ebc-471e-82ce-568ac6c1fa35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:55.717961 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610802e9-2ebc-471e-82ce-568ac6c1fa35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:55.718242 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610802e9-2ebc-471e-82ce-568ac6c1fa35 admin admin] PATH_INFO: `/v3/projects/54a5ef516e584e66941825e061afdfac/users/8568dd6145f54f46bb2781968b5c4ac9/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:55.740742 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610802e9-2ebc-471e-82ce-568ac6c1fa35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54a5ef516e584e66941825e061afdfac, user_id=8568dd6145f54f46bb2781968b5c4ac9, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:55.744766 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610802e9-2ebc-471e-82ce-568ac6c1fa35 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:55.765680 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1354/2742] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:55 2022] PUT /identity/v3/projects/54a5ef516e584e66941825e061afdfac/users/8568dd6145f54f46bb2781968b5c4ac9/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:44:55.766700 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f358f92-be49-4a7b-a40e-daaf452565b6 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:55.773305 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:55.780169 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f358f92-be49-4a7b-a40e-daaf452565b6 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:55.844848 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5c044-4e8c-48de-bbcc-eeafdf2a0f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:55.845556 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5c044-4e8c-48de-bbcc-eeafdf2a0f5b admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:55.845874 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5c044-4e8c-48de-bbcc-eeafdf2a0f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:55.846109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5c044-4e8c-48de-bbcc-eeafdf2a0f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:55.846842 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5c044-4e8c-48de-bbcc-eeafdf2a0f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:55.848534 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5c044-4e8c-48de-bbcc-eeafdf2a0f5b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:55.859846 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1389/2743] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:44:55.864059 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610802e9-2ebc-471e-82ce-568ac6c1fa35 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:55.875153 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610802e9-2ebc-471e-82ce-568ac6c1fa35 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:55.880332 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4376f8-4aca-4eea-873f-33de85d68e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:55.880954 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4376f8-4aca-4eea-873f-33de85d68e9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:55.881322 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4376f8-4aca-4eea-873f-33de85d68e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:55.881669 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4376f8-4aca-4eea-873f-33de85d68e9d admin admin] PATH_INFO: `/v3/projects/54a5ef516e584e66941825e061afdfac/users/8568dd6145f54f46bb2781968b5c4ac9/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:55.883980 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4376f8-4aca-4eea-873f-33de85d68e9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=54a5ef516e584e66941825e061afdfac, user_id=8568dd6145f54f46bb2781968b5c4ac9, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:55.887393 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4376f8-4aca-4eea-873f-33de85d68e9d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:55.899825 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1355/2744] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:44:55 2022] PUT /identity/v3/projects/54a5ef516e584e66941825e061afdfac/users/8568dd6145f54f46bb2781968b5c4ac9/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:44:56.329743 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5c044-4e8c-48de-bbcc-eeafdf2a0f5b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:56.331891 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c3f5c044-4e8c-48de-bbcc-eeafdf2a0f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:56.405161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5c044-4e8c-48de-bbcc-eeafdf2a0f5b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:56.476502 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506e72e-070f-4dd6-9c5d-c39cb9be8ac3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:56.477132 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506e72e-070f-4dd6-9c5d-c39cb9be8ac3 service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:56.477435 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506e72e-070f-4dd6-9c5d-c39cb9be8ac3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:56.477933 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506e72e-070f-4dd6-9c5d-c39cb9be8ac3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:56.612501 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506e72e-070f-4dd6-9c5d-c39cb9be8ac3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:56.613987 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506e72e-070f-4dd6-9c5d-c39cb9be8ac3 service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:56.626855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1390/2745] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:57.459875 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4376f8-4aca-4eea-873f-33de85d68e9d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:57.471505 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4376f8-4aca-4eea-873f-33de85d68e9d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:57.475717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc01645-3606-4620-bb22-9cade1e093fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:57.476511 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc01645-3606-4620-bb22-9cade1e093fb service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:57.476931 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc01645-3606-4620-bb22-9cade1e093fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:57.477331 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc01645-3606-4620-bb22-9cade1e093fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:57.500644 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:57.553345 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc01645-3606-4620-bb22-9cade1e093fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:57.555139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc01645-3606-4620-bb22-9cade1e093fb service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:57.567187 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1356/2746] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:01.483693 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bca420-5995-4617-b859-a93e1ecfdf95 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:01.484171 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bca420-5995-4617-b859-a93e1ecfdf95 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:01.484512 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bca420-5995-4617-b859-a93e1ecfdf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:01.505779 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:01.515042 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-92bca420-5995-4617-b859-a93e1ecfdf95 None None] MFA Rules not processed for user `8568dd6145f54f46bb2781968b5c4ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:01.516249 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-92bca420-5995-4617-b859-a93e1ecfdf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:01.588596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1391/2747] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:45:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:01.602231 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc01645-3606-4620-bb22-9cade1e093fb service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:01.604451 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bcc01645-3606-4620-bb22-9cade1e093fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:01.682772 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc01645-3606-4620-bb22-9cade1e093fb service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:01.688289 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123600a3-5e26-4ff7-968d-bd4f87521707 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:01.688959 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123600a3-5e26-4ff7-968d-bd4f87521707 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:01.689242 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123600a3-5e26-4ff7-968d-bd4f87521707 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:01.689517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123600a3-5e26-4ff7-968d-bd4f87521707 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:01.748719 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123600a3-5e26-4ff7-968d-bd4f87521707 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:01.750683 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123600a3-5e26-4ff7-968d-bd4f87521707 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:01.760554 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1357/2748] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:01.843893 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bca420-5995-4617-b859-a93e1ecfdf95 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:01.927802 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bca420-5995-4617-b859-a93e1ecfdf95 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:01.934962 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6e66a-aca7-47da-89c2-42333817c8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:01.936078 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6e66a-aca7-47da-89c2-42333817c8a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:01.936476 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6e66a-aca7-47da-89c2-42333817c8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:01.936760 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6e66a-aca7-47da-89c2-42333817c8a4 admin admin] PATH_INFO: `/v3/users/ba8b7003195843b9a6d5d67e1a083f82` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:01.938450 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6e66a-aca7-47da-89c2-42333817c8a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba8b7003195843b9a6d5d67e1a083f82)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:01.940576 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6e66a-aca7-47da-89c2-42333817c8a4 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:02.013798 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-bad6e66a-aca7-47da-89c2-42333817c8a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba8b7003195843b9a6d5d67e1a083f82'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:02.024763 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-bad6e66a-aca7-47da-89c2-42333817c8a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba8b7003195843b9a6d5d67e1a083f82'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:02.026358 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-bad6e66a-aca7-47da-89c2-42333817c8a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba8b7003195843b9a6d5d67e1a083f82'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:02.044024 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-bad6e66a-aca7-47da-89c2-42333817c8a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba8b7003195843b9a6d5d67e1a083f82'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:02.053493 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-bad6e66a-aca7-47da-89c2-42333817c8a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba8b7003195843b9a6d5d67e1a083f82'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:02.060817 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1392/2749] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:45:01 2022] DELETE /identity/v3/users/ba8b7003195843b9a6d5d67e1a083f82 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:02.065576 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b8775-6af8-466e-bf67-71a50df464c3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:02.065576 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b8775-6af8-466e-bf67-71a50df464c3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:02.065838 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b8775-6af8-466e-bf67-71a50df464c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:02.084560 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b28b8775-6af8-466e-bf67-71a50df464c3 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:02.085693 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b28b8775-6af8-466e-bf67-71a50df464c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:02.155335 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:02.171850 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1358/2750] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:02.184373 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6e66a-aca7-47da-89c2-42333817c8a4 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:02.185806 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bad6e66a-aca7-47da-89c2-42333817c8a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:02.206505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:02.259678 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6e66a-aca7-47da-89c2-42333817c8a4 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:02.264024 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4d6a3-fdd8-46f4-bf82-6954f85ddbc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:02.264905 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4d6a3-fdd8-46f4-bf82-6954f85ddbc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:02.265248 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4d6a3-fdd8-46f4-bf82-6954f85ddbc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:02.265535 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4d6a3-fdd8-46f4-bf82-6954f85ddbc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:02.276086 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d4d6a3-fdd8-46f4-bf82-6954f85ddbc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:02.277669 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d4d6a3-fdd8-46f4-bf82-6954f85ddbc8 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:02.289319 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1393/2751] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:02.835928 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b8775-6af8-466e-bf67-71a50df464c3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:02.837469 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b28b8775-6af8-466e-bf67-71a50df464c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:02.860074 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b8775-6af8-466e-bf67-71a50df464c3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:02.864743 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ceaa01-c0a0-4269-a0ec-fc6f73cd1c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:02.865612 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ceaa01-c0a0-4269-a0ec-fc6f73cd1c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:02.865895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ceaa01-c0a0-4269-a0ec-fc6f73cd1c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:02.866176 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ceaa01-c0a0-4269-a0ec-fc6f73cd1c0b admin admin] PATH_INFO: `/v3/projects/e8a67904fa9147a69be9f6ba96dc2bf4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:02.868059 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ceaa01-c0a0-4269-a0ec-fc6f73cd1c0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8a67904fa9147a69be9f6ba96dc2bf4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:02.870678 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ceaa01-c0a0-4269-a0ec-fc6f73cd1c0b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:02.942201 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c2ceaa01-c0a0-4269-a0ec-fc6f73cd1c0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8a67904fa9147a69be9f6ba96dc2bf4', 'request_id': 'req-c2ceaa01-c0a0-4269-a0ec-fc6f73cd1c0b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:02.949239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c2ceaa01-c0a0-4269-a0ec-fc6f73cd1c0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8a67904fa9147a69be9f6ba96dc2bf4', 'request_id': 'req-c2ceaa01-c0a0-4269-a0ec-fc6f73cd1c0b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:02.958552 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c2ceaa01-c0a0-4269-a0ec-fc6f73cd1c0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8a67904fa9147a69be9f6ba96dc2bf4', 'request_id': 'req-c2ceaa01-c0a0-4269-a0ec-fc6f73cd1c0b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:02.972642 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c2ceaa01-c0a0-4269-a0ec-fc6f73cd1c0b admin admin] The token cache is being invalidate because project e8a67904fa9147a69be9f6ba96dc2bf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:45:02.973178 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c2ceaa01-c0a0-4269-a0ec-fc6f73cd1c0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:02.973989 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c2ceaa01-c0a0-4269-a0ec-fc6f73cd1c0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:02.975941 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1359/2752] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:45:02 2022] DELETE /identity/v3/projects/e8a67904fa9147a69be9f6ba96dc2bf4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:02.980592 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4d6a3-fdd8-46f4-bf82-6954f85ddbc8 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:02.990915 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4d6a3-fdd8-46f4-bf82-6954f85ddbc8 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:03.070665 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00592970-eb83-40a7-b332-1604679fdcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:03.071672 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00592970-eb83-40a7-b332-1604679fdcbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:03.072087 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00592970-eb83-40a7-b332-1604679fdcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:03.072507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00592970-eb83-40a7-b332-1604679fdcbd admin admin] PATH_INFO: `/v3/users/fa1de3548d0e4cb88b8f0f5fb0e18a9d` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:03.073806 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00592970-eb83-40a7-b332-1604679fdcbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa1de3548d0e4cb88b8f0f5fb0e18a9d)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:03.075836 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00592970-eb83-40a7-b332-1604679fdcbd admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:03.139332 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-00592970-eb83-40a7-b332-1604679fdcbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa1de3548d0e4cb88b8f0f5fb0e18a9d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:03.149455 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-00592970-eb83-40a7-b332-1604679fdcbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa1de3548d0e4cb88b8f0f5fb0e18a9d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:03.150317 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-00592970-eb83-40a7-b332-1604679fdcbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa1de3548d0e4cb88b8f0f5fb0e18a9d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:03.171794 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-00592970-eb83-40a7-b332-1604679fdcbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa1de3548d0e4cb88b8f0f5fb0e18a9d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:03.185249 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-00592970-eb83-40a7-b332-1604679fdcbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa1de3548d0e4cb88b8f0f5fb0e18a9d'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:03.191457 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1394/2753] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:45:02 2022] DELETE /identity/v3/users/fa1de3548d0e4cb88b8f0f5fb0e18a9d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:03.505593 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ceaa01-c0a0-4269-a0ec-fc6f73cd1c0b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:03.507155 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c2ceaa01-c0a0-4269-a0ec-fc6f73cd1c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:03.526453 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ceaa01-c0a0-4269-a0ec-fc6f73cd1c0b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:03.605054 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c20fb-39ea-4c60-a33c-433b13c604bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:03.605837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c20fb-39ea-4c60-a33c-433b13c604bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:03.606118 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c20fb-39ea-4c60-a33c-433b13c604bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:03.606393 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c20fb-39ea-4c60-a33c-433b13c604bf admin admin] PATH_INFO: `/v3/projects/c8ee31d75ee04b82b054d0ce81cce575` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:03.607791 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c20fb-39ea-4c60-a33c-433b13c604bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8ee31d75ee04b82b054d0ce81cce575)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:03.610256 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c20fb-39ea-4c60-a33c-433b13c604bf admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:03.688884 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-234c20fb-39ea-4c60-a33c-433b13c604bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8ee31d75ee04b82b054d0ce81cce575', 'request_id': 'req-234c20fb-39ea-4c60-a33c-433b13c604bf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:03.695410 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-234c20fb-39ea-4c60-a33c-433b13c604bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8ee31d75ee04b82b054d0ce81cce575', 'request_id': 'req-234c20fb-39ea-4c60-a33c-433b13c604bf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:03.705002 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-234c20fb-39ea-4c60-a33c-433b13c604bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8ee31d75ee04b82b054d0ce81cce575', 'request_id': 'req-234c20fb-39ea-4c60-a33c-433b13c604bf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:03.719316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-234c20fb-39ea-4c60-a33c-433b13c604bf admin admin] The token cache is being invalidate because project c8ee31d75ee04b82b054d0ce81cce575 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:45:03.719683 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-234c20fb-39ea-4c60-a33c-433b13c604bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:03.722050 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-234c20fb-39ea-4c60-a33c-433b13c604bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:03.724804 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1360/2754] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:45:03 2022] DELETE /identity/v3/projects/c8ee31d75ee04b82b054d0ce81cce575 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:03.728676 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00592970-eb83-40a7-b332-1604679fdcbd admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:03.730104 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-00592970-eb83-40a7-b332-1604679fdcbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:03.743769 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00592970-eb83-40a7-b332-1604679fdcbd admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:03.797119 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:03.824163 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef18416-4629-40bf-bea1-4b8e7bbe1b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:03.825078 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef18416-4629-40bf-bea1-4b8e7bbe1b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:03.825360 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef18416-4629-40bf-bea1-4b8e7bbe1b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:03.825639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef18416-4629-40bf-bea1-4b8e7bbe1b4a admin admin] PATH_INFO: `/v3/users/59e80d55dc834e61a139d59570b9df92` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:03.827100 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef18416-4629-40bf-bea1-4b8e7bbe1b4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=59e80d55dc834e61a139d59570b9df92)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:03.829077 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef18416-4629-40bf-bea1-4b8e7bbe1b4a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:03.881511 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9ef18416-4629-40bf-bea1-4b8e7bbe1b4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59e80d55dc834e61a139d59570b9df92'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:03.888878 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9ef18416-4629-40bf-bea1-4b8e7bbe1b4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59e80d55dc834e61a139d59570b9df92'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:03.889535 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9ef18416-4629-40bf-bea1-4b8e7bbe1b4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59e80d55dc834e61a139d59570b9df92'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:03.901509 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9ef18416-4629-40bf-bea1-4b8e7bbe1b4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59e80d55dc834e61a139d59570b9df92'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:03.908583 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-9ef18416-4629-40bf-bea1-4b8e7bbe1b4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59e80d55dc834e61a139d59570b9df92'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:03.914408 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1395/2755] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:45:03 2022] DELETE /identity/v3/users/59e80d55dc834e61a139d59570b9df92 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:45:04.239571 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c20fb-39ea-4c60-a33c-433b13c604bf admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:04.241180 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-234c20fb-39ea-4c60-a33c-433b13c604bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:04.251276 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:04.256766 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c20fb-39ea-4c60-a33c-433b13c604bf admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:04.327456 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1e8ee-0dbc-4f14-95e3-4648e01cbb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:04.328381 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1e8ee-0dbc-4f14-95e3-4648e01cbb74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:04.328668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1e8ee-0dbc-4f14-95e3-4648e01cbb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:04.328946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1e8ee-0dbc-4f14-95e3-4648e01cbb74 admin admin] PATH_INFO: `/v3/projects/608a706696ca4c4884fee1a203766fc0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:04.330186 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1e8ee-0dbc-4f14-95e3-4648e01cbb74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=608a706696ca4c4884fee1a203766fc0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:04.332129 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1e8ee-0dbc-4f14-95e3-4648e01cbb74 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:04.387245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c7c1e8ee-0dbc-4f14-95e3-4648e01cbb74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '608a706696ca4c4884fee1a203766fc0', 'request_id': 'req-c7c1e8ee-0dbc-4f14-95e3-4648e01cbb74'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:04.392653 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c7c1e8ee-0dbc-4f14-95e3-4648e01cbb74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '608a706696ca4c4884fee1a203766fc0', 'request_id': 'req-c7c1e8ee-0dbc-4f14-95e3-4648e01cbb74'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:04.404430 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c7c1e8ee-0dbc-4f14-95e3-4648e01cbb74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '608a706696ca4c4884fee1a203766fc0', 'request_id': 'req-c7c1e8ee-0dbc-4f14-95e3-4648e01cbb74'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:04.416528 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c7c1e8ee-0dbc-4f14-95e3-4648e01cbb74 admin admin] The token cache is being invalidate because project 608a706696ca4c4884fee1a203766fc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:45:04.416851 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c7c1e8ee-0dbc-4f14-95e3-4648e01cbb74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:04.417504 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c7c1e8ee-0dbc-4f14-95e3-4648e01cbb74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:04.419049 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1361/2756] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:45:04 2022] DELETE /identity/v3/projects/608a706696ca4c4884fee1a203766fc0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:04.424646 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d753a-0d41-4719-89d1-be4021d22b8b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:04.425072 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d753a-0d41-4719-89d1-be4021d22b8b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:04.425272 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d753a-0d41-4719-89d1-be4021d22b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:04.444374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-c40d753a-0d41-4719-89d1-be4021d22b8b None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:04.445619 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-c40d753a-0d41-4719-89d1-be4021d22b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:04.519687 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1396/2757] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:04.521809 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03475028-fdc9-408e-975c-a895c71b3361 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:04.522185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03475028-fdc9-408e-975c-a895c71b3361 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:04.522473 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03475028-fdc9-408e-975c-a895c71b3361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:04.543262 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-03475028-fdc9-408e-975c-a895c71b3361 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:04.544527 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-03475028-fdc9-408e-975c-a895c71b3361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:04.552785 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1362/2758] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:04.557491 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d753a-0d41-4719-89d1-be4021d22b8b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:04.567189 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d753a-0d41-4719-89d1-be4021d22b8b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:04.571754 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae7103-ea02-4cc8-962a-d9f361c6931b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:04.573041 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae7103-ea02-4cc8-962a-d9f361c6931b admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:04.573331 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae7103-ea02-4cc8-962a-d9f361c6931b admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:04.573607 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae7103-ea02-4cc8-962a-d9f361c6931b admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:04.574332 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae7103-ea02-4cc8-962a-d9f361c6931b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:45:04.574640 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae7103-ea02-4cc8-962a-d9f361c6931b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:04.576256 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae7103-ea02-4cc8-962a-d9f361c6931b admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:04.592087 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1397/2759] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:45:04.594069 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03475028-fdc9-408e-975c-a895c71b3361 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:04.604678 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03475028-fdc9-408e-975c-a895c71b3361 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:04.609406 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7f330-dfb7-481f-ae29-a9d95e1cc3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:04.610095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7f330-dfb7-481f-ae29-a9d95e1cc3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:04.610544 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7f330-dfb7-481f-ae29-a9d95e1cc3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:04.610821 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7f330-dfb7-481f-ae29-a9d95e1cc3b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:04.611524 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7f330-dfb7-481f-ae29-a9d95e1cc3b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:04.613469 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7f330-dfb7-481f-ae29-a9d95e1cc3b6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:04.643074 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1363/2760] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:45:04 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:45:04.653442 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae7103-ea02-4cc8-962a-d9f361c6931b admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:04.665753 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae7103-ea02-4cc8-962a-d9f361c6931b admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:04.710515 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:04.730936 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51fd51-13bf-4338-914b-e032136f7437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:04.731696 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51fd51-13bf-4338-914b-e032136f7437 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:04.732508 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51fd51-13bf-4338-914b-e032136f7437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:04.732508 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51fd51-13bf-4338-914b-e032136f7437 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:04.733315 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51fd51-13bf-4338-914b-e032136f7437 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:04.735307 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51fd51-13bf-4338-914b-e032136f7437 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:04.768781 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1398/2761] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:45:04 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:45:04.770375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7f330-dfb7-481f-ae29-a9d95e1cc3b6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:04.783388 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7f330-dfb7-481f-ae29-a9d95e1cc3b6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:04.788183 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426043f-8a45-4967-8356-96bc5eb35837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:04.788889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426043f-8a45-4967-8356-96bc5eb35837 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:04.789174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426043f-8a45-4967-8356-96bc5eb35837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:04.789589 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426043f-8a45-4967-8356-96bc5eb35837 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:04.790324 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426043f-8a45-4967-8356-96bc5eb35837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:04.792532 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426043f-8a45-4967-8356-96bc5eb35837 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:04.803946 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1364/2762] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:45:04.809513 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51fd51-13bf-4338-914b-e032136f7437 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:04.822462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51fd51-13bf-4338-914b-e032136f7437 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:04.829835 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd5675-2da2-444b-9249-e6b97c5d46eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:04.830925 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd5675-2da2-444b-9249-e6b97c5d46eb admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:04.831292 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd5675-2da2-444b-9249-e6b97c5d46eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:04.831579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd5675-2da2-444b-9249-e6b97c5d46eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:04.832655 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd5675-2da2-444b-9249-e6b97c5d46eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:04.834413 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd5675-2da2-444b-9249-e6b97c5d46eb admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:04.851105 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1399/2763] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:45:04.851809 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426043f-8a45-4967-8356-96bc5eb35837 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:04.877125 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426043f-8a45-4967-8356-96bc5eb35837 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:04.882802 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffc2d9-e0cd-4ed5-b524-4a8abe2dd12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:04.884032 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffc2d9-e0cd-4ed5-b524-4a8abe2dd12b admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:04.884684 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffc2d9-e0cd-4ed5-b524-4a8abe2dd12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:04.885013 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffc2d9-e0cd-4ed5-b524-4a8abe2dd12b admin admin] PATH_INFO: `/v3/projects/9314a89fec2e421fbcc4ae1b85de2a96/users/d77f2cd2e7b44199a8acd6ee569b27c6/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:04.905358 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bffc2d9-e0cd-4ed5-b524-4a8abe2dd12b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9314a89fec2e421fbcc4ae1b85de2a96, user_id=d77f2cd2e7b44199a8acd6ee569b27c6, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:04.907941 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bffc2d9-e0cd-4ed5-b524-4a8abe2dd12b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:04.935917 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1365/2764] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:45:04 2022] PUT /identity/v3/projects/9314a89fec2e421fbcc4ae1b85de2a96/users/d77f2cd2e7b44199a8acd6ee569b27c6/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:05.012235 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd24048-f7ee-4eb8-90ac-d28f2b1f470c None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:05.012726 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd24048-f7ee-4eb8-90ac-d28f2b1f470c None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:05.013109 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd24048-f7ee-4eb8-90ac-d28f2b1f470c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:05.048533 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-7cd24048-f7ee-4eb8-90ac-d28f2b1f470c None None] MFA Rules not processed for user `d77f2cd2e7b44199a8acd6ee569b27c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:05.049953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-7cd24048-f7ee-4eb8-90ac-d28f2b1f470c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:05.146752 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1400/2765] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:45:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:05.160643 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffc2d9-e0cd-4ed5-b524-4a8abe2dd12b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:05.162601 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0bffc2d9-e0cd-4ed5-b524-4a8abe2dd12b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:05.226785 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:05.257332 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffc2d9-e0cd-4ed5-b524-4a8abe2dd12b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:05.261915 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac886ce6-0d46-4ba0-b224-ace5b23d54c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:05.262707 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac886ce6-0d46-4ba0-b224-ace5b23d54c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:05.263087 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac886ce6-0d46-4ba0-b224-ace5b23d54c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:05.263478 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac886ce6-0d46-4ba0-b224-ace5b23d54c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:05.273116 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac886ce6-0d46-4ba0-b224-ace5b23d54c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:05.274851 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac886ce6-0d46-4ba0-b224-ace5b23d54c5 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:05.290256 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1366/2766] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:45:15.143052 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=46,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:15.284970 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=12 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:19.530258 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd24048-f7ee-4eb8-90ac-d28f2b1f470c None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:19.597512 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd24048-f7ee-4eb8-90ac-d28f2b1f470c None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:19.602198 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea3376-4d93-4520-abf0-e8004e3f770d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:19.603076 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea3376-4d93-4520-abf0-e8004e3f770d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:19.603362 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea3376-4d93-4520-abf0-e8004e3f770d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:19.603639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea3376-4d93-4520-abf0-e8004e3f770d admin admin] PATH_INFO: `/v3/users/d77f2cd2e7b44199a8acd6ee569b27c6` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:19.604881 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea3376-4d93-4520-abf0-e8004e3f770d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d77f2cd2e7b44199a8acd6ee569b27c6)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:19.606820 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea3376-4d93-4520-abf0-e8004e3f770d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:19.652646 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b9ea3376-4d93-4520-abf0-e8004e3f770d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd77f2cd2e7b44199a8acd6ee569b27c6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:19.662713 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b9ea3376-4d93-4520-abf0-e8004e3f770d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd77f2cd2e7b44199a8acd6ee569b27c6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:19.663421 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b9ea3376-4d93-4520-abf0-e8004e3f770d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd77f2cd2e7b44199a8acd6ee569b27c6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:19.675552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b9ea3376-4d93-4520-abf0-e8004e3f770d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd77f2cd2e7b44199a8acd6ee569b27c6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:19.682935 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-b9ea3376-4d93-4520-abf0-e8004e3f770d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd77f2cd2e7b44199a8acd6ee569b27c6'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:19.690026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1401/2767] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:45:19 2022] DELETE /identity/v3/users/d77f2cd2e7b44199a8acd6ee569b27c6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:19.695372 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cfb9a-5f23-474c-b12a-a2751f67fb7d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:19.695924 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cfb9a-5f23-474c-b12a-a2751f67fb7d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:19.696046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cfb9a-5f23-474c-b12a-a2751f67fb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:19.720047 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4a7cfb9a-5f23-474c-b12a-a2751f67fb7d None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:19.721286 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4a7cfb9a-5f23-474c-b12a-a2751f67fb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:19.783346 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1367/2768] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:19.792883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea3376-4d93-4520-abf0-e8004e3f770d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:19.794269 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b9ea3376-4d93-4520-abf0-e8004e3f770d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:19.850554 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea3376-4d93-4520-abf0-e8004e3f770d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:19.854183 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5db920-eb41-4111-bd80-1f4f30da047d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:19.854822 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5db920-eb41-4111-bd80-1f4f30da047d service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:19.855111 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5db920-eb41-4111-bd80-1f4f30da047d service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:19.855389 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5db920-eb41-4111-bd80-1f4f30da047d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:19.864262 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5db920-eb41-4111-bd80-1f4f30da047d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:19.865738 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5db920-eb41-4111-bd80-1f4f30da047d service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:19.875023 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1402/2769] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:45:20.145064 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7cfb9a-5f23-474c-b12a-a2751f67fb7d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:20.149537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4a7cfb9a-5f23-474c-b12a-a2751f67fb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:20.163467 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7cfb9a-5f23-474c-b12a-a2751f67fb7d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:20.169087 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e0dfe-6c67-438e-8acd-b9c9853cef73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:20.170036 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e0dfe-6c67-438e-8acd-b9c9853cef73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:20.170269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e0dfe-6c67-438e-8acd-b9c9853cef73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:20.170563 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e0dfe-6c67-438e-8acd-b9c9853cef73 admin admin] PATH_INFO: `/v3/projects/9314a89fec2e421fbcc4ae1b85de2a96` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:20.171771 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e0dfe-6c67-438e-8acd-b9c9853cef73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9314a89fec2e421fbcc4ae1b85de2a96)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:20.174044 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e0dfe-6c67-438e-8acd-b9c9853cef73 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:20.221776 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a63e0dfe-6c67-438e-8acd-b9c9853cef73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9314a89fec2e421fbcc4ae1b85de2a96', 'request_id': 'req-a63e0dfe-6c67-438e-8acd-b9c9853cef73'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:20.227029 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a63e0dfe-6c67-438e-8acd-b9c9853cef73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9314a89fec2e421fbcc4ae1b85de2a96', 'request_id': 'req-a63e0dfe-6c67-438e-8acd-b9c9853cef73'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:20.234341 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a63e0dfe-6c67-438e-8acd-b9c9853cef73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9314a89fec2e421fbcc4ae1b85de2a96', 'request_id': 'req-a63e0dfe-6c67-438e-8acd-b9c9853cef73'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:20.245180 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a63e0dfe-6c67-438e-8acd-b9c9853cef73 admin admin] The token cache is being invalidate because project 9314a89fec2e421fbcc4ae1b85de2a96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:45:20.245469 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a63e0dfe-6c67-438e-8acd-b9c9853cef73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:20.246096 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a63e0dfe-6c67-438e-8acd-b9c9853cef73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:20.248136 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1368/2770] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:45:20 2022] DELETE /identity/v3/projects/9314a89fec2e421fbcc4ae1b85de2a96 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:20.253078 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d58fec-18cf-406f-9322-49507d523b20 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:20.253541 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d58fec-18cf-406f-9322-49507d523b20 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:20.253852 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d58fec-18cf-406f-9322-49507d523b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:20.272328 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-39d58fec-18cf-406f-9322-49507d523b20 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:20.274265 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-39d58fec-18cf-406f-9322-49507d523b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:20.290630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:20.339018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1403/2771] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:45:20.346852 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfb388-37d9-4812-9fd2-2e2df6678b8f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:20.347145 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfb388-37d9-4812-9fd2-2e2df6678b8f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:20.347428 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfb388-37d9-4812-9fd2-2e2df6678b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:20.366191 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-36dfb388-37d9-4812-9fd2-2e2df6678b8f None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:20.367382 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-36dfb388-37d9-4812-9fd2-2e2df6678b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:20.376928 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1369/2772] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:20.381108 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d58fec-18cf-406f-9322-49507d523b20 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:20.390844 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d58fec-18cf-406f-9322-49507d523b20 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:20.395406 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85d782-db52-45fc-966d-a6d6aa8caeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:20.396051 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85d782-db52-45fc-966d-a6d6aa8caeec admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:20.396364 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85d782-db52-45fc-966d-a6d6aa8caeec admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:20.396646 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85d782-db52-45fc-966d-a6d6aa8caeec admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:20.397429 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85d782-db52-45fc-966d-a6d6aa8caeec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:45:20.397738 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85d782-db52-45fc-966d-a6d6aa8caeec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:20.399380 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85d782-db52-45fc-966d-a6d6aa8caeec admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:20.411339 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1404/2773] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:45:20.415752 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfb388-37d9-4812-9fd2-2e2df6678b8f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:20.425575 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfb388-37d9-4812-9fd2-2e2df6678b8f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:20.430207 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3dda8-f975-4bf0-8873-6e241d8e0463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:20.430849 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3dda8-f975-4bf0-8873-6e241d8e0463 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:20.431134 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3dda8-f975-4bf0-8873-6e241d8e0463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:20.431413 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3dda8-f975-4bf0-8873-6e241d8e0463 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:20.432099 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3dda8-f975-4bf0-8873-6e241d8e0463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:20.434039 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3dda8-f975-4bf0-8873-6e241d8e0463 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:20.459001 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1370/2774] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:45:20 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:45:20.463018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85d782-db52-45fc-966d-a6d6aa8caeec admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:20.472959 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85d782-db52-45fc-966d-a6d6aa8caeec admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:20.529741 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07407c5-e190-477c-b983-4d88bb0ae33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:20.530412 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07407c5-e190-477c-b983-4d88bb0ae33f admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:20.530991 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07407c5-e190-477c-b983-4d88bb0ae33f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:20.530991 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07407c5-e190-477c-b983-4d88bb0ae33f admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:20.531634 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07407c5-e190-477c-b983-4d88bb0ae33f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:20.533589 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07407c5-e190-477c-b983-4d88bb0ae33f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:20.554493 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1405/2775] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:45:20 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:45:20.558975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3dda8-f975-4bf0-8873-6e241d8e0463 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:20.570117 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3dda8-f975-4bf0-8873-6e241d8e0463 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:20.574927 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5daeaad-1393-4a3a-a396-e4d7b5543abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:20.575600 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5daeaad-1393-4a3a-a396-e4d7b5543abc admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:20.575905 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5daeaad-1393-4a3a-a396-e4d7b5543abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:20.576194 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5daeaad-1393-4a3a-a396-e4d7b5543abc admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:20.577219 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5daeaad-1393-4a3a-a396-e4d7b5543abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:20.578826 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5daeaad-1393-4a3a-a396-e4d7b5543abc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:20.589280 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1371/2776] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:45:20.593494 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07407c5-e190-477c-b983-4d88bb0ae33f admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:20.603413 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07407c5-e190-477c-b983-4d88bb0ae33f admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:20.608723 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2902517-c680-4ca6-9eb6-eba43e4f0f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:20.609418 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2902517-c680-4ca6-9eb6-eba43e4f0f64 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:20.609705 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2902517-c680-4ca6-9eb6-eba43e4f0f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:20.609985 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2902517-c680-4ca6-9eb6-eba43e4f0f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:20.610719 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2902517-c680-4ca6-9eb6-eba43e4f0f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:20.612330 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2902517-c680-4ca6-9eb6-eba43e4f0f64 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:20.622092 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1406/2777] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:45:20.626537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5daeaad-1393-4a3a-a396-e4d7b5543abc admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:20.636255 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5daeaad-1393-4a3a-a396-e4d7b5543abc admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:20.640797 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61502727-5f0a-4c5e-9ce1-58baac7a16ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:20.641645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61502727-5f0a-4c5e-9ce1-58baac7a16ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:20.641927 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61502727-5f0a-4c5e-9ce1-58baac7a16ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:20.642205 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61502727-5f0a-4c5e-9ce1-58baac7a16ed admin admin] PATH_INFO: `/v3/projects/97425c4354ba47dc9a4a6e434a57c97e/users/665084d472824beb91eb2f615b56ceb1/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:20.656764 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61502727-5f0a-4c5e-9ce1-58baac7a16ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=97425c4354ba47dc9a4a6e434a57c97e, user_id=665084d472824beb91eb2f615b56ceb1, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:20.659388 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61502727-5f0a-4c5e-9ce1-58baac7a16ed admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:20.672840 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1372/2778] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:45:20 2022] PUT /identity/v3/projects/97425c4354ba47dc9a4a6e434a57c97e/users/665084d472824beb91eb2f615b56ceb1/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:20.682639 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3afb36-2dde-4310-95fe-107324fa0fc0 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:20.682934 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3afb36-2dde-4310-95fe-107324fa0fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:20.683218 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3afb36-2dde-4310-95fe-107324fa0fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:20.709764 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-de3afb36-2dde-4310-95fe-107324fa0fc0 None None] MFA Rules not processed for user `665084d472824beb91eb2f615b56ceb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:20.710979 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-de3afb36-2dde-4310-95fe-107324fa0fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:20.774548 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1407/2779] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:45:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:20.785517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61502727-5f0a-4c5e-9ce1-58baac7a16ed admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:20.787181 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-61502727-5f0a-4c5e-9ce1-58baac7a16ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:20.809602 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:20.849165 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61502727-5f0a-4c5e-9ce1-58baac7a16ed admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:20.852807 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372f779-509c-4a81-ac6b-626bd2951633 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:20.853447 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372f779-509c-4a81-ac6b-626bd2951633 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:20.853728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372f779-509c-4a81-ac6b-626bd2951633 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:20.854006 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372f779-509c-4a81-ac6b-626bd2951633 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:20.862918 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372f779-509c-4a81-ac6b-626bd2951633 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:20.864379 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372f779-509c-4a81-ac6b-626bd2951633 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:20.873188 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1373/2780] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:22.230451 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05003d2e-94ae-4d74-a7ba-07eda8edffcd None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:22.230980 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05003d2e-94ae-4d74-a7ba-07eda8edffcd None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:22.231102 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05003d2e-94ae-4d74-a7ba-07eda8edffcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:22.250357 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-05003d2e-94ae-4d74-a7ba-07eda8edffcd None None] MFA Rules not processed for user `665084d472824beb91eb2f615b56ceb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:22.251575 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-05003d2e-94ae-4d74-a7ba-07eda8edffcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:22.258545 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1408/2781] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:45:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:23.766633 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911495cd-17ac-47bb-9463-c81a9ead5506 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:23.767547 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911495cd-17ac-47bb-9463-c81a9ead5506 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:23.767833 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911495cd-17ac-47bb-9463-c81a9ead5506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:23.792785 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-911495cd-17ac-47bb-9463-c81a9ead5506 None None] MFA Rules not processed for user `64d281c3f8e447aaacb073ed0f8c7a35`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:23.794205 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-911495cd-17ac-47bb-9463-c81a9ead5506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:23.864894 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1374/2782] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:45:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:32.243941 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:33.055122 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05003d2e-94ae-4d74-a7ba-07eda8edffcd None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:33.056711 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-05003d2e-94ae-4d74-a7ba-07eda8edffcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:33.123097 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05003d2e-94ae-4d74-a7ba-07eda8edffcd None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:33.127705 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474e28a-a080-4044-a2b3-46186f869c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:33.128596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474e28a-a080-4044-a2b3-46186f869c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:33.128883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474e28a-a080-4044-a2b3-46186f869c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:33.129161 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474e28a-a080-4044-a2b3-46186f869c93 admin admin] PATH_INFO: `/v3/users/cd13e07ba22947f0af413f87499a9218` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:33.130353 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474e28a-a080-4044-a2b3-46186f869c93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd13e07ba22947f0af413f87499a9218)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:33.132259 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474e28a-a080-4044-a2b3-46186f869c93 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:33.177112 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6474e28a-a080-4044-a2b3-46186f869c93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd13e07ba22947f0af413f87499a9218'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:33.183853 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6474e28a-a080-4044-a2b3-46186f869c93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd13e07ba22947f0af413f87499a9218'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:33.184672 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6474e28a-a080-4044-a2b3-46186f869c93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd13e07ba22947f0af413f87499a9218'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:33.197026 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6474e28a-a080-4044-a2b3-46186f869c93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd13e07ba22947f0af413f87499a9218'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:33.204146 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-6474e28a-a080-4044-a2b3-46186f869c93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd13e07ba22947f0af413f87499a9218'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:33.209909 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1409/2783] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:45:33 2022] DELETE /identity/v3/users/cd13e07ba22947f0af413f87499a9218 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:33.214612 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983146f5-c350-4fb5-9ac4-31f3432a1596 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:33.215096 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983146f5-c350-4fb5-9ac4-31f3432a1596 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:33.215096 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983146f5-c350-4fb5-9ac4-31f3432a1596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:33.232699 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-983146f5-c350-4fb5-9ac4-31f3432a1596 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:33.233874 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-983146f5-c350-4fb5-9ac4-31f3432a1596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:33.290908 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1375/2784] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:45:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:33.301192 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474e28a-a080-4044-a2b3-46186f869c93 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:33.302617 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-6474e28a-a080-4044-a2b3-46186f869c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:33.361221 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474e28a-a080-4044-a2b3-46186f869c93 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:33.364889 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3d5c6-ccb4-4632-93d8-caee548dad1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:33.365531 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3d5c6-ccb4-4632-93d8-caee548dad1c service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:33.365817 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3d5c6-ccb4-4632-93d8-caee548dad1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:33.366092 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3d5c6-ccb4-4632-93d8-caee548dad1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:33.375769 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3d5c6-ccb4-4632-93d8-caee548dad1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:33.377227 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3d5c6-ccb4-4632-93d8-caee548dad1c service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:33.386514 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1410/2785] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:33.653861 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983146f5-c350-4fb5-9ac4-31f3432a1596 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:33.655416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-983146f5-c350-4fb5-9ac4-31f3432a1596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:33.667453 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983146f5-c350-4fb5-9ac4-31f3432a1596 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:33.672860 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd2f7a-d356-4a24-bab4-d030f9a7145d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:33.673712 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd2f7a-d356-4a24-bab4-d030f9a7145d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:33.673997 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd2f7a-d356-4a24-bab4-d030f9a7145d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:33.674417 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd2f7a-d356-4a24-bab4-d030f9a7145d admin admin] PATH_INFO: `/v3/projects/1f2885a4b1e84242b849739d37a8a730` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:33.675602 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd2f7a-d356-4a24-bab4-d030f9a7145d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f2885a4b1e84242b849739d37a8a730)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:33.677539 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd2f7a-d356-4a24-bab4-d030f9a7145d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:33.724886 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-acdd2f7a-d356-4a24-bab4-d030f9a7145d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f2885a4b1e84242b849739d37a8a730', 'request_id': 'req-acdd2f7a-d356-4a24-bab4-d030f9a7145d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:33.730375 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-acdd2f7a-d356-4a24-bab4-d030f9a7145d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f2885a4b1e84242b849739d37a8a730', 'request_id': 'req-acdd2f7a-d356-4a24-bab4-d030f9a7145d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:33.734346 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:33.738521 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-acdd2f7a-d356-4a24-bab4-d030f9a7145d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f2885a4b1e84242b849739d37a8a730', 'request_id': 'req-acdd2f7a-d356-4a24-bab4-d030f9a7145d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:33.751490 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-acdd2f7a-d356-4a24-bab4-d030f9a7145d admin admin] The token cache is being invalidate because project 1f2885a4b1e84242b849739d37a8a730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:45:33.751781 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-acdd2f7a-d356-4a24-bab4-d030f9a7145d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:33.752445 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-acdd2f7a-d356-4a24-bab4-d030f9a7145d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:33.754006 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1376/2786] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:45:33 2022] DELETE /identity/v3/projects/1f2885a4b1e84242b849739d37a8a730 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:33.757919 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3d5c6-ccb4-4632-93d8-caee548dad1c service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:33.768163 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3d5c6-ccb4-4632-93d8-caee548dad1c service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:33.786411 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:33.827751 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63333ed-68b8-434e-b181-6c4f129d9e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:33.828658 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63333ed-68b8-434e-b181-6c4f129d9e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:33.828953 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63333ed-68b8-434e-b181-6c4f129d9e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:33.829230 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63333ed-68b8-434e-b181-6c4f129d9e7a admin admin] PATH_INFO: `/v3/users/db99a39ad79c4e4dadd018bc0c9e585a` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:33.830568 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63333ed-68b8-434e-b181-6c4f129d9e7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=db99a39ad79c4e4dadd018bc0c9e585a)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:33.832521 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63333ed-68b8-434e-b181-6c4f129d9e7a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:33.879598 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a63333ed-68b8-434e-b181-6c4f129d9e7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db99a39ad79c4e4dadd018bc0c9e585a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:33.886336 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a63333ed-68b8-434e-b181-6c4f129d9e7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db99a39ad79c4e4dadd018bc0c9e585a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:33.887065 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a63333ed-68b8-434e-b181-6c4f129d9e7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db99a39ad79c4e4dadd018bc0c9e585a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:33.899577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a63333ed-68b8-434e-b181-6c4f129d9e7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db99a39ad79c4e4dadd018bc0c9e585a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:33.906831 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a63333ed-68b8-434e-b181-6c4f129d9e7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db99a39ad79c4e4dadd018bc0c9e585a'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:33.913106 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1411/2787] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:45:33 2022] DELETE /identity/v3/users/db99a39ad79c4e4dadd018bc0c9e585a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:34.341446 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd2f7a-d356-4a24-bab4-d030f9a7145d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:34.342945 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-acdd2f7a-d356-4a24-bab4-d030f9a7145d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:34.356518 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd2f7a-d356-4a24-bab4-d030f9a7145d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:34.414913 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935c480-14c5-4b9b-9904-d31e3f2322f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:34.415799 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935c480-14c5-4b9b-9904-d31e3f2322f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:34.416107 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935c480-14c5-4b9b-9904-d31e3f2322f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:34.416413 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935c480-14c5-4b9b-9904-d31e3f2322f3 admin admin] PATH_INFO: `/v3/projects/44b42df195c64c3cbb87ed57b3c013c4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:34.417590 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935c480-14c5-4b9b-9904-d31e3f2322f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44b42df195c64c3cbb87ed57b3c013c4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:34.419538 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935c480-14c5-4b9b-9904-d31e3f2322f3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:34.464983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0935c480-14c5-4b9b-9904-d31e3f2322f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44b42df195c64c3cbb87ed57b3c013c4', 'request_id': 'req-0935c480-14c5-4b9b-9904-d31e3f2322f3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:34.470454 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0935c480-14c5-4b9b-9904-d31e3f2322f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44b42df195c64c3cbb87ed57b3c013c4', 'request_id': 'req-0935c480-14c5-4b9b-9904-d31e3f2322f3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:34.477694 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0935c480-14c5-4b9b-9904-d31e3f2322f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44b42df195c64c3cbb87ed57b3c013c4', 'request_id': 'req-0935c480-14c5-4b9b-9904-d31e3f2322f3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:34.488769 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0935c480-14c5-4b9b-9904-d31e3f2322f3 admin admin] The token cache is being invalidate because project 44b42df195c64c3cbb87ed57b3c013c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:45:34.489063 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0935c480-14c5-4b9b-9904-d31e3f2322f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:34.489694 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0935c480-14c5-4b9b-9904-d31e3f2322f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:34.491246 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1377/2788] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:45:34 2022] DELETE /identity/v3/projects/44b42df195c64c3cbb87ed57b3c013c4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:34.496469 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c1d33-6a8a-43d4-bd97-cf87febf3f2e None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:34.497501 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c1d33-6a8a-43d4-bd97-cf87febf3f2e None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:34.497605 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c1d33-6a8a-43d4-bd97-cf87febf3f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:34.515487 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-171c1d33-6a8a-43d4-bd97-cf87febf3f2e None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:34.516731 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-171c1d33-6a8a-43d4-bd97-cf87febf3f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:34.575058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1412/2789] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:34.586407 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7194d7-ce3b-44dc-8ed4-0f177b389d0f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:34.586848 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7194d7-ce3b-44dc-8ed4-0f177b389d0f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:34.587196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7194d7-ce3b-44dc-8ed4-0f177b389d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:34.607323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3b7194d7-ce3b-44dc-8ed4-0f177b389d0f None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:34.608737 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3b7194d7-ce3b-44dc-8ed4-0f177b389d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:34.620020 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1378/2790] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:34.621636 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c1d33-6a8a-43d4-bd97-cf87febf3f2e None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:34.632485 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c1d33-6a8a-43d4-bd97-cf87febf3f2e None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:34.637429 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1825725-5371-45ee-aa3a-97af3e616f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:34.638145 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1825725-5371-45ee-aa3a-97af3e616f93 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:34.638435 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1825725-5371-45ee-aa3a-97af3e616f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:34.638720 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1825725-5371-45ee-aa3a-97af3e616f93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:34.639497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1825725-5371-45ee-aa3a-97af3e616f93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:45:34.639809 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1825725-5371-45ee-aa3a-97af3e616f93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:34.641547 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1825725-5371-45ee-aa3a-97af3e616f93 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:34.656495 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1413/2791] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:45:34.658801 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7194d7-ce3b-44dc-8ed4-0f177b389d0f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:34.679648 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7194d7-ce3b-44dc-8ed4-0f177b389d0f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:34.684518 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805b13e-64ef-44b5-83c5-7491b1ba1803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:34.685702 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805b13e-64ef-44b5-83c5-7491b1ba1803 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:34.685985 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805b13e-64ef-44b5-83c5-7491b1ba1803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:34.686260 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805b13e-64ef-44b5-83c5-7491b1ba1803 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:34.686958 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805b13e-64ef-44b5-83c5-7491b1ba1803 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:34.688926 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805b13e-64ef-44b5-83c5-7491b1ba1803 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:34.716429 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1379/2792] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:45:34 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:45:34.720791 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1825725-5371-45ee-aa3a-97af3e616f93 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:34.732153 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1825725-5371-45ee-aa3a-97af3e616f93 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:34.759684 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:34.791697 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94099576-f2a2-476b-9830-4d5b1b7052dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:34.792404 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94099576-f2a2-476b-9830-4d5b1b7052dc admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:34.792697 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94099576-f2a2-476b-9830-4d5b1b7052dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:34.792980 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94099576-f2a2-476b-9830-4d5b1b7052dc admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:34.793716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94099576-f2a2-476b-9830-4d5b1b7052dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:34.796261 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94099576-f2a2-476b-9830-4d5b1b7052dc admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:34.819796 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1414/2793] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:45:34 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:45:34.821104 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805b13e-64ef-44b5-83c5-7491b1ba1803 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:34.832510 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805b13e-64ef-44b5-83c5-7491b1ba1803 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:34.837548 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4366a4-9e1f-4b57-b3a8-61a3bec4ce69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:34.838172 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4366a4-9e1f-4b57-b3a8-61a3bec4ce69 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:34.838459 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4366a4-9e1f-4b57-b3a8-61a3bec4ce69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:34.838735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4366a4-9e1f-4b57-b3a8-61a3bec4ce69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:34.839495 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4366a4-9e1f-4b57-b3a8-61a3bec4ce69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:34.841164 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4366a4-9e1f-4b57-b3a8-61a3bec4ce69 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:34.856988 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1380/2794] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:45:34.863251 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94099576-f2a2-476b-9830-4d5b1b7052dc admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:34.869157 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94099576-f2a2-476b-9830-4d5b1b7052dc admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:34.874580 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae074f-9be6-4bee-ace0-aadd8d51d6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:34.875244 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae074f-9be6-4bee-ace0-aadd8d51d6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:34.875565 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae074f-9be6-4bee-ace0-aadd8d51d6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:34.875844 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae074f-9be6-4bee-ace0-aadd8d51d6d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:34.876628 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae074f-9be6-4bee-ace0-aadd8d51d6d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:34.878232 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae074f-9be6-4bee-ace0-aadd8d51d6d9 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:34.889028 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1415/2795] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:45:34.893272 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4366a4-9e1f-4b57-b3a8-61a3bec4ce69 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:34.904615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4366a4-9e1f-4b57-b3a8-61a3bec4ce69 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:34.909394 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99125773-f27e-4557-89e4-f59e2b3caa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:34.910278 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99125773-f27e-4557-89e4-f59e2b3caa8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:34.910563 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99125773-f27e-4557-89e4-f59e2b3caa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:34.910840 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99125773-f27e-4557-89e4-f59e2b3caa8c admin admin] PATH_INFO: `/v3/projects/60c443a194224739bb11faabd05b9638/users/75d6f41e88e64e0f997c1ef0d0d79a69/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:34.926269 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99125773-f27e-4557-89e4-f59e2b3caa8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=60c443a194224739bb11faabd05b9638, user_id=75d6f41e88e64e0f997c1ef0d0d79a69, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:34.929020 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99125773-f27e-4557-89e4-f59e2b3caa8c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:34.942389 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1381/2796] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:45:34 2022] PUT /identity/v3/projects/60c443a194224739bb11faabd05b9638/users/75d6f41e88e64e0f997c1ef0d0d79a69/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:34.954557 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389e8d2-bed1-4faf-9d58-529ec2c7e4cc None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:34.954847 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389e8d2-bed1-4faf-9d58-529ec2c7e4cc None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:34.955136 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389e8d2-bed1-4faf-9d58-529ec2c7e4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:34.983723 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-f389e8d2-bed1-4faf-9d58-529ec2c7e4cc None None] MFA Rules not processed for user `75d6f41e88e64e0f997c1ef0d0d79a69`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:34.985013 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-f389e8d2-bed1-4faf-9d58-529ec2c7e4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:35.051399 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1416/2797] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:45:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:35.055926 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99125773-f27e-4557-89e4-f59e2b3caa8c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:35.075591 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:35.122192 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99125773-f27e-4557-89e4-f59e2b3caa8c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:35.126921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198a2f8-efce-4cdf-a390-90b3a107a874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:35.127591 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198a2f8-efce-4cdf-a390-90b3a107a874 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:35.127877 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198a2f8-efce-4cdf-a390-90b3a107a874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:35.128290 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198a2f8-efce-4cdf-a390-90b3a107a874 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:35.129123 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198a2f8-efce-4cdf-a390-90b3a107a874 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:35.131043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198a2f8-efce-4cdf-a390-90b3a107a874 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:35.160165 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1382/2798] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:45:35 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:45:35.161695 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389e8d2-bed1-4faf-9d58-529ec2c7e4cc None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:35.173007 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389e8d2-bed1-4faf-9d58-529ec2c7e4cc None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:35.232172 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d766e-95c6-416a-8876-08b4ebbcc401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:35.233006 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d766e-95c6-416a-8876-08b4ebbcc401 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:35.233387 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d766e-95c6-416a-8876-08b4ebbcc401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:35.233763 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d766e-95c6-416a-8876-08b4ebbcc401 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:35.234563 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d766e-95c6-416a-8876-08b4ebbcc401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:35.236630 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d766e-95c6-416a-8876-08b4ebbcc401 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:35.266620 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1417/2799] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:45:35 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:45:35.271166 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198a2f8-efce-4cdf-a390-90b3a107a874 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:35.296948 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198a2f8-efce-4cdf-a390-90b3a107a874 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:35.305557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66a711-2647-4414-9a77-d9a2a3c7a7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:35.306239 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66a711-2647-4414-9a77-d9a2a3c7a7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:35.306915 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66a711-2647-4414-9a77-d9a2a3c7a7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:35.307199 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66a711-2647-4414-9a77-d9a2a3c7a7b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:35.308487 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66a711-2647-4414-9a77-d9a2a3c7a7b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:35.310376 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66a711-2647-4414-9a77-d9a2a3c7a7b5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:35.322671 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1383/2800] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:45:35.327888 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d766e-95c6-416a-8876-08b4ebbcc401 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:35.338379 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d766e-95c6-416a-8876-08b4ebbcc401 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:35.343608 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd6785-3e14-49c4-88e8-5276a49009f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:35.344528 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd6785-3e14-49c4-88e8-5276a49009f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:35.344813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd6785-3e14-49c4-88e8-5276a49009f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:35.345093 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd6785-3e14-49c4-88e8-5276a49009f7 admin admin] PATH_INFO: `/v3/projects/104c1df39cc04e708e8ce45f834a4feb/users/7a1f957395a84720955f3fb8f428cc8b/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:35.360577 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd6785-3e14-49c4-88e8-5276a49009f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=104c1df39cc04e708e8ce45f834a4feb, user_id=7a1f957395a84720955f3fb8f428cc8b, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:35.363383 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd6785-3e14-49c4-88e8-5276a49009f7 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:35.377072 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1418/2801] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:45:35 2022] PUT /identity/v3/projects/104c1df39cc04e708e8ce45f834a4feb/users/7a1f957395a84720955f3fb8f428cc8b/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:45:35.381109 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66a711-2647-4414-9a77-d9a2a3c7a7b5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:35.391870 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66a711-2647-4414-9a77-d9a2a3c7a7b5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:35.455435 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607545e7-b9a3-4def-9638-ca674ec89f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:35.456145 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607545e7-b9a3-4def-9638-ca674ec89f5f admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:35.456466 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607545e7-b9a3-4def-9638-ca674ec89f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:35.456752 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607545e7-b9a3-4def-9638-ca674ec89f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:35.457480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607545e7-b9a3-4def-9638-ca674ec89f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:35.459135 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607545e7-b9a3-4def-9638-ca674ec89f5f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:35.470485 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1384/2802] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:45:35.474616 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd6785-3e14-49c4-88e8-5276a49009f7 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:35.487821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:35.496236 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd6785-3e14-49c4-88e8-5276a49009f7 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:35.501684 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b136399-cd47-42e4-b9dd-5b1105ef8eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:35.502652 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b136399-cd47-42e4-b9dd-5b1105ef8eca admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:35.502946 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b136399-cd47-42e4-b9dd-5b1105ef8eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:35.503229 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b136399-cd47-42e4-b9dd-5b1105ef8eca admin admin] PATH_INFO: `/v3/projects/104c1df39cc04e708e8ce45f834a4feb/users/7a1f957395a84720955f3fb8f428cc8b/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:35.505295 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b136399-cd47-42e4-b9dd-5b1105ef8eca admin admin] RBAC: Authorizing `identity:create_grant(project_id=104c1df39cc04e708e8ce45f834a4feb, user_id=7a1f957395a84720955f3fb8f428cc8b, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:35.507938 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b136399-cd47-42e4-b9dd-5b1105ef8eca admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:35.519210 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1419/2803] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:45:35 2022] PUT /identity/v3/projects/104c1df39cc04e708e8ce45f834a4feb/users/7a1f957395a84720955f3fb8f428cc8b/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:35.529857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e518d0-e97a-48ff-9f8b-e191e7411ab7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:35.530151 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e518d0-e97a-48ff-9f8b-e191e7411ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:35.530435 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e518d0-e97a-48ff-9f8b-e191e7411ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:35.556846 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f3e518d0-e97a-48ff-9f8b-e191e7411ab7 None None] MFA Rules not processed for user `7a1f957395a84720955f3fb8f428cc8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:35.558092 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f3e518d0-e97a-48ff-9f8b-e191e7411ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:35.631112 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1385/2804] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:45:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:35.642813 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b136399-cd47-42e4-b9dd-5b1105ef8eca admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:35.644565 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8b136399-cd47-42e4-b9dd-5b1105ef8eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:35.705764 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b136399-cd47-42e4-b9dd-5b1105ef8eca admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:35.709475 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0fb08-e54b-421d-a5ab-5ddac46d4f5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:35.710136 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0fb08-e54b-421d-a5ab-5ddac46d4f5a service cinder] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:35.710403 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0fb08-e54b-421d-a5ab-5ddac46d4f5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:35.710680 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0fb08-e54b-421d-a5ab-5ddac46d4f5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:35.719983 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0fb08-e54b-421d-a5ab-5ddac46d4f5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:35.721455 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0fb08-e54b-421d-a5ab-5ddac46d4f5a service cinder] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:35.730807 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1420/2805] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:35.801451 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e518d0-e97a-48ff-9f8b-e191e7411ab7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:35.812119 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e518d0-e97a-48ff-9f8b-e191e7411ab7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:35.815783 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c15276-b616-4d5d-ab0b-5b188405b4c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:35.816472 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c15276-b616-4d5d-ab0b-5b188405b4c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:35.816760 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c15276-b616-4d5d-ab0b-5b188405b4c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:35.817043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c15276-b616-4d5d-ab0b-5b188405b4c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:35.827455 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:35.879165 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c15276-b616-4d5d-ab0b-5b188405b4c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:35.880738 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c15276-b616-4d5d-ab0b-5b188405b4c6 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:35.891858 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1386/2806] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:45.726640 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:45.886299 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=22 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:47.966278 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe79372-0d24-4891-8ac7-a13eb1490c74 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:47.966278 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe79372-0d24-4891-8ac7-a13eb1490c74 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:47.966278 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe79372-0d24-4891-8ac7-a13eb1490c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:47.984563 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-abe79372-0d24-4891-8ac7-a13eb1490c74 None None] MFA Rules not processed for user `bbcd5ba866b84d099d183fe19ba61a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:47.986234 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-abe79372-0d24-4891-8ac7-a13eb1490c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:48.032790 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c15276-b616-4d5d-ab0b-5b188405b4c6 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:48.067756 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1421/2807] 10.222.0.32 () {58 vars in 1009 bytes} [Thu Jun 2 13:45:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:45:48.128841 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe79372-0d24-4891-8ac7-a13eb1490c74 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:48.131740 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-abe79372-0d24-4891-8ac7-a13eb1490c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:48.152270 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c15276-b616-4d5d-ab0b-5b188405b4c6 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:48.162233 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b42703-2ec7-4c08-9406-fbd4425c29fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:48.163848 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b42703-2ec7-4c08-9406-fbd4425c29fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:48.164412 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b42703-2ec7-4c08-9406-fbd4425c29fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:48.164943 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b42703-2ec7-4c08-9406-fbd4425c29fd admin admin] PATH_INFO: `/v3/users/75d6f41e88e64e0f997c1ef0d0d79a69` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:48.167153 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b42703-2ec7-4c08-9406-fbd4425c29fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=75d6f41e88e64e0f997c1ef0d0d79a69)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:48.171202 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b42703-2ec7-4c08-9406-fbd4425c29fd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:48.220033 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe79372-0d24-4891-8ac7-a13eb1490c74 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:48.226979 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14fd34-e02b-40bc-a8ae-f6032bc0b6f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aea97e7b39448a283032f662142b6e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:48.227681 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14fd34-e02b-40bc-a8ae-f6032bc0b6f6 service swift] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:48.228004 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14fd34-e02b-40bc-a8ae-f6032bc0b6f6 service swift] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:48.228243 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14fd34-e02b-40bc-a8ae-f6032bc0b6f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:48.237097 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14fd34-e02b-40bc-a8ae-f6032bc0b6f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:48.238675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14fd34-e02b-40bc-a8ae-f6032bc0b6f6 service swift] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:48.246932 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1422/2808] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Jun 2 13:45:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 13:45:48.247323 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-45b42703-2ec7-4c08-9406-fbd4425c29fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75d6f41e88e64e0f997c1ef0d0d79a69'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:48.256780 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-45b42703-2ec7-4c08-9406-fbd4425c29fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75d6f41e88e64e0f997c1ef0d0d79a69'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:48.258184 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-45b42703-2ec7-4c08-9406-fbd4425c29fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75d6f41e88e64e0f997c1ef0d0d79a69'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:48.274159 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-45b42703-2ec7-4c08-9406-fbd4425c29fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75d6f41e88e64e0f997c1ef0d0d79a69'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:48.282291 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-45b42703-2ec7-4c08-9406-fbd4425c29fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75d6f41e88e64e0f997c1ef0d0d79a69'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:48.289374 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1387/2809] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:45:48 2022] DELETE /identity/v3/users/75d6f41e88e64e0f997c1ef0d0d79a69 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:48.294674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5597be-0901-436f-bd3f-c70e1f4a5a02 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:48.294875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5597be-0901-436f-bd3f-c70e1f4a5a02 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:48.295221 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5597be-0901-436f-bd3f-c70e1f4a5a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:48.315235 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-8f5597be-0901-436f-bd3f-c70e1f4a5a02 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:48.317130 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8f5597be-0901-436f-bd3f-c70e1f4a5a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:48.396551 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1423/2810] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:48.406989 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b42703-2ec7-4c08-9406-fbd4425c29fd admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:48.409779 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-45b42703-2ec7-4c08-9406-fbd4425c29fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:48.476665 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b42703-2ec7-4c08-9406-fbd4425c29fd admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:48.480707 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6b25f-1c0e-4ad2-b5bb-90e969f34cb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:48.482059 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6b25f-1c0e-4ad2-b5bb-90e969f34cb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:48.482420 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6b25f-1c0e-4ad2-b5bb-90e969f34cb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:48.482774 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6b25f-1c0e-4ad2-b5bb-90e969f34cb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:48.493509 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6b25f-1c0e-4ad2-b5bb-90e969f34cb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:48.494972 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6b25f-1c0e-4ad2-b5bb-90e969f34cb0 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:48.506040 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1388/2811] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:48.812872 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89849530-b8e4-4a75-bd3f-8e94baa7ea4b None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:48.813169 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89849530-b8e4-4a75-bd3f-8e94baa7ea4b None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:48.813460 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89849530-b8e4-4a75-bd3f-8e94baa7ea4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:48.833855 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-89849530-b8e4-4a75-bd3f-8e94baa7ea4b None None] MFA Rules not processed for user `bbcd5ba866b84d099d183fe19ba61a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:48.835743 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-89849530-b8e4-4a75-bd3f-8e94baa7ea4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:48.872584 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:48.897600 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6b25f-1c0e-4ad2-b5bb-90e969f34cb0 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:48.899338 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bfc6b25f-1c0e-4ad2-b5bb-90e969f34cb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:48.914708 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1424/2812] 10.222.0.32 () {58 vars in 967 bytes} [Thu Jun 2 13:45:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:45:48.924728 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6b25f-1c0e-4ad2-b5bb-90e969f34cb0 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:48.928044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89849530-b8e4-4a75-bd3f-8e94baa7ea4b None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:48.929575 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-89849530-b8e4-4a75-bd3f-8e94baa7ea4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:48.930796 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c5b0a-aaf5-415d-863f-b95d29364a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:48.931687 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c5b0a-aaf5-415d-863f-b95d29364a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:48.932082 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c5b0a-aaf5-415d-863f-b95d29364a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:48.932477 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c5b0a-aaf5-415d-863f-b95d29364a20 admin admin] PATH_INFO: `/v3/projects/60c443a194224739bb11faabd05b9638` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:48.933850 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c5b0a-aaf5-415d-863f-b95d29364a20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60c443a194224739bb11faabd05b9638)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:48.935812 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c5b0a-aaf5-415d-863f-b95d29364a20 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:48.956795 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:48.998964 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0f4c5b0a-aaf5-415d-863f-b95d29364a20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60c443a194224739bb11faabd05b9638', 'request_id': 'req-0f4c5b0a-aaf5-415d-863f-b95d29364a20'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:49.004974 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0f4c5b0a-aaf5-415d-863f-b95d29364a20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60c443a194224739bb11faabd05b9638', 'request_id': 'req-0f4c5b0a-aaf5-415d-863f-b95d29364a20'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:49.014999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89849530-b8e4-4a75-bd3f-8e94baa7ea4b None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:49.015435 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0f4c5b0a-aaf5-415d-863f-b95d29364a20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60c443a194224739bb11faabd05b9638', 'request_id': 'req-0f4c5b0a-aaf5-415d-863f-b95d29364a20'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:49.027281 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0f4c5b0a-aaf5-415d-863f-b95d29364a20 admin admin] The token cache is being invalidate because project 60c443a194224739bb11faabd05b9638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:45:49.027698 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0f4c5b0a-aaf5-415d-863f-b95d29364a20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:49.029051 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0f4c5b0a-aaf5-415d-863f-b95d29364a20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:49.030596 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1389/2813] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:45:48 2022] DELETE /identity/v3/projects/60c443a194224739bb11faabd05b9638 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:49.034485 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c5b0a-aaf5-415d-863f-b95d29364a20 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:49.035840 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0f4c5b0a-aaf5-415d-863f-b95d29364a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:49.080970 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45a0f2-41c5-4f23-b7ab-92c8493263c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aea97e7b39448a283032f662142b6e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:49.081626 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45a0f2-41c5-4f23-b7ab-92c8493263c0 service swift] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:49.081912 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45a0f2-41c5-4f23-b7ab-92c8493263c0 service swift] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:49.082245 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45a0f2-41c5-4f23-b7ab-92c8493263c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:49.084223 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fb45a0f2-41c5-4f23-b7ab-92c8493263c0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:49.107199 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c5b0a-aaf5-415d-863f-b95d29364a20 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:49.111936 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00933c-9b60-4feb-b90c-a0474cadf477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:49.112927 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00933c-9b60-4feb-b90c-a0474cadf477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:49.113217 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00933c-9b60-4feb-b90c-a0474cadf477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:49.113507 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00933c-9b60-4feb-b90c-a0474cadf477 admin admin] PATH_INFO: `/v3/users/7a1f957395a84720955f3fb8f428cc8b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:49.114735 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00933c-9b60-4feb-b90c-a0474cadf477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a1f957395a84720955f3fb8f428cc8b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:49.116703 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00933c-9b60-4feb-b90c-a0474cadf477 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:49.151502 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb45a0f2-41c5-4f23-b7ab-92c8493263c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:49.154701 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb45a0f2-41c5-4f23-b7ab-92c8493263c0 service swift] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:49.164850 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1425/2814] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Jun 2 13:45:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 13:45:49.172926 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ba00933c-9b60-4feb-b90c-a0474cadf477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a1f957395a84720955f3fb8f428cc8b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:49.179915 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ba00933c-9b60-4feb-b90c-a0474cadf477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a1f957395a84720955f3fb8f428cc8b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:49.180631 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ba00933c-9b60-4feb-b90c-a0474cadf477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a1f957395a84720955f3fb8f428cc8b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:49.194745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ba00933c-9b60-4feb-b90c-a0474cadf477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a1f957395a84720955f3fb8f428cc8b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:49.204234 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ba00933c-9b60-4feb-b90c-a0474cadf477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a1f957395a84720955f3fb8f428cc8b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:49.210864 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1390/2815] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:45:49 2022] DELETE /identity/v3/users/7a1f957395a84720955f3fb8f428cc8b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:45:49.371114 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0c3cc-1aa1-4d2b-a4a0-7dcf381025ca None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:49.371379 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0c3cc-1aa1-4d2b-a4a0-7dcf381025ca None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:49.372216 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0c3cc-1aa1-4d2b-a4a0-7dcf381025ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:49.391653 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-97d0c3cc-1aa1-4d2b-a4a0-7dcf381025ca None None] MFA Rules not processed for user `bbcd5ba866b84d099d183fe19ba61a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:49.392914 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-97d0c3cc-1aa1-4d2b-a4a0-7dcf381025ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:49.413591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=100 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:49.456812 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1426/2816] 10.222.0.32 () {58 vars in 1009 bytes} [Thu Jun 2 13:45:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:49.469701 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00933c-9b60-4feb-b90c-a0474cadf477 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:49.471127 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ba00933c-9b60-4feb-b90c-a0474cadf477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:49.504525 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:49.521220 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0c3cc-1aa1-4d2b-a4a0-7dcf381025ca None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:49.522697 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-97d0c3cc-1aa1-4d2b-a4a0-7dcf381025ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:49.564591 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00933c-9b60-4feb-b90c-a0474cadf477 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:49.569701 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c531f-09a7-467d-a180-da37824095c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aea97e7b39448a283032f662142b6e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:49.570348 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c531f-09a7-467d-a180-da37824095c8 service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:49.570687 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c531f-09a7-467d-a180-da37824095c8 service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:49.570966 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c531f-09a7-467d-a180-da37824095c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:49.580146 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c531f-09a7-467d-a180-da37824095c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:49.581781 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c531f-09a7-467d-a180-da37824095c8 service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:49.590137 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1391/2817] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Jun 2 13:45:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:45:49.603778 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0c3cc-1aa1-4d2b-a4a0-7dcf381025ca None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:49.608632 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee05b2-8b25-499e-a6e1-18d129806cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:49.609503 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee05b2-8b25-499e-a6e1-18d129806cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:49.609789 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee05b2-8b25-499e-a6e1-18d129806cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:49.610074 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee05b2-8b25-499e-a6e1-18d129806cc1 admin admin] PATH_INFO: `/v3/projects/104c1df39cc04e708e8ce45f834a4feb` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:49.611281 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee05b2-8b25-499e-a6e1-18d129806cc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=104c1df39cc04e708e8ce45f834a4feb)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:49.613248 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee05b2-8b25-499e-a6e1-18d129806cc1 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:49.665387 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-81ee05b2-8b25-499e-a6e1-18d129806cc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '104c1df39cc04e708e8ce45f834a4feb', 'request_id': 'req-81ee05b2-8b25-499e-a6e1-18d129806cc1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:49.677124 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-81ee05b2-8b25-499e-a6e1-18d129806cc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '104c1df39cc04e708e8ce45f834a4feb', 'request_id': 'req-81ee05b2-8b25-499e-a6e1-18d129806cc1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:49.682782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-81ee05b2-8b25-499e-a6e1-18d129806cc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '104c1df39cc04e708e8ce45f834a4feb', 'request_id': 'req-81ee05b2-8b25-499e-a6e1-18d129806cc1'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:49.696579 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-81ee05b2-8b25-499e-a6e1-18d129806cc1 admin admin] The token cache is being invalidate because project 104c1df39cc04e708e8ce45f834a4feb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:45:49.696870 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-81ee05b2-8b25-499e-a6e1-18d129806cc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:49.697705 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-81ee05b2-8b25-499e-a6e1-18d129806cc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:49.703287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1427/2818] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:45:49 2022] DELETE /identity/v3/projects/104c1df39cc04e708e8ce45f834a4feb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:49.707818 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa018712-abb3-4a76-8549-ec19d885e1f7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:49.707818 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa018712-abb3-4a76-8549-ec19d885e1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:49.707818 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa018712-abb3-4a76-8549-ec19d885e1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:49.728285 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-fa018712-abb3-4a76-8549-ec19d885e1f7 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:49.729117 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fa018712-abb3-4a76-8549-ec19d885e1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:49.803229 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1392/2819] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:45:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:49.813332 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34af994-229c-47cf-a4ce-a08f18c6ea5f None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:49.813629 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34af994-229c-47cf-a4ce-a08f18c6ea5f None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:49.813921 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34af994-229c-47cf-a4ce-a08f18c6ea5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:49.836706 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-e34af994-229c-47cf-a4ce-a08f18c6ea5f None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:49.837919 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-e34af994-229c-47cf-a4ce-a08f18c6ea5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:49.846482 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1428/2820] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:45:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:49.851281 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa018712-abb3-4a76-8549-ec19d885e1f7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:49.863786 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa018712-abb3-4a76-8549-ec19d885e1f7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:49.869729 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed4dac-cabd-4dba-82b7-6dd8e13dcb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:49.870628 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed4dac-cabd-4dba-82b7-6dd8e13dcb03 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:49.872863 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed4dac-cabd-4dba-82b7-6dd8e13dcb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:49.872863 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed4dac-cabd-4dba-82b7-6dd8e13dcb03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:49.878353 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed4dac-cabd-4dba-82b7-6dd8e13dcb03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:45:49.879388 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed4dac-cabd-4dba-82b7-6dd8e13dcb03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:49.883737 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed4dac-cabd-4dba-82b7-6dd8e13dcb03 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:49.900016 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1393/2821] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:45:49.904935 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34af994-229c-47cf-a4ce-a08f18c6ea5f None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:49.916291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34af994-229c-47cf-a4ce-a08f18c6ea5f None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:49.922819 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb77e1-4eae-4e4a-acb8-8ec1a0f05829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:49.923408 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb77e1-4eae-4e4a-acb8-8ec1a0f05829 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:49.923689 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb77e1-4eae-4e4a-acb8-8ec1a0f05829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:49.923962 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb77e1-4eae-4e4a-acb8-8ec1a0f05829 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:49.924704 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb77e1-4eae-4e4a-acb8-8ec1a0f05829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:49.926592 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb77e1-4eae-4e4a-acb8-8ec1a0f05829 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:49.963988 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503424e-1a3b-4b8d-8d6b-5efe6218d832 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:49.964453 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503424e-1a3b-4b8d-8d6b-5efe6218d832 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:49.964750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503424e-1a3b-4b8d-8d6b-5efe6218d832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:49.966465 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1429/2822] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:45:49 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:45:49.970387 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb77e1-4eae-4e4a-acb8-8ec1a0f05829 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:49.985312 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7503424e-1a3b-4b8d-8d6b-5efe6218d832 None None] MFA Rules not processed for user `bbcd5ba866b84d099d183fe19ba61a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:49.986592 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7503424e-1a3b-4b8d-8d6b-5efe6218d832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:50.033466 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:50.076016 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb77e1-4eae-4e4a-acb8-8ec1a0f05829 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:50.081917 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100e1d2-d06b-45c3-87cd-689ae04c6cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:50.082688 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100e1d2-d06b-45c3-87cd-689ae04c6cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:50.083044 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100e1d2-d06b-45c3-87cd-689ae04c6cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:50.083398 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100e1d2-d06b-45c3-87cd-689ae04c6cd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:50.084163 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100e1d2-d06b-45c3-87cd-689ae04c6cd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:50.084901 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1394/2823] 10.222.0.32 () {58 vars in 967 bytes} [Thu Jun 2 13:45:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:45:50.091788 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100e1d2-d06b-45c3-87cd-689ae04c6cd7 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:50.102556 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503424e-1a3b-4b8d-8d6b-5efe6218d832 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:50.104129 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7503424e-1a3b-4b8d-8d6b-5efe6218d832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:50.117294 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1430/2824] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:45:49 2022] POST /identity/v3/users => generated 291 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:45:50.122191 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100e1d2-d06b-45c3-87cd-689ae04c6cd7 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:50.135436 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100e1d2-d06b-45c3-87cd-689ae04c6cd7 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:50.141178 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97fe62-af09-4ad6-a84f-0d29a71e7d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:50.142305 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97fe62-af09-4ad6-a84f-0d29a71e7d99 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:50.142763 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97fe62-af09-4ad6-a84f-0d29a71e7d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:50.143194 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97fe62-af09-4ad6-a84f-0d29a71e7d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:50.144283 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97fe62-af09-4ad6-a84f-0d29a71e7d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:50.146050 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97fe62-af09-4ad6-a84f-0d29a71e7d99 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:50.162660 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1431/2825] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:45:50.164403 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97fe62-af09-4ad6-a84f-0d29a71e7d99 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:50.179128 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97fe62-af09-4ad6-a84f-0d29a71e7d99 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:50.185169 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868dc993-db92-4e91-9746-59ef65f8e571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:50.186205 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dc993-db92-4e91-9746-59ef65f8e571 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:50.186502 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dc993-db92-4e91-9746-59ef65f8e571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:50.186788 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dc993-db92-4e91-9746-59ef65f8e571 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:50.187869 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868dc993-db92-4e91-9746-59ef65f8e571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:50.189505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868dc993-db92-4e91-9746-59ef65f8e571 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:50.193598 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:50.202399 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1432/2826] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:45:50.206452 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868dc993-db92-4e91-9746-59ef65f8e571 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:50.217287 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868dc993-db92-4e91-9746-59ef65f8e571 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:50.218543 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503424e-1a3b-4b8d-8d6b-5efe6218d832 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:50.222653 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca839c-d1b2-439d-83ac-f966bb4e221d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:50.223461 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca839c-d1b2-439d-83ac-f966bb4e221d admin admin] REQUEST_METHOD: `PUT` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:50.223742 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca839c-d1b2-439d-83ac-f966bb4e221d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:50.224020 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca839c-d1b2-439d-83ac-f966bb4e221d admin admin] PATH_INFO: `/v3/projects/366c269c87bf4ff98d44fad5c0fd4a5c/users/6ac8df38b1be4fe6b57ce284e15fe458/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:50.224137 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01623e0-47c4-49ba-a966-2d27690206ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3aea97e7b39448a283032f662142b6e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:50.224789 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01623e0-47c4-49ba-a966-2d27690206ca service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:50.225620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01623e0-47c4-49ba-a966-2d27690206ca service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:50.225620 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01623e0-47c4-49ba-a966-2d27690206ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:50.239854 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01623e0-47c4-49ba-a966-2d27690206ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:50.241568 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01623e0-47c4-49ba-a966-2d27690206ca service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:50.241777 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca839c-d1b2-439d-83ac-f966bb4e221d admin admin] RBAC: Authorizing `identity:create_grant(project_id=366c269c87bf4ff98d44fad5c0fd4a5c, user_id=6ac8df38b1be4fe6b57ce284e15fe458, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:50.244427 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca839c-d1b2-439d-83ac-f966bb4e221d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:50.251690 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1395/2827] 10.222.0.32 () {60 vars in 1384 bytes} [Thu Jun 2 13:45:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 13:45:50.252480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01623e0-47c4-49ba-a966-2d27690206ca service swift] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:50.254339 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d01623e0-47c4-49ba-a966-2d27690206ca service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:50.260057 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1433/2828] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:45:50 2022] PUT /identity/v3/projects/366c269c87bf4ff98d44fad5c0fd4a5c/users/6ac8df38b1be4fe6b57ce284e15fe458/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:45:50.271398 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc40b60-c6d0-4d9e-a6bb-cb51d12008a1 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:50.271690 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc40b60-c6d0-4d9e-a6bb-cb51d12008a1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:50.271972 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc40b60-c6d0-4d9e-a6bb-cb51d12008a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:50.304484 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-fbc40b60-c6d0-4d9e-a6bb-cb51d12008a1 None None] MFA Rules not processed for user `6ac8df38b1be4fe6b57ce284e15fe458`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:50.305768 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-fbc40b60-c6d0-4d9e-a6bb-cb51d12008a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:50.339328 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01623e0-47c4-49ba-a966-2d27690206ca service swift] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:50.399299 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1434/2829] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:45:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:45:50.405011 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc40b60-c6d0-4d9e-a6bb-cb51d12008a1 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:50.415098 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1ed6b-21bf-41e1-bd2a-945efe79748c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:50.416085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1ed6b-21bf-41e1-bd2a-945efe79748c service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:50.416556 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1ed6b-21bf-41e1-bd2a-945efe79748c service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:50.417011 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1ed6b-21bf-41e1-bd2a-945efe79748c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:50.419342 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a3d1ed6b-21bf-41e1-bd2a-945efe79748c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:50.494203 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc40b60-c6d0-4d9e-a6bb-cb51d12008a1 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:50.501278 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2919a31-a430-4242-ac33-ec10e4974512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:50.501981 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2919a31-a430-4242-ac33-ec10e4974512 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:50.502271 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2919a31-a430-4242-ac33-ec10e4974512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:50.502553 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2919a31-a430-4242-ac33-ec10e4974512 admin admin] PATH_INFO: `/v3/projects` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:50.503254 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2919a31-a430-4242-ac33-ec10e4974512 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:50.503830 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1ed6b-21bf-41e1-bd2a-945efe79748c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:50.505199 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2919a31-a430-4242-ac33-ec10e4974512 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:50.505311 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1ed6b-21bf-41e1-bd2a-945efe79748c service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:50.515544 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:50.518722 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1396/2830] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:50.550595 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1435/2831] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:45:50 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:45:50.551561 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1ed6b-21bf-41e1-bd2a-945efe79748c service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:50.567960 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1ed6b-21bf-41e1-bd2a-945efe79748c service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:50.619690 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:50.639215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c678b2f6-bf5b-4089-9752-4e61f66e3841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:50.640086 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678b2f6-bf5b-4089-9752-4e61f66e3841 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:50.640508 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678b2f6-bf5b-4089-9752-4e61f66e3841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:50.640908 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678b2f6-bf5b-4089-9752-4e61f66e3841 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:50.641702 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c678b2f6-bf5b-4089-9752-4e61f66e3841 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:50.643847 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c678b2f6-bf5b-4089-9752-4e61f66e3841 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:50.670170 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1397/2832] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:45:50 2022] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:45:50.674837 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2919a31-a430-4242-ac33-ec10e4974512 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:50.690568 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2919a31-a430-4242-ac33-ec10e4974512 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:50.698228 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9f3b0-d3bc-4598-93e2-8e2b0b6ce948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:50.699078 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9f3b0-d3bc-4598-93e2-8e2b0b6ce948 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:50.700147 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9f3b0-d3bc-4598-93e2-8e2b0b6ce948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:50.700574 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9f3b0-d3bc-4598-93e2-8e2b0b6ce948 admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:50.701815 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9f3b0-d3bc-4598-93e2-8e2b0b6ce948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:50.704213 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9f3b0-d3bc-4598-93e2-8e2b0b6ce948 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:50.717355 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1436/2833] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:45:50.725616 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c678b2f6-bf5b-4089-9752-4e61f66e3841 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:50.737865 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c678b2f6-bf5b-4089-9752-4e61f66e3841 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:50.743330 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c273a5-4ad0-4240-97a8-43b9a8d7d806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:50.744628 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c273a5-4ad0-4240-97a8-43b9a8d7d806 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:50.745245 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c273a5-4ad0-4240-97a8-43b9a8d7d806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:50.745631 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c273a5-4ad0-4240-97a8-43b9a8d7d806 admin admin] PATH_INFO: `/v3/projects/5022c6ba65f347b58cdab9d799719a18/users/8292cbe1f97742c188884e955012773c/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:50.766393 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c273a5-4ad0-4240-97a8-43b9a8d7d806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5022c6ba65f347b58cdab9d799719a18, user_id=8292cbe1f97742c188884e955012773c, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:50.766393 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c273a5-4ad0-4240-97a8-43b9a8d7d806 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:50.784750 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1398/2834] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:45:50 2022] PUT /identity/v3/projects/5022c6ba65f347b58cdab9d799719a18/users/8292cbe1f97742c188884e955012773c/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:50.788617 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9f3b0-d3bc-4598-93e2-8e2b0b6ce948 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:50.800769 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9f3b0-d3bc-4598-93e2-8e2b0b6ce948 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:50.866900 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237ca22-91b4-4eab-8275-3583cc11679a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:50.867699 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237ca22-91b4-4eab-8275-3583cc11679a admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:50.867992 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237ca22-91b4-4eab-8275-3583cc11679a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:50.868276 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237ca22-91b4-4eab-8275-3583cc11679a admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:50.869038 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c237ca22-91b4-4eab-8275-3583cc11679a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:50.870674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c237ca22-91b4-4eab-8275-3583cc11679a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:50.881839 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1437/2835] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:45:50.885280 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c273a5-4ad0-4240-97a8-43b9a8d7d806 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:50.895810 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c273a5-4ad0-4240-97a8-43b9a8d7d806 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:50.901350 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adcd8e-8820-47e1-a924-93a58a05bae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:50.902324 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adcd8e-8820-47e1-a924-93a58a05bae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:50.903220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adcd8e-8820-47e1-a924-93a58a05bae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:50.903559 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adcd8e-8820-47e1-a924-93a58a05bae1 admin admin] PATH_INFO: `/v3/projects/5022c6ba65f347b58cdab9d799719a18/users/8292cbe1f97742c188884e955012773c/roles/128feb04d1e042ac844f9ad70b89bb02` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:50.905679 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62adcd8e-8820-47e1-a924-93a58a05bae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5022c6ba65f347b58cdab9d799719a18, user_id=8292cbe1f97742c188884e955012773c, role_id=128feb04d1e042ac844f9ad70b89bb02)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:50.908574 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62adcd8e-8820-47e1-a924-93a58a05bae1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:50.932794 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1399/2836] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:45:50 2022] PUT /identity/v3/projects/5022c6ba65f347b58cdab9d799719a18/users/8292cbe1f97742c188884e955012773c/roles/128feb04d1e042ac844f9ad70b89bb02 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:50.934233 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51583a64-9264-40e3-b83e-e0dfe8a2c889 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:50.934474 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51583a64-9264-40e3-b83e-e0dfe8a2c889 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:50.934758 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51583a64-9264-40e3-b83e-e0dfe8a2c889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:50.965704 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-51583a64-9264-40e3-b83e-e0dfe8a2c889 None None] MFA Rules not processed for user `8292cbe1f97742c188884e955012773c`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:50.966938 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-51583a64-9264-40e3-b83e-e0dfe8a2c889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:51.065989 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1438/2837] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:45:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:51.079822 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adcd8e-8820-47e1-a924-93a58a05bae1 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:51.082099 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-62adcd8e-8820-47e1-a924-93a58a05bae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:51.158611 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adcd8e-8820-47e1-a924-93a58a05bae1 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:51.162838 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765c820-e9ac-4795-a1b1-4357d40547d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:51.163625 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765c820-e9ac-4795-a1b1-4357d40547d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:51.163959 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765c820-e9ac-4795-a1b1-4357d40547d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:51.164291 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765c820-e9ac-4795-a1b1-4357d40547d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:51.177134 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5765c820-e9ac-4795-a1b1-4357d40547d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:51.182845 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5765c820-e9ac-4795-a1b1-4357d40547d0 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:51.196456 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1400/2838] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:51 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:51.598381 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51583a64-9264-40e3-b83e-e0dfe8a2c889 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:51.607550 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51583a64-9264-40e3-b83e-e0dfe8a2c889 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:51.612209 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bba391-e2e3-4b84-93e7-79aa75213618 tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8292cbe1f97742c188884e955012773c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5022c6ba65f347b58cdab9d799719a18', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:51.612903 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bba391-e2e3-4b84-93e7-79aa75213618 tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:51.613190 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bba391-e2e3-4b84-93e7-79aa75213618 tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:51.613601 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bba391-e2e3-4b84-93e7-79aa75213618 tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:51.614597 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bba391-e2e3-4b84-93e7-79aa75213618 tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:45:51.614885 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bba391-e2e3-4b84-93e7-79aa75213618 tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:51.616601 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bba391-e2e3-4b84-93e7-79aa75213618 tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:51.629947 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1439/2839] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:45:51.633895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765c820-e9ac-4795-a1b1-4357d40547d0 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:51.643615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765c820-e9ac-4795-a1b1-4357d40547d0 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:51.648201 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d4888-b142-4f97-8ab4-6b0d7c3a6bf3 tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8292cbe1f97742c188884e955012773c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5022c6ba65f347b58cdab9d799719a18', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:51.648896 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d4888-b142-4f97-8ab4-6b0d7c3a6bf3 tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:51.649205 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d4888-b142-4f97-8ab4-6b0d7c3a6bf3 tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:51.649476 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d4888-b142-4f97-8ab4-6b0d7c3a6bf3 tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:51.650223 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d4888-b142-4f97-8ab4-6b0d7c3a6bf3 tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:51.652139 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d4888-b142-4f97-8ab4-6b0d7c3a6bf3 tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:51.679300 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1401/2840] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:45:51 2022] POST /identity/v3/projects => generated 354 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:45:51.683374 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bba391-e2e3-4b84-93e7-79aa75213618 tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:51.694180 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bba391-e2e3-4b84-93e7-79aa75213618 tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:51.742743 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:51.760372 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f574a-a5a6-499a-bbc6-fb9e8180cef8 tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8292cbe1f97742c188884e955012773c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5022c6ba65f347b58cdab9d799719a18', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:51.761019 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f574a-a5a6-499a-bbc6-fb9e8180cef8 tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:51.761311 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f574a-a5a6-499a-bbc6-fb9e8180cef8 tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:51.761596 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f574a-a5a6-499a-bbc6-fb9e8180cef8 tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:51.762955 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f574a-a5a6-499a-bbc6-fb9e8180cef8 tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:45:51.763283 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f574a-a5a6-499a-bbc6-fb9e8180cef8 tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:51.764958 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f574a-a5a6-499a-bbc6-fb9e8180cef8 tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:51.778148 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1440/2841] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:45:51.824753 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d4888-b142-4f97-8ab4-6b0d7c3a6bf3 tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:51.835848 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d4888-b142-4f97-8ab4-6b0d7c3a6bf3 tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:51.841170 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6313d5c-8c86-48da-b85d-e51c8baecb3c tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8292cbe1f97742c188884e955012773c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5022c6ba65f347b58cdab9d799719a18', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:51.842043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6313d5c-8c86-48da-b85d-e51c8baecb3c tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:51.842328 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6313d5c-8c86-48da-b85d-e51c8baecb3c tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:51.842604 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6313d5c-8c86-48da-b85d-e51c8baecb3c tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] PATH_INFO: `/v3/projects/a240e246b478444fa17af26bfb77f3fb` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:51.843826 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6313d5c-8c86-48da-b85d-e51c8baecb3c tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a240e246b478444fa17af26bfb77f3fb)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:51.845786 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6313d5c-8c86-48da-b85d-e51c8baecb3c tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:51.898058 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d6313d5c-8c86-48da-b85d-e51c8baecb3c tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a240e246b478444fa17af26bfb77f3fb', 'request_id': 'req-d6313d5c-8c86-48da-b85d-e51c8baecb3c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:51.904765 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d6313d5c-8c86-48da-b85d-e51c8baecb3c tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a240e246b478444fa17af26bfb77f3fb', 'request_id': 'req-d6313d5c-8c86-48da-b85d-e51c8baecb3c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:51.914135 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d6313d5c-8c86-48da-b85d-e51c8baecb3c tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a240e246b478444fa17af26bfb77f3fb', 'request_id': 'req-d6313d5c-8c86-48da-b85d-e51c8baecb3c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:51.923633 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:51.941416 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d6313d5c-8c86-48da-b85d-e51c8baecb3c tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] The token cache is being invalidate because project a240e246b478444fa17af26bfb77f3fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:45:51.941999 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d6313d5c-8c86-48da-b85d-e51c8baecb3c tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:51.943349 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d6313d5c-8c86-48da-b85d-e51c8baecb3c tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:51.946092 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1402/2842] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:45:51 2022] DELETE /identity/v3/projects/a240e246b478444fa17af26bfb77f3fb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:45:52.162693 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f574a-a5a6-499a-bbc6-fb9e8180cef8 tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:52.164510 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-d85f574a-a5a6-499a-bbc6-fb9e8180cef8 tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:52.234338 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f574a-a5a6-499a-bbc6-fb9e8180cef8 tempest-VolumeQuotaClassesTest-283502713 tempest-VolumeQuotaClassesTest-283502713-project-admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:52.293076 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4f94d-315d-4fb5-9218-b53279b25b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:52.294587 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4f94d-315d-4fb5-9218-b53279b25b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:52.294862 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4f94d-315d-4fb5-9218-b53279b25b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:52.295144 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4f94d-315d-4fb5-9218-b53279b25b52 admin admin] PATH_INFO: `/v3/users/6ac8df38b1be4fe6b57ce284e15fe458` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:52.296369 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4f94d-315d-4fb5-9218-b53279b25b52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ac8df38b1be4fe6b57ce284e15fe458)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:52.298284 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4f94d-315d-4fb5-9218-b53279b25b52 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:52.347922 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-aaa4f94d-315d-4fb5-9218-b53279b25b52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ac8df38b1be4fe6b57ce284e15fe458'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:52.355045 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-aaa4f94d-315d-4fb5-9218-b53279b25b52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ac8df38b1be4fe6b57ce284e15fe458'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:52.355745 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-aaa4f94d-315d-4fb5-9218-b53279b25b52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ac8df38b1be4fe6b57ce284e15fe458'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:52.369322 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-aaa4f94d-315d-4fb5-9218-b53279b25b52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ac8df38b1be4fe6b57ce284e15fe458'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:52.379289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-aaa4f94d-315d-4fb5-9218-b53279b25b52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ac8df38b1be4fe6b57ce284e15fe458'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:52.388149 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1441/2843] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:45:52 2022] DELETE /identity/v3/users/6ac8df38b1be4fe6b57ce284e15fe458 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:52.394410 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f53d0-ea6f-4914-84af-3c8c6ba04822 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:52.395019 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f53d0-ea6f-4914-84af-3c8c6ba04822 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:52.395019 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f53d0-ea6f-4914-84af-3c8c6ba04822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:52.416252 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d33f53d0-ea6f-4914-84af-3c8c6ba04822 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:52.417519 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d33f53d0-ea6f-4914-84af-3c8c6ba04822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:52.500444 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1403/2844] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:52.507903 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4f94d-315d-4fb5-9218-b53279b25b52 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:52.509721 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-aaa4f94d-315d-4fb5-9218-b53279b25b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:52.524650 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:52.566804 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f53d0-ea6f-4914-84af-3c8c6ba04822 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:52.568663 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d33f53d0-ea6f-4914-84af-3c8c6ba04822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:52.591439 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f53d0-ea6f-4914-84af-3c8c6ba04822 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:52.604927 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e72f08-2dfd-41d5-b8a8-e328c3c4f667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:52.606172 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e72f08-2dfd-41d5-b8a8-e328c3c4f667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:52.606458 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e72f08-2dfd-41d5-b8a8-e328c3c4f667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:52.606722 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e72f08-2dfd-41d5-b8a8-e328c3c4f667 admin admin] PATH_INFO: `/v3/users/665084d472824beb91eb2f615b56ceb1` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:52.609691 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e72f08-2dfd-41d5-b8a8-e328c3c4f667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=665084d472824beb91eb2f615b56ceb1)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:52.611984 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e72f08-2dfd-41d5-b8a8-e328c3c4f667 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:52.652059 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4f94d-315d-4fb5-9218-b53279b25b52 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:52.663812 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c545a28-181a-4c4c-824b-2252a5b27676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:52.667497 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c545a28-181a-4c4c-824b-2252a5b27676 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:52.667975 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c545a28-181a-4c4c-824b-2252a5b27676 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:52.669110 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c545a28-181a-4c4c-824b-2252a5b27676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:52.683495 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-50e72f08-2dfd-41d5-b8a8-e328c3c4f667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '665084d472824beb91eb2f615b56ceb1'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:52.696256 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c545a28-181a-4c4c-824b-2252a5b27676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:52.697831 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c545a28-181a-4c4c-824b-2252a5b27676 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:52.702196 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-50e72f08-2dfd-41d5-b8a8-e328c3c4f667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '665084d472824beb91eb2f615b56ceb1'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:52.703185 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-50e72f08-2dfd-41d5-b8a8-e328c3c4f667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '665084d472824beb91eb2f615b56ceb1'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:52.717410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1442/2845] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:52.727215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-50e72f08-2dfd-41d5-b8a8-e328c3c4f667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '665084d472824beb91eb2f615b56ceb1'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:52.757909 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-50e72f08-2dfd-41d5-b8a8-e328c3c4f667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '665084d472824beb91eb2f615b56ceb1'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:52.770537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1404/2846] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:45:52 2022] DELETE /identity/v3/users/665084d472824beb91eb2f615b56ceb1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:52.772363 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326ea7c-52f4-41ae-b6da-9b5f5420aede None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:52.772666 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326ea7c-52f4-41ae-b6da-9b5f5420aede None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:52.772955 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326ea7c-52f4-41ae-b6da-9b5f5420aede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:52.794132 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-8326ea7c-52f4-41ae-b6da-9b5f5420aede None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:52.794667 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8326ea7c-52f4-41ae-b6da-9b5f5420aede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:52.879479 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1443/2847] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:52.888961 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e72f08-2dfd-41d5-b8a8-e328c3c4f667 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:52.890688 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-50e72f08-2dfd-41d5-b8a8-e328c3c4f667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:52.978171 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e72f08-2dfd-41d5-b8a8-e328c3c4f667 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:52.985637 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3549b3-6fbd-4e96-98eb-c920576dc3d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:52.985637 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3549b3-6fbd-4e96-98eb-c920576dc3d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:52.985637 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3549b3-6fbd-4e96-98eb-c920576dc3d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:52.985637 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3549b3-6fbd-4e96-98eb-c920576dc3d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:53.024179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3549b3-6fbd-4e96-98eb-c920576dc3d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:53.026364 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3549b3-6fbd-4e96-98eb-c920576dc3d1 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:53.041628 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1405/2848] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:53.194445 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326ea7c-52f4-41ae-b6da-9b5f5420aede None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:53.197797 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8326ea7c-52f4-41ae-b6da-9b5f5420aede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:53.215321 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326ea7c-52f4-41ae-b6da-9b5f5420aede None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:53.220640 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5b74c-ad06-4695-9941-4d4f1338bbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:53.222018 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5b74c-ad06-4695-9941-4d4f1338bbb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:53.222330 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5b74c-ad06-4695-9941-4d4f1338bbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:53.222651 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5b74c-ad06-4695-9941-4d4f1338bbb3 admin admin] PATH_INFO: `/v3/projects/366c269c87bf4ff98d44fad5c0fd4a5c` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:53.223817 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5b74c-ad06-4695-9941-4d4f1338bbb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=366c269c87bf4ff98d44fad5c0fd4a5c)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:53.225774 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5b74c-ad06-4695-9941-4d4f1338bbb3 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:53.282353 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-24b5b74c-ad06-4695-9941-4d4f1338bbb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '366c269c87bf4ff98d44fad5c0fd4a5c', 'request_id': 'req-24b5b74c-ad06-4695-9941-4d4f1338bbb3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:53.290837 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-24b5b74c-ad06-4695-9941-4d4f1338bbb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '366c269c87bf4ff98d44fad5c0fd4a5c', 'request_id': 'req-24b5b74c-ad06-4695-9941-4d4f1338bbb3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:53.299052 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-24b5b74c-ad06-4695-9941-4d4f1338bbb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '366c269c87bf4ff98d44fad5c0fd4a5c', 'request_id': 'req-24b5b74c-ad06-4695-9941-4d4f1338bbb3'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:53.311321 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-24b5b74c-ad06-4695-9941-4d4f1338bbb3 admin admin] The token cache is being invalidate because project 366c269c87bf4ff98d44fad5c0fd4a5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:45:53.311660 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-24b5b74c-ad06-4695-9941-4d4f1338bbb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:53.312761 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-24b5b74c-ad06-4695-9941-4d4f1338bbb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:53.314099 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1444/2849] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:45:53 2022] DELETE /identity/v3/projects/366c269c87bf4ff98d44fad5c0fd4a5c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:53.317956 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3549b3-6fbd-4e96-98eb-c920576dc3d1 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:53.329035 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3549b3-6fbd-4e96-98eb-c920576dc3d1 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:53.342316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:53.383938 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5b74c-ad06-4695-9941-4d4f1338bbb3 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:53.385541 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-24b5b74c-ad06-4695-9941-4d4f1338bbb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:53.422193 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8b083-7a57-4cc0-bc74-35e014cdbe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:53.423747 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8b083-7a57-4cc0-bc74-35e014cdbe41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:53.424217 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8b083-7a57-4cc0-bc74-35e014cdbe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:53.424719 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8b083-7a57-4cc0-bc74-35e014cdbe41 admin admin] PATH_INFO: `/v3/users/8292cbe1f97742c188884e955012773c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:53.426265 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8b083-7a57-4cc0-bc74-35e014cdbe41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8292cbe1f97742c188884e955012773c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:53.428411 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8b083-7a57-4cc0-bc74-35e014cdbe41 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:53.441510 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:53.490549 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5b74c-ad06-4695-9941-4d4f1338bbb3 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:53.495043 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-31f8b083-7a57-4cc0-bc74-35e014cdbe41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8292cbe1f97742c188884e955012773c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:53.503563 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f07ec-70de-4da6-8ebc-df904f9d0214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:53.504472 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f07ec-70de-4da6-8ebc-df904f9d0214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:53.504755 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f07ec-70de-4da6-8ebc-df904f9d0214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:53.505033 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f07ec-70de-4da6-8ebc-df904f9d0214 admin admin] PATH_INFO: `/v3/projects/97425c4354ba47dc9a4a6e434a57c97e` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:53.507847 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f07ec-70de-4da6-8ebc-df904f9d0214 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97425c4354ba47dc9a4a6e434a57c97e)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:53.508410 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-31f8b083-7a57-4cc0-bc74-35e014cdbe41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8292cbe1f97742c188884e955012773c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:53.509524 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-31f8b083-7a57-4cc0-bc74-35e014cdbe41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8292cbe1f97742c188884e955012773c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:53.509796 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f07ec-70de-4da6-8ebc-df904f9d0214 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:53.538517 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-31f8b083-7a57-4cc0-bc74-35e014cdbe41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8292cbe1f97742c188884e955012773c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:53.549128 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-31f8b083-7a57-4cc0-bc74-35e014cdbe41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8292cbe1f97742c188884e955012773c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:53.559877 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1406/2850] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:45:53 2022] DELETE /identity/v3/users/8292cbe1f97742c188884e955012773c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:53.575025 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-855f07ec-70de-4da6-8ebc-df904f9d0214 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97425c4354ba47dc9a4a6e434a57c97e', 'request_id': 'req-855f07ec-70de-4da6-8ebc-df904f9d0214'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:53.585982 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-855f07ec-70de-4da6-8ebc-df904f9d0214 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97425c4354ba47dc9a4a6e434a57c97e', 'request_id': 'req-855f07ec-70de-4da6-8ebc-df904f9d0214'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:53.595289 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-855f07ec-70de-4da6-8ebc-df904f9d0214 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97425c4354ba47dc9a4a6e434a57c97e', 'request_id': 'req-855f07ec-70de-4da6-8ebc-df904f9d0214'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:53.614105 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-855f07ec-70de-4da6-8ebc-df904f9d0214 admin admin] The token cache is being invalidate because project 97425c4354ba47dc9a4a6e434a57c97e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:45:53.614918 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-855f07ec-70de-4da6-8ebc-df904f9d0214 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:53.615636 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-855f07ec-70de-4da6-8ebc-df904f9d0214 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:53.617703 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1445/2851] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:45:53 2022] DELETE /identity/v3/projects/97425c4354ba47dc9a4a6e434a57c97e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:53.949483 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8b083-7a57-4cc0-bc74-35e014cdbe41 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:53.951477 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-31f8b083-7a57-4cc0-bc74-35e014cdbe41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:54.032878 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8b083-7a57-4cc0-bc74-35e014cdbe41 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:54.037537 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f4f24-c813-4d05-9c14-2e065bf9c9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:54.038396 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f4f24-c813-4d05-9c14-2e065bf9c9fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:54.038723 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f4f24-c813-4d05-9c14-2e065bf9c9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:54.039003 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f4f24-c813-4d05-9c14-2e065bf9c9fb admin admin] PATH_INFO: `/v3/projects/5022c6ba65f347b58cdab9d799719a18` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:54.040348 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f4f24-c813-4d05-9c14-2e065bf9c9fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5022c6ba65f347b58cdab9d799719a18)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:54.042319 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f4f24-c813-4d05-9c14-2e065bf9c9fb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:54.093542 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:54.106615 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bc4f4f24-c813-4d05-9c14-2e065bf9c9fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5022c6ba65f347b58cdab9d799719a18', 'request_id': 'req-bc4f4f24-c813-4d05-9c14-2e065bf9c9fb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:54.115688 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bc4f4f24-c813-4d05-9c14-2e065bf9c9fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5022c6ba65f347b58cdab9d799719a18', 'request_id': 'req-bc4f4f24-c813-4d05-9c14-2e065bf9c9fb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:54.124125 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bc4f4f24-c813-4d05-9c14-2e065bf9c9fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5022c6ba65f347b58cdab9d799719a18', 'request_id': 'req-bc4f4f24-c813-4d05-9c14-2e065bf9c9fb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:54.136153 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bc4f4f24-c813-4d05-9c14-2e065bf9c9fb admin admin] The token cache is being invalidate because project 5022c6ba65f347b58cdab9d799719a18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:45:54.136481 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bc4f4f24-c813-4d05-9c14-2e065bf9c9fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:54.137645 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bc4f4f24-c813-4d05-9c14-2e065bf9c9fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:54.139535 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1407/2852] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:45:53 2022] DELETE /identity/v3/projects/5022c6ba65f347b58cdab9d799719a18 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:54.145104 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fd438-3632-462e-a9db-da43900d34f2 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:54.145394 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fd438-3632-462e-a9db-da43900d34f2 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:54.145676 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fd438-3632-462e-a9db-da43900d34f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:54.164222 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-b26fd438-3632-462e-a9db-da43900d34f2 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:54.165438 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-b26fd438-3632-462e-a9db-da43900d34f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:54.223291 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1446/2853] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:54.230989 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0dc74-6ac8-4475-9e41-655673dff23a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:54.231276 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0dc74-6ac8-4475-9e41-655673dff23a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:54.231555 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0dc74-6ac8-4475-9e41-655673dff23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:54.249694 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-16c0dc74-6ac8-4475-9e41-655673dff23a None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:54.250897 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-16c0dc74-6ac8-4475-9e41-655673dff23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:54.258832 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1408/2854] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:45:54.263681 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fd438-3632-462e-a9db-da43900d34f2 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:54.273524 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fd438-3632-462e-a9db-da43900d34f2 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:54.280429 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52035e6a-6883-4b22-ad6c-64c187fc4a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:54.281110 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52035e6a-6883-4b22-ad6c-64c187fc4a5f admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:54.281394 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52035e6a-6883-4b22-ad6c-64c187fc4a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:54.281676 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52035e6a-6883-4b22-ad6c-64c187fc4a5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:54.282405 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52035e6a-6883-4b22-ad6c-64c187fc4a5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:45:54.282716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52035e6a-6883-4b22-ad6c-64c187fc4a5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:54.284439 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52035e6a-6883-4b22-ad6c-64c187fc4a5f admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:54.297704 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1447/2855] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:45:54.304123 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0dc74-6ac8-4475-9e41-655673dff23a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:54.313732 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0dc74-6ac8-4475-9e41-655673dff23a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:54.318983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c85a18-8598-4b2f-a741-3adbba3743ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:54.319690 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c85a18-8598-4b2f-a741-3adbba3743ee admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:54.319975 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c85a18-8598-4b2f-a741-3adbba3743ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:54.320253 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c85a18-8598-4b2f-a741-3adbba3743ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:54.320995 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c85a18-8598-4b2f-a741-3adbba3743ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:54.322986 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c85a18-8598-4b2f-a741-3adbba3743ee admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:54.352227 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1409/2856] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:45:54 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:45:54.356435 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52035e6a-6883-4b22-ad6c-64c187fc4a5f admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:54.367715 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52035e6a-6883-4b22-ad6c-64c187fc4a5f admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:54.418821 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:54.431674 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87368781-97eb-4579-aa97-6add76328d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:54.432402 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87368781-97eb-4579-aa97-6add76328d5d admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:54.432692 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87368781-97eb-4579-aa97-6add76328d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:54.432972 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87368781-97eb-4579-aa97-6add76328d5d admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:54.433686 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87368781-97eb-4579-aa97-6add76328d5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:54.435671 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87368781-97eb-4579-aa97-6add76328d5d admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:54.460933 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1448/2857] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:45:54 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:45:54.465857 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c85a18-8598-4b2f-a741-3adbba3743ee admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:54.476070 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c85a18-8598-4b2f-a741-3adbba3743ee admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:54.481315 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a270bd-f038-4ea2-9ec2-330b38cc35b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:54.481968 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a270bd-f038-4ea2-9ec2-330b38cc35b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:54.482257 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a270bd-f038-4ea2-9ec2-330b38cc35b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:54.482536 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a270bd-f038-4ea2-9ec2-330b38cc35b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:54.483262 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a270bd-f038-4ea2-9ec2-330b38cc35b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:54.484895 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a270bd-f038-4ea2-9ec2-330b38cc35b7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:54.495085 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1410/2858] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:45:54.498946 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87368781-97eb-4579-aa97-6add76328d5d admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:54.508713 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87368781-97eb-4579-aa97-6add76328d5d admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:54.513239 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86151d6-00af-4d7a-8d74-d2ee5859e87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:54.513879 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86151d6-00af-4d7a-8d74-d2ee5859e87a admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:54.514163 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86151d6-00af-4d7a-8d74-d2ee5859e87a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:54.514437 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86151d6-00af-4d7a-8d74-d2ee5859e87a admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:54.515152 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86151d6-00af-4d7a-8d74-d2ee5859e87a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:54.516762 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86151d6-00af-4d7a-8d74-d2ee5859e87a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:54.526419 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1449/2859] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:45:54.530842 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a270bd-f038-4ea2-9ec2-330b38cc35b7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:54.540774 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a270bd-f038-4ea2-9ec2-330b38cc35b7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:54.546790 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70daa810-41f3-4495-b967-d848ed6f99fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:54.547655 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daa810-41f3-4495-b967-d848ed6f99fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:54.547939 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daa810-41f3-4495-b967-d848ed6f99fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:54.548216 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daa810-41f3-4495-b967-d848ed6f99fc admin admin] PATH_INFO: `/v3/projects/761e41c0810549aca66a939cd758e3b5/users/0ff73a2a47ab41d5a40dcb8148341739/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:54.562941 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70daa810-41f3-4495-b967-d848ed6f99fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=761e41c0810549aca66a939cd758e3b5, user_id=0ff73a2a47ab41d5a40dcb8148341739, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:54.565646 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70daa810-41f3-4495-b967-d848ed6f99fc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:54.578652 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1411/2860] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:45:54 2022] PUT /identity/v3/projects/761e41c0810549aca66a939cd758e3b5/users/0ff73a2a47ab41d5a40dcb8148341739/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:54.589656 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf855f2-28b8-49e0-933e-3eb29cf9c4e1 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:54.589969 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf855f2-28b8-49e0-933e-3eb29cf9c4e1 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:54.590257 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf855f2-28b8-49e0-933e-3eb29cf9c4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:54.620523 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-4bf855f2-28b8-49e0-933e-3eb29cf9c4e1 None None] MFA Rules not processed for user `0ff73a2a47ab41d5a40dcb8148341739`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:54.622298 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-4bf855f2-28b8-49e0-933e-3eb29cf9c4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:54.691507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1450/2861] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:45:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:54.703943 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70daa810-41f3-4495-b967-d848ed6f99fc admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:54.705698 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-70daa810-41f3-4495-b967-d848ed6f99fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:54.764081 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70daa810-41f3-4495-b967-d848ed6f99fc admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:54.767095 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893eb9c-f057-4328-ba74-63f60ecd28a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:54.767755 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893eb9c-f057-4328-ba74-63f60ecd28a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:54.768045 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893eb9c-f057-4328-ba74-63f60ecd28a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:54.768426 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893eb9c-f057-4328-ba74-63f60ecd28a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:54.777505 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2893eb9c-f057-4328-ba74-63f60ecd28a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:54.778965 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2893eb9c-f057-4328-ba74-63f60ecd28a2 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:54.787969 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1412/2862] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:54.808139 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf855f2-28b8-49e0-933e-3eb29cf9c4e1 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:54.869049 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf855f2-28b8-49e0-933e-3eb29cf9c4e1 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:54.874104 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0039eb-ad49-4cdd-b801-24b3ef681fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:54.874952 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0039eb-ad49-4cdd-b801-24b3ef681fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:54.875233 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0039eb-ad49-4cdd-b801-24b3ef681fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:54.875505 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0039eb-ad49-4cdd-b801-24b3ef681fea admin admin] PATH_INFO: `/v3/users/0ff73a2a47ab41d5a40dcb8148341739` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:54.876709 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0039eb-ad49-4cdd-b801-24b3ef681fea admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ff73a2a47ab41d5a40dcb8148341739)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:54.878626 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0039eb-ad49-4cdd-b801-24b3ef681fea admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:54.923125 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ca0039eb-ad49-4cdd-b801-24b3ef681fea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ff73a2a47ab41d5a40dcb8148341739'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:54.930062 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ca0039eb-ad49-4cdd-b801-24b3ef681fea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ff73a2a47ab41d5a40dcb8148341739'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:54.930726 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ca0039eb-ad49-4cdd-b801-24b3ef681fea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ff73a2a47ab41d5a40dcb8148341739'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:54.935586 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:54.945748 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ca0039eb-ad49-4cdd-b801-24b3ef681fea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ff73a2a47ab41d5a40dcb8148341739'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:54.953235 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-ca0039eb-ad49-4cdd-b801-24b3ef681fea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ff73a2a47ab41d5a40dcb8148341739'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:54.959270 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1451/2863] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:45:54 2022] DELETE /identity/v3/users/0ff73a2a47ab41d5a40dcb8148341739 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:54.963717 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8f483-6bce-47b0-aca3-2f10743e2923 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:54.964010 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8f483-6bce-47b0-aca3-2f10743e2923 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:54.964292 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8f483-6bce-47b0-aca3-2f10743e2923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:54.981578 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-88e8f483-6bce-47b0-aca3-2f10743e2923 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:54.982766 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-88e8f483-6bce-47b0-aca3-2f10743e2923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:55.063155 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1413/2864] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:55.074074 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0039eb-ad49-4cdd-b801-24b3ef681fea admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:55.076786 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-ca0039eb-ad49-4cdd-b801-24b3ef681fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:55.147439 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0039eb-ad49-4cdd-b801-24b3ef681fea admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:55.154057 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd9640-d492-49fe-b2da-1911d3fbe360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:55.155104 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd9640-d492-49fe-b2da-1911d3fbe360 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:55.155572 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd9640-d492-49fe-b2da-1911d3fbe360 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:55.156023 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd9640-d492-49fe-b2da-1911d3fbe360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:55.172979 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd9640-d492-49fe-b2da-1911d3fbe360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:55.175779 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd9640-d492-49fe-b2da-1911d3fbe360 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:55.193211 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1452/2865] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:55.558160 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8f483-6bce-47b0-aca3-2f10743e2923 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:55.560531 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-88e8f483-6bce-47b0-aca3-2f10743e2923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:55.573976 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:55.582720 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8f483-6bce-47b0-aca3-2f10743e2923 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:55.594001 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4497573-47b1-400a-85f3-45749367941b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:55.595646 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4497573-47b1-400a-85f3-45749367941b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:55.596174 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4497573-47b1-400a-85f3-45749367941b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:55.597651 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4497573-47b1-400a-85f3-45749367941b admin admin] PATH_INFO: `/v3/projects/761e41c0810549aca66a939cd758e3b5` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:55.604021 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4497573-47b1-400a-85f3-45749367941b admin admin] RBAC: Authorizing `identity:delete_project(project_id=761e41c0810549aca66a939cd758e3b5)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:55.610943 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4497573-47b1-400a-85f3-45749367941b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:55.678928 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e4497573-47b1-400a-85f3-45749367941b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '761e41c0810549aca66a939cd758e3b5', 'request_id': 'req-e4497573-47b1-400a-85f3-45749367941b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:55.687628 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e4497573-47b1-400a-85f3-45749367941b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '761e41c0810549aca66a939cd758e3b5', 'request_id': 'req-e4497573-47b1-400a-85f3-45749367941b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:55.697730 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e4497573-47b1-400a-85f3-45749367941b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '761e41c0810549aca66a939cd758e3b5', 'request_id': 'req-e4497573-47b1-400a-85f3-45749367941b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:55.717164 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e4497573-47b1-400a-85f3-45749367941b admin admin] The token cache is being invalidate because project 761e41c0810549aca66a939cd758e3b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:45:55.717164 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e4497573-47b1-400a-85f3-45749367941b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:55.718123 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e4497573-47b1-400a-85f3-45749367941b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:55.719685 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1414/2866] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:45:55 2022] DELETE /identity/v3/projects/761e41c0810549aca66a939cd758e3b5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:55.728886 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be6518-8210-42bb-8739-70b7f239e4f0 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:55.729430 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be6518-8210-42bb-8739-70b7f239e4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:55.729430 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be6518-8210-42bb-8739-70b7f239e4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:55.748069 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-06be6518-8210-42bb-8739-70b7f239e4f0 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:55.749306 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-06be6518-8210-42bb-8739-70b7f239e4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:55.814552 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1453/2867] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:55.822205 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a345e-435a-4564-baf2-9aed36d9b0b3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:55.822601 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a345e-435a-4564-baf2-9aed36d9b0b3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:55.822992 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a345e-435a-4564-baf2-9aed36d9b0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:55.842451 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-688a345e-435a-4564-baf2-9aed36d9b0b3 None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:55.843766 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-688a345e-435a-4564-baf2-9aed36d9b0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:55.852179 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1415/2868] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:55.856911 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be6518-8210-42bb-8739-70b7f239e4f0 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:55.866585 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be6518-8210-42bb-8739-70b7f239e4f0 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:55.871182 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228e460-e5eb-498f-b33c-f5e60006b7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:55.872661 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228e460-e5eb-498f-b33c-f5e60006b7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:55.872948 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228e460-e5eb-498f-b33c-f5e60006b7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:55.873225 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228e460-e5eb-498f-b33c-f5e60006b7d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:55.873951 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228e460-e5eb-498f-b33c-f5e60006b7d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:45:55.874255 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228e460-e5eb-498f-b33c-f5e60006b7d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:55.875841 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228e460-e5eb-498f-b33c-f5e60006b7d6 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:55.887620 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1454/2869] 10.222.0.32 () {58 vars in 1152 bytes} [Thu Jun 2 13:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:45:55.891978 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a345e-435a-4564-baf2-9aed36d9b0b3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:55.905027 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a345e-435a-4564-baf2-9aed36d9b0b3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:55.909968 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea9ec8-ff77-42ba-9dc3-cd15e7eae618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:55.910867 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea9ec8-ff77-42ba-9dc3-cd15e7eae618 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:55.911007 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea9ec8-ff77-42ba-9dc3-cd15e7eae618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:55.911580 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea9ec8-ff77-42ba-9dc3-cd15e7eae618 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:55.911979 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea9ec8-ff77-42ba-9dc3-cd15e7eae618 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:55.914442 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea9ec8-ff77-42ba-9dc3-cd15e7eae618 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:55.942837 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1416/2870] 10.222.0.32 () {60 vars in 1152 bytes} [Thu Jun 2 13:45:55 2022] POST /identity/v3/projects => generated 399 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:45:55.947165 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228e460-e5eb-498f-b33c-f5e60006b7d6 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:55.957670 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228e460-e5eb-498f-b33c-f5e60006b7d6 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:56.027057 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994baff-7d4f-411f-8f05-c204b550cad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:56.028411 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994baff-7d4f-411f-8f05-c204b550cad7 admin admin] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:56.028744 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994baff-7d4f-411f-8f05-c204b550cad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:56.029024 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994baff-7d4f-411f-8f05-c204b550cad7 admin admin] PATH_INFO: `/v3/users` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:56.029717 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994baff-7d4f-411f-8f05-c204b550cad7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:56.031623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994baff-7d4f-411f-8f05-c204b550cad7 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:56.046849 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:56.056623 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1455/2871] 10.222.0.32 () {60 vars in 1143 bytes} [Thu Jun 2 13:45:55 2022] POST /identity/v3/users => generated 300 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:45:56.057803 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea9ec8-ff77-42ba-9dc3-cd15e7eae618 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:56.068027 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea9ec8-ff77-42ba-9dc3-cd15e7eae618 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:56.074627 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65646c-a3f1-4c42-8bca-17195ab059a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:56.075290 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65646c-a3f1-4c42-8bca-17195ab059a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:56.075983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65646c-a3f1-4c42-8bca-17195ab059a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:56.076261 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65646c-a3f1-4c42-8bca-17195ab059a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:56.077047 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65646c-a3f1-4c42-8bca-17195ab059a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:56.078709 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65646c-a3f1-4c42-8bca-17195ab059a0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:56.090738 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1417/2872] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:45:56.095058 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994baff-7d4f-411f-8f05-c204b550cad7 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:56.105349 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994baff-7d4f-411f-8f05-c204b550cad7 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:56.110679 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3befc2-99fc-49d8-ac9b-b2522f0b81ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:56.111657 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3befc2-99fc-49d8-ac9b-b2522f0b81ac admin admin] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:56.111952 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3befc2-99fc-49d8-ac9b-b2522f0b81ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:56.112931 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3befc2-99fc-49d8-ac9b-b2522f0b81ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:56.113675 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3befc2-99fc-49d8-ac9b-b2522f0b81ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:56.115286 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3befc2-99fc-49d8-ac9b-b2522f0b81ac admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:56.125649 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1456/2873] 10.222.0.32 () {58 vars in 1121 bytes} [Thu Jun 2 13:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:45:56.130056 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65646c-a3f1-4c42-8bca-17195ab059a0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:56.140674 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65646c-a3f1-4c42-8bca-17195ab059a0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:56.146282 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d743c1c-c3de-4607-883e-8ac591539b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:56.147354 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d743c1c-c3de-4607-883e-8ac591539b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:56.147641 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d743c1c-c3de-4607-883e-8ac591539b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:56.147937 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d743c1c-c3de-4607-883e-8ac591539b46 admin admin] PATH_INFO: `/v3/projects/56d342a7f0f641919a7e697c03f94fac/users/c43a7e9741f243cf9b2ed4c06f0e4ce8/roles/e4d5af06c5a44d479d25ce8490ce71a0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:56.165293 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d743c1c-c3de-4607-883e-8ac591539b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56d342a7f0f641919a7e697c03f94fac, user_id=c43a7e9741f243cf9b2ed4c06f0e4ce8, role_id=e4d5af06c5a44d479d25ce8490ce71a0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:56.168002 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d743c1c-c3de-4607-883e-8ac591539b46 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:56.181622 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1418/2874] 10.222.0.32 () {60 vars in 1482 bytes} [Thu Jun 2 13:45:56 2022] PUT /identity/v3/projects/56d342a7f0f641919a7e697c03f94fac/users/c43a7e9741f243cf9b2ed4c06f0e4ce8/roles/e4d5af06c5a44d479d25ce8490ce71a0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:56.193081 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df6da6-56b7-4d2c-b18d-1e8f53978aba None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:56.193377 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df6da6-56b7-4d2c-b18d-1e8f53978aba None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:56.193660 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df6da6-56b7-4d2c-b18d-1e8f53978aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:56.220898 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-08df6da6-56b7-4d2c-b18d-1e8f53978aba None None] MFA Rules not processed for user `c43a7e9741f243cf9b2ed4c06f0e4ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:56.222102 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-08df6da6-56b7-4d2c-b18d-1e8f53978aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:56.286558 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1457/2875] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:45:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:45:56.297787 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d743c1c-c3de-4607-883e-8ac591539b46 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:56.299739 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3d743c1c-c3de-4607-883e-8ac591539b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:56.360905 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d743c1c-c3de-4607-883e-8ac591539b46 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:56.365236 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363ca55-e40b-45c5-bf27-ea78d4249d52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a1e517aa87428ebdb1e54671a8d93d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:56.365881 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363ca55-e40b-45c5-bf27-ea78d4249d52 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:56.366201 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363ca55-e40b-45c5-bf27-ea78d4249d52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:56.366534 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363ca55-e40b-45c5-bf27-ea78d4249d52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:56.375490 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363ca55-e40b-45c5-bf27-ea78d4249d52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:56.377046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363ca55-e40b-45c5-bf27-ea78d4249d52 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:56.387745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1419/2876] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:56.888803 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df6da6-56b7-4d2c-b18d-1e8f53978aba None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:56.891108 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-08df6da6-56b7-4d2c-b18d-1e8f53978aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:56.968120 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df6da6-56b7-4d2c-b18d-1e8f53978aba None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:56.972775 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16a17f-e628-4f46-a1f2-a862cb910302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:56.973642 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16a17f-e628-4f46-a1f2-a862cb910302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:56.973926 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16a17f-e628-4f46-a1f2-a862cb910302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:56.974202 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16a17f-e628-4f46-a1f2-a862cb910302 admin admin] PATH_INFO: `/v3/users/4c181d9000214ce78c5acb11ac6f6f7e` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:56.975395 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16a17f-e628-4f46-a1f2-a862cb910302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c181d9000214ce78c5acb11ac6f6f7e)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:56.977473 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16a17f-e628-4f46-a1f2-a862cb910302 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:57.029494 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0c16a17f-e628-4f46-a1f2-a862cb910302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c181d9000214ce78c5acb11ac6f6f7e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:57.036870 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0c16a17f-e628-4f46-a1f2-a862cb910302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c181d9000214ce78c5acb11ac6f6f7e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:57.037566 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0c16a17f-e628-4f46-a1f2-a862cb910302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c181d9000214ce78c5acb11ac6f6f7e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:57.049782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0c16a17f-e628-4f46-a1f2-a862cb910302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c181d9000214ce78c5acb11ac6f6f7e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:57.053678 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:57.058426 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-0c16a17f-e628-4f46-a1f2-a862cb910302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c181d9000214ce78c5acb11ac6f6f7e'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:57.067542 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1458/2877] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:45:56 2022] DELETE /identity/v3/users/4c181d9000214ce78c5acb11ac6f6f7e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:45:57.242191 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363ca55-e40b-45c5-bf27-ea78d4249d52 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:57.258107 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363ca55-e40b-45c5-bf27-ea78d4249d52 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:57.280552 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:57.320277 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698eded5-305b-48f5-804b-087e04ba62cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:57.321158 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698eded5-305b-48f5-804b-087e04ba62cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:57.321440 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698eded5-305b-48f5-804b-087e04ba62cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:57.321716 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698eded5-305b-48f5-804b-087e04ba62cb admin admin] PATH_INFO: `/v3/projects/aa0c8692daa04252a385888208812cf4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:57.322891 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698eded5-305b-48f5-804b-087e04ba62cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa0c8692daa04252a385888208812cf4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:57.324893 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698eded5-305b-48f5-804b-087e04ba62cb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:57.383123 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-698eded5-305b-48f5-804b-087e04ba62cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa0c8692daa04252a385888208812cf4', 'request_id': 'req-698eded5-305b-48f5-804b-087e04ba62cb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:57.388694 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-698eded5-305b-48f5-804b-087e04ba62cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa0c8692daa04252a385888208812cf4', 'request_id': 'req-698eded5-305b-48f5-804b-087e04ba62cb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:57.398813 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-698eded5-305b-48f5-804b-087e04ba62cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa0c8692daa04252a385888208812cf4', 'request_id': 'req-698eded5-305b-48f5-804b-087e04ba62cb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:57.413366 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-698eded5-305b-48f5-804b-087e04ba62cb admin admin] The token cache is being invalidate because project aa0c8692daa04252a385888208812cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:45:57.414040 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-698eded5-305b-48f5-804b-087e04ba62cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:57.414745 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-698eded5-305b-48f5-804b-087e04ba62cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:45:57.417026 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1420/2878] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:45:57 2022] DELETE /identity/v3/projects/aa0c8692daa04252a385888208812cf4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:03.493936 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16a17f-e628-4f46-a1f2-a862cb910302 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:03.495359 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0c16a17f-e628-4f46-a1f2-a862cb910302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:03.509186 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16a17f-e628-4f46-a1f2-a862cb910302 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:03.566758 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28337867-b767-4f47-bd06-d75620ab6fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:03.567628 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28337867-b767-4f47-bd06-d75620ab6fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:03.567915 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28337867-b767-4f47-bd06-d75620ab6fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:03.568191 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28337867-b767-4f47-bd06-d75620ab6fb3 admin admin] PATH_INFO: `/v3/users/c43a7e9741f243cf9b2ed4c06f0e4ce8` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:03.569480 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28337867-b767-4f47-bd06-d75620ab6fb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c43a7e9741f243cf9b2ed4c06f0e4ce8)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:03.571428 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28337867-b767-4f47-bd06-d75620ab6fb3 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:03.617483 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-28337867-b767-4f47-bd06-d75620ab6fb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c43a7e9741f243cf9b2ed4c06f0e4ce8'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:03.624645 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-28337867-b767-4f47-bd06-d75620ab6fb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c43a7e9741f243cf9b2ed4c06f0e4ce8'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:03.625319 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-28337867-b767-4f47-bd06-d75620ab6fb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c43a7e9741f243cf9b2ed4c06f0e4ce8'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:03.637782 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-28337867-b767-4f47-bd06-d75620ab6fb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c43a7e9741f243cf9b2ed4c06f0e4ce8'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:03.645478 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-28337867-b767-4f47-bd06-d75620ab6fb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c43a7e9741f243cf9b2ed4c06f0e4ce8'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:03.651621 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1459/2879] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:46:03 2022] DELETE /identity/v3/users/c43a7e9741f243cf9b2ed4c06f0e4ce8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:03.656256 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24a01d-39d6-42bc-9384-d4325e6fe51d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:03.656765 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24a01d-39d6-42bc-9384-d4325e6fe51d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:03.656868 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24a01d-39d6-42bc-9384-d4325e6fe51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:03.674253 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ab24a01d-39d6-42bc-9384-d4325e6fe51d None None] MFA Rules not processed for user `9c16757fd814428091339e7b09bd9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:03.675458 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ab24a01d-39d6-42bc-9384-d4325e6fe51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:03.734649 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1421/2880] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:03.744188 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28337867-b767-4f47-bd06-d75620ab6fb3 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:03.746250 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-28337867-b767-4f47-bd06-d75620ab6fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:03.803770 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28337867-b767-4f47-bd06-d75620ab6fb3 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:03.807434 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be089bcc-e920-4c75-bc29-79699ce27506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:03.808081 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be089bcc-e920-4c75-bc29-79699ce27506 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:03.809019 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be089bcc-e920-4c75-bc29-79699ce27506 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:03.809303 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be089bcc-e920-4c75-bc29-79699ce27506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:03.818410 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be089bcc-e920-4c75-bc29-79699ce27506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:03.819843 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be089bcc-e920-4c75-bc29-79699ce27506 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:03.829700 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1460/2881] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:04.093668 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24a01d-39d6-42bc-9384-d4325e6fe51d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:04.095096 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ab24a01d-39d6-42bc-9384-d4325e6fe51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:04.107740 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24a01d-39d6-42bc-9384-d4325e6fe51d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:04.112598 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9785a77-58ff-4d14-bc6e-b1e5432fc931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:04.113500 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9785a77-58ff-4d14-bc6e-b1e5432fc931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:04.113782 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9785a77-58ff-4d14-bc6e-b1e5432fc931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:04.114051 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9785a77-58ff-4d14-bc6e-b1e5432fc931 admin admin] PATH_INFO: `/v3/projects/56d342a7f0f641919a7e697c03f94fac` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:04.115327 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9785a77-58ff-4d14-bc6e-b1e5432fc931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56d342a7f0f641919a7e697c03f94fac)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:04.117460 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9785a77-58ff-4d14-bc6e-b1e5432fc931 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:04.171627 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c9785a77-58ff-4d14-bc6e-b1e5432fc931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56d342a7f0f641919a7e697c03f94fac', 'request_id': 'req-c9785a77-58ff-4d14-bc6e-b1e5432fc931'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:04.172878 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:04.179692 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c9785a77-58ff-4d14-bc6e-b1e5432fc931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56d342a7f0f641919a7e697c03f94fac', 'request_id': 'req-c9785a77-58ff-4d14-bc6e-b1e5432fc931'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:04.189094 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c9785a77-58ff-4d14-bc6e-b1e5432fc931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56d342a7f0f641919a7e697c03f94fac', 'request_id': 'req-c9785a77-58ff-4d14-bc6e-b1e5432fc931'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:04.201888 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c9785a77-58ff-4d14-bc6e-b1e5432fc931 admin admin] The token cache is being invalidate because project 56d342a7f0f641919a7e697c03f94fac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:46:04.202191 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c9785a77-58ff-4d14-bc6e-b1e5432fc931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:04.202872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c9785a77-58ff-4d14-bc6e-b1e5432fc931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:46:04.204527 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1422/2882] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:46:04 2022] DELETE /identity/v3/projects/56d342a7f0f641919a7e697c03f94fac => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:46:13.825440 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=81,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:14.197894 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=3,keystone:SELECT=6,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:19.571883 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be089bcc-e920-4c75-bc29-79699ce27506 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:19.581017 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be089bcc-e920-4c75-bc29-79699ce27506 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:19.638375 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0bfbf5-b80e-4b0f-87f8-e09fc7508a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:19.639032 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bfbf5-b80e-4b0f-87f8-e09fc7508a6e service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:19.639320 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bfbf5-b80e-4b0f-87f8-e09fc7508a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:19.639603 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bfbf5-b80e-4b0f-87f8-e09fc7508a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:19.641463 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-cc0bfbf5-b80e-4b0f-87f8-e09fc7508a6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:19.651323 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0bfbf5-b80e-4b0f-87f8-e09fc7508a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:19.652819 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0bfbf5-b80e-4b0f-87f8-e09fc7508a6e service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:19.662839 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1461/2883] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:29.657667 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=26 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:45.402352 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9785a77-58ff-4d14-bc6e-b1e5432fc931 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:45.403843 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c9785a77-58ff-4d14-bc6e-b1e5432fc931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:45.416557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9785a77-58ff-4d14-bc6e-b1e5432fc931 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:45.420123 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55f8a7-20ad-4bf9-8ff4-f98f165e341c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:45.420824 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55f8a7-20ad-4bf9-8ff4-f98f165e341c service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:45.421110 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55f8a7-20ad-4bf9-8ff4-f98f165e341c service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:45.421395 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55f8a7-20ad-4bf9-8ff4-f98f165e341c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:45.423093 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1c55f8a7-20ad-4bf9-8ff4-f98f165e341c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:45.494787 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c55f8a7-20ad-4bf9-8ff4-f98f165e341c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:45.496137 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c55f8a7-20ad-4bf9-8ff4-f98f165e341c service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:45.507962 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1423/2884] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:46.683817 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0bfbf5-b80e-4b0f-87f8-e09fc7508a6e service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:46.695652 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0bfbf5-b80e-4b0f-87f8-e09fc7508a6e service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:46.702110 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c475f3f-3a4b-4ffe-8a33-110ad4b29910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:46.703207 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c475f3f-3a4b-4ffe-8a33-110ad4b29910 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:46.703700 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c475f3f-3a4b-4ffe-8a33-110ad4b29910 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:46.704181 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c475f3f-3a4b-4ffe-8a33-110ad4b29910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:46.707774 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0c475f3f-3a4b-4ffe-8a33-110ad4b29910 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:46.722520 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c475f3f-3a4b-4ffe-8a33-110ad4b29910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:46.723944 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c475f3f-3a4b-4ffe-8a33-110ad4b29910 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:46.734891 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1462/2885] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:48.170146 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55f8a7-20ad-4bf9-8ff4-f98f165e341c service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:48.171923 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1c55f8a7-20ad-4bf9-8ff4-f98f165e341c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:48.196699 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55f8a7-20ad-4bf9-8ff4-f98f165e341c service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:48.203291 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef1541-8a73-40f8-add2-d9a73f91452d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:48.204019 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef1541-8a73-40f8-add2-d9a73f91452d service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:48.204417 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef1541-8a73-40f8-add2-d9a73f91452d service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:48.204697 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef1541-8a73-40f8-add2-d9a73f91452d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:48.207167 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c9ef1541-8a73-40f8-add2-d9a73f91452d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:48.221658 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef1541-8a73-40f8-add2-d9a73f91452d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:48.223967 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef1541-8a73-40f8-add2-d9a73f91452d service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:48.236454 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1424/2886] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:50.134246 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87102ee8-27d8-467c-b558-69257376749a None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:50.134736 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87102ee8-27d8-467c-b558-69257376749a None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:50.134848 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87102ee8-27d8-467c-b558-69257376749a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:50.151506 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-87102ee8-27d8-467c-b558-69257376749a None None] MFA Rules not processed for user `64d281c3f8e447aaacb073ed0f8c7a35`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:50.152759 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-87102ee8-27d8-467c-b558-69257376749a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:50.208091 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1463/2887] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:47:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:50.515254 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef1541-8a73-40f8-add2-d9a73f91452d service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:50.525173 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef1541-8a73-40f8-add2-d9a73f91452d service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:50.528746 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf609b9-e1da-4bc5-9768-b1f1dacc4948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:50.529377 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf609b9-e1da-4bc5-9768-b1f1dacc4948 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:50.529659 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf609b9-e1da-4bc5-9768-b1f1dacc4948 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:50.529936 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf609b9-e1da-4bc5-9768-b1f1dacc4948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:50.531712 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cbf609b9-e1da-4bc5-9768-b1f1dacc4948 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:50.541793 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf609b9-e1da-4bc5-9768-b1f1dacc4948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:50.543220 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf609b9-e1da-4bc5-9768-b1f1dacc4948 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:50.551282 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1425/2888] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:51.008643 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87102ee8-27d8-467c-b558-69257376749a None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:51.010462 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-87102ee8-27d8-467c-b558-69257376749a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:51.084615 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87102ee8-27d8-467c-b558-69257376749a None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:51.089580 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ad447-d942-4092-9008-588bac518920 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24410ef5e78042c79c5b4a0d78b56258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:51.090221 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ad447-d942-4092-9008-588bac518920 service placement] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:51.090507 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ad447-d942-4092-9008-588bac518920 service placement] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:51.090786 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ad447-d942-4092-9008-588bac518920 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:51.092591 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-8c0ad447-d942-4092-9008-588bac518920 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:51.104160 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ad447-d942-4092-9008-588bac518920 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:51.105755 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ad447-d942-4092-9008-588bac518920 service placement] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:51.116545 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1464/2889] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:48:00.547733 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=46 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:01.111889 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=63 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:04.987652 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf609b9-e1da-4bc5-9768-b1f1dacc4948 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:48:05.016889 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf609b9-e1da-4bc5-9768-b1f1dacc4948 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:48:05.024872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e444e-65a0-4978-9494-8826a06f85b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:48:05.024872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e444e-65a0-4978-9494-8826a06f85b4 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:48:05.024872 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e444e-65a0-4978-9494-8826a06f85b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:48:05.025482 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e444e-65a0-4978-9494-8826a06f85b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:48:05.027068 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-750e444e-65a0-4978-9494-8826a06f85b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:48:05.044232 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e444e-65a0-4978-9494-8826a06f85b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:48:05.046118 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e444e-65a0-4978-9494-8826a06f85b4 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:48:05.061995 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1426/2890] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:48:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:48:15.056192 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=6 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:49:57.078386 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44c9ef-2b43-4536-8926-95980d678278 None None] REQUEST_METHOD: `POST` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:57.078964 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44c9ef-2b43-4536-8926-95980d678278 None None] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:57.079370 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44c9ef-2b43-4536-8926-95980d678278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:57.108840 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.auth.core [None req-bf44c9ef-2b43-4536-8926-95980d678278 None None] MFA Rules not processed for user `64d281c3f8e447aaacb073ed0f8c7a35`. Rule list: `[]` (Enabled: `True`). {{(pid=80182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:49:57.110046 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-bf44c9ef-2b43-4536-8926-95980d678278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:57.133918 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1465/2891] 10.222.0.32 () {58 vars in 957 bytes} [Thu Jun 2 13:49:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:49:58.361494 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e444e-65a0-4978-9494-8826a06f85b4 service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:49:58.362980 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-750e444e-65a0-4978-9494-8826a06f85b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:58.448260 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e444e-65a0-4978-9494-8826a06f85b4 service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:49:58.453910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d8a80-a7b8-4766-8319-f7fcae8a15f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24410ef5e78042c79c5b4a0d78b56258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:49:58.454557 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d8a80-a7b8-4766-8319-f7fcae8a15f2 service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:49:58.454846 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d8a80-a7b8-4766-8319-f7fcae8a15f2 service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:49:58.455129 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d8a80-a7b8-4766-8319-f7fcae8a15f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:49:58.456938 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9e9d8a80-a7b8-4766-8319-f7fcae8a15f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:49:58.469677 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d8a80-a7b8-4766-8319-f7fcae8a15f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:49:58.471283 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d8a80-a7b8-4766-8319-f7fcae8a15f2 service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:49:58.482949 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1427/2892] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:49:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:50:01.267698 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44c9ef-2b43-4536-8926-95980d678278 None None] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:50:01.298186 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44c9ef-2b43-4536-8926-95980d678278 None None] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:50:01.303854 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46c6b3-1b9f-4412-9fb7-49e8025f7299 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:50:01.304561 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46c6b3-1b9f-4412-9fb7-49e8025f7299 service nova] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:01.304852 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46c6b3-1b9f-4412-9fb7-49e8025f7299 service nova] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:01.305134 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46c6b3-1b9f-4412-9fb7-49e8025f7299 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:01.306903 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0f46c6b3-1b9f-4412-9fb7-49e8025f7299 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:50:01.317632 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46c6b3-1b9f-4412-9fb7-49e8025f7299 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:50:01.319224 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46c6b3-1b9f-4412-9fb7-49e8025f7299 service nova] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:50:01.329657 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1466/2893] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:50:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:50:08.477329 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=37 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:50:11.324785 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=28 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:51:45.806965 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d8a80-a7b8-4766-8319-f7fcae8a15f2 service placement] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:51:45.808657 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9e9d8a80-a7b8-4766-8319-f7fcae8a15f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:51:45.838875 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d8a80-a7b8-4766-8319-f7fcae8a15f2 service placement] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:51:45.844337 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afeb4e5-5f2c-41e8-987d-b55a8138ffc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e5d9f3c4e04ca3bf52b28b67d2a4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:51:45.844983 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afeb4e5-5f2c-41e8-987d-b55a8138ffc5 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:51:45.845267 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afeb4e5-5f2c-41e8-987d-b55a8138ffc5 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:51:45.845544 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afeb4e5-5f2c-41e8-987d-b55a8138ffc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:51:45.847464 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9afeb4e5-5f2c-41e8-987d-b55a8138ffc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:51:45.860984 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afeb4e5-5f2c-41e8-987d-b55a8138ffc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:51:45.862897 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afeb4e5-5f2c-41e8-987d-b55a8138ffc5 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:51:45.874307 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1428/2894] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:51:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:51:55.869296 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=11 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:51:56.133762 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46c6b3-1b9f-4412-9fb7-49e8025f7299 service nova] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:51:56.135253 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-0f46c6b3-1b9f-4412-9fb7-49e8025f7299 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:51:56.175123 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46c6b3-1b9f-4412-9fb7-49e8025f7299 service nova] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:51:56.178919 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b28098-4b6c-4f0c-8c47-e814b6d60387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb2722c122f4aeba23ec16b5a3c485f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:51:56.179560 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b28098-4b6c-4f0c-8c47-e814b6d60387 service neutron] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:51:56.179847 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b28098-4b6c-4f0c-8c47-e814b6d60387 service neutron] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:51:56.180139 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b28098-4b6c-4f0c-8c47-e814b6d60387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:51:56.182228 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-10b28098-4b6c-4f0c-8c47-e814b6d60387 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:51:56.270059 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b28098-4b6c-4f0c-8c47-e814b6d60387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:51:56.272117 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b28098-4b6c-4f0c-8c47-e814b6d60387 service neutron] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:51:56.291360 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1467/2895] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:51:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:51:59.432440 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afeb4e5-5f2c-41e8-987d-b55a8138ffc5 service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:51:59.445761 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afeb4e5-5f2c-41e8-987d-b55a8138ffc5 service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:51:59.451003 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065115e3-3b7e-49ce-b6db-25e624f7e2c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24410ef5e78042c79c5b4a0d78b56258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:51:59.451730 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065115e3-3b7e-49ce-b6db-25e624f7e2c0 service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:51:59.452127 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065115e3-3b7e-49ce-b6db-25e624f7e2c0 service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:51:59.452521 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065115e3-3b7e-49ce-b6db-25e624f7e2c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:51:59.454440 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-065115e3-3b7e-49ce-b6db-25e624f7e2c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:51:59.468421 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065115e3-3b7e-49ce-b6db-25e624f7e2c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:51:59.470135 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065115e3-3b7e-49ce-b6db-25e624f7e2c0 service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:51:59.482396 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1429/2896] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:51:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:52:02.710189 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b28098-4b6c-4f0c-8c47-e814b6d60387 service neutron] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:52:02.712256 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-10b28098-4b6c-4f0c-8c47-e814b6d60387 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:52:02.733755 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b28098-4b6c-4f0c-8c47-e814b6d60387 service neutron] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:52:02.738760 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339a564-7e2b-410b-a981-1e2c48a5002a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:52:02.740192 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339a564-7e2b-410b-a981-1e2c48a5002a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:02.740506 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339a564-7e2b-410b-a981-1e2c48a5002a admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:02.740781 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339a564-7e2b-410b-a981-1e2c48a5002a admin admin] PATH_INFO: `/v3/users/64d281c3f8e447aaacb073ed0f8c7a35` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:02.741974 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339a564-7e2b-410b-a981-1e2c48a5002a admin admin] RBAC: Authorizing `identity:delete_user(user_id=64d281c3f8e447aaacb073ed0f8c7a35)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:52:02.743888 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339a564-7e2b-410b-a981-1e2c48a5002a admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:52:02.793681 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1339a564-7e2b-410b-a981-1e2c48a5002a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64d281c3f8e447aaacb073ed0f8c7a35'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:52:02.800875 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1339a564-7e2b-410b-a981-1e2c48a5002a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64d281c3f8e447aaacb073ed0f8c7a35'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:52:02.801603 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1339a564-7e2b-410b-a981-1e2c48a5002a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64d281c3f8e447aaacb073ed0f8c7a35'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:52:02.814913 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1339a564-7e2b-410b-a981-1e2c48a5002a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64d281c3f8e447aaacb073ed0f8c7a35'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:52:02.823716 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-1339a564-7e2b-410b-a981-1e2c48a5002a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64d281c3f8e447aaacb073ed0f8c7a35'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:52:02.829999 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1468/2897] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:52:02 2022] DELETE /identity/v3/users/64d281c3f8e447aaacb073ed0f8c7a35 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:52:03.020736 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065115e3-3b7e-49ce-b6db-25e624f7e2c0 service placement] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:52:03.034921 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065115e3-3b7e-49ce-b6db-25e624f7e2c0 service placement] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:52:03.104476 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c6e44-bcc9-4e47-b933-6ae24219e989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:52:03.105363 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c6e44-bcc9-4e47-b933-6ae24219e989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:03.105632 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c6e44-bcc9-4e47-b933-6ae24219e989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:03.107821 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c6e44-bcc9-4e47-b933-6ae24219e989 admin admin] PATH_INFO: `/v3/projects/25b312790b9644bb8fbe30d2ab637db0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:03.107821 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c6e44-bcc9-4e47-b933-6ae24219e989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25b312790b9644bb8fbe30d2ab637db0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:52:03.109215 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c6e44-bcc9-4e47-b933-6ae24219e989 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:52:03.162316 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c27c6e44-bcc9-4e47-b933-6ae24219e989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25b312790b9644bb8fbe30d2ab637db0', 'request_id': 'req-c27c6e44-bcc9-4e47-b933-6ae24219e989'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:52:03.168644 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c27c6e44-bcc9-4e47-b933-6ae24219e989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25b312790b9644bb8fbe30d2ab637db0', 'request_id': 'req-c27c6e44-bcc9-4e47-b933-6ae24219e989'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:52:03.182373 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c27c6e44-bcc9-4e47-b933-6ae24219e989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25b312790b9644bb8fbe30d2ab637db0', 'request_id': 'req-c27c6e44-bcc9-4e47-b933-6ae24219e989'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:52:03.197361 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c27c6e44-bcc9-4e47-b933-6ae24219e989 admin admin] The token cache is being invalidate because project 25b312790b9644bb8fbe30d2ab637db0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:52:03.197676 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c27c6e44-bcc9-4e47-b933-6ae24219e989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:52:03.198321 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c27c6e44-bcc9-4e47-b933-6ae24219e989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:52:03.199898 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1430/2898] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:52:03 2022] DELETE /identity/v3/projects/25b312790b9644bb8fbe30d2ab637db0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:52:03.204514 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339a564-7e2b-410b-a981-1e2c48a5002a admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:52:03.205933 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-1339a564-7e2b-410b-a981-1e2c48a5002a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:52:03.219795 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339a564-7e2b-410b-a981-1e2c48a5002a admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:52:03.232970 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:52:03.280695 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222b7fd-4b69-4f16-bc3b-5d77306c3f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:52:03.281583 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222b7fd-4b69-4f16-bc3b-5d77306c3f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:03.281873 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222b7fd-4b69-4f16-bc3b-5d77306c3f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:03.282154 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222b7fd-4b69-4f16-bc3b-5d77306c3f73 admin admin] PATH_INFO: `/v3/users/8568dd6145f54f46bb2781968b5c4ac9` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:03.283390 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222b7fd-4b69-4f16-bc3b-5d77306c3f73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8568dd6145f54f46bb2781968b5c4ac9)` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:52:03.285381 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222b7fd-4b69-4f16-bc3b-5d77306c3f73 admin admin] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:52:03.336371 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a222b7fd-4b69-4f16-bc3b-5d77306c3f73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8568dd6145f54f46bb2781968b5c4ac9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:52:03.343330 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a222b7fd-4b69-4f16-bc3b-5d77306c3f73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8568dd6145f54f46bb2781968b5c4ac9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:52:03.344094 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a222b7fd-4b69-4f16-bc3b-5d77306c3f73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8568dd6145f54f46bb2781968b5c4ac9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:52:03.356659 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a222b7fd-4b69-4f16-bc3b-5d77306c3f73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8568dd6145f54f46bb2781968b5c4ac9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:52:03.367755 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.notifications [None req-a222b7fd-4b69-4f16-bc3b-5d77306c3f73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8568dd6145f54f46bb2781968b5c4ac9'} {{(pid=80182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:52:03.374959 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1469/2899] 10.222.0.32 () {58 vars in 1223 bytes} [Thu Jun 2 13:52:03 2022] DELETE /identity/v3/users/8568dd6145f54f46bb2781968b5c4ac9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:52:03.563947 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c6e44-bcc9-4e47-b933-6ae24219e989 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:52:03.565580 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c27c6e44-bcc9-4e47-b933-6ae24219e989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:52:03.580801 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c6e44-bcc9-4e47-b933-6ae24219e989 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:52:03.640476 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7d5ea-24a0-449f-8670-657a0c2853bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c16757fd814428091339e7b09bd9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c7119c3fda547cdad0db42ad18b471e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:52:03.641348 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7d5ea-24a0-449f-8670-657a0c2853bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:03.641631 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7d5ea-24a0-449f-8670-657a0c2853bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:03.641910 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7d5ea-24a0-449f-8670-657a0c2853bd admin admin] PATH_INFO: `/v3/projects/54a5ef516e584e66941825e061afdfac` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:03.643147 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7d5ea-24a0-449f-8670-657a0c2853bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=54a5ef516e584e66941825e061afdfac)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:52:03.645121 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7d5ea-24a0-449f-8670-657a0c2853bd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:52:03.668197 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:52:03.697423 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d2c7d5ea-24a0-449f-8670-657a0c2853bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54a5ef516e584e66941825e061afdfac', 'request_id': 'req-d2c7d5ea-24a0-449f-8670-657a0c2853bd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:52:03.702819 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d2c7d5ea-24a0-449f-8670-657a0c2853bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54a5ef516e584e66941825e061afdfac', 'request_id': 'req-d2c7d5ea-24a0-449f-8670-657a0c2853bd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:52:03.710480 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d2c7d5ea-24a0-449f-8670-657a0c2853bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54a5ef516e584e66941825e061afdfac', 'request_id': 'req-d2c7d5ea-24a0-449f-8670-657a0c2853bd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:52:03.722084 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d2c7d5ea-24a0-449f-8670-657a0c2853bd admin admin] The token cache is being invalidate because project 54a5ef516e584e66941825e061afdfac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:52:03.722374 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d2c7d5ea-24a0-449f-8670-657a0c2853bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:52:03.723046 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d2c7d5ea-24a0-449f-8670-657a0c2853bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:52:03.724692 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1431/2900] 10.222.0.32 () {58 vars in 1232 bytes} [Thu Jun 2 13:52:03 2022] DELETE /identity/v3/projects/54a5ef516e584e66941825e061afdfac => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:52:13.370406 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=45,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:52:13.718995 dv-cinder-836083-8-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:30.843055 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222b7fd-4b69-4f16-bc3b-5d77306c3f73 admin admin] Authenticating user token {{(pid=80182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:30.844506 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-a222b7fd-4b69-4f16-bc3b-5d77306c3f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:30.913672 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222b7fd-4b69-4f16-bc3b-5d77306c3f73 admin admin] Validating token access rules against request {{(pid=80182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:30.973133 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284eb662-c860-456d-9dbc-10a07be7f041 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24410ef5e78042c79c5b4a0d78b56258', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9007447059e4862972078c032a5d67b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:30.973789 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284eb662-c860-456d-9dbc-10a07be7f041 service placement] REQUEST_METHOD: `GET` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:30.974082 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284eb662-c860-456d-9dbc-10a07be7f041 service placement] SCRIPT_NAME: `/identity` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:30.974365 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284eb662-c860-456d-9dbc-10a07be7f041 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:30.976158 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.fernet_utils [None req-284eb662-c860-456d-9dbc-10a07be7f041 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:30.987322 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284eb662-c860-456d-9dbc-10a07be7f041 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:30.988946 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284eb662-c860-456d-9dbc-10a07be7f041 service placement] RBAC: Authorization granted {{(pid=80182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:30.999186 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: [pid: 80182|app: 0|req: 1470/2901] 10.222.0.32 () {60 vars in 1365 bytes} [Thu Jun 2 13:55:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:55:40.994615 dv-cinder-836083-8-iscsi devstack@keystone.service[80182]: DEBUG dbcounter [-] [80182] Writing DB stats keystone:SELECT=58 {{(pid=80182) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}